Sr Python Developer

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.

Required Skills:

• Python: Advanced proficiency with extensive experience in building data pipelines.
• AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
• Spark: Proficient in using Apache Spark for large-scale data processing.
• Scala: Working knowledge of Scala for Spark programming.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with SQL and relational databases.
• Familiarity with data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

• Proficient knowledge of Django and Django REST framework 
• Experience and good understanding of Redis
• Good knowledge and understanding of PostgreSQL or other relational databases 
• Proficient in NoSQL document databases especially MongoDB. 
• Understanding of threading and multiprocessing in Python, and multi-process architecture 
• Good-enough understanding of version control systems like Git or Mercurial 
• Strong unit-test and debugging skills 
• Knowledge of container technologies (specially Docker) and orchestration systems is a plus 
• Strong understanding of various Python Libraries, APIs, and toolkits
• Excellent understanding of MVC and OOP
• Rapid prototyping skills for getting product feedback 
• Experience with Agile and SCRUM methodology

Requirements

• 3+ years work experience with production-grade python. Contribution to open source repos is preferred
• Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
• Experience with one relational & 1 non-relational DB is preferred
• Prior work in the ML domain will be a big boost

What You’ll Do

• Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
• Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
• Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
• Write maintainable, scalable performant python code
• Building gRPC, rest API servers
• Working with Thrift, Protobufs, etc.

We are looking for a Backend Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well.

• Writing reusable, testable, and efficient code
• Design and implementation of low-latency, high-availability, and performant applications
• Implementation of security and data protection strategies like circuit breaker, rate limiting.
• Integration of data storage solutions like OLTP(RDS, Postgres), OLAP(Redshift) and Cache(redis, memcache) servers with applications.
• End to end responsibility from development to production.
• Ability to work in odd hours in-case of emergencies.
• Well aware of server-less, containers and microservices technologies(like Lambda, Fargate, ECS, EKS).

• Experience 1.5+ yrs in the Software Industry.
• Mastery in Python with knowledge of at least one Python web framework (such as Django, Flask) with amazing debugging skills.
• Familiarity with some ORM (Object Relational Mapper) and caching libraries
• Understanding of the threading limitations of Python, and multi-process architecture
• Good understanding of server-side templating languages such as Jinja 2, Mako
• Basic understanding of front-end technologies, such as Jquery, JavaScript, HTML5, and CSS3
• Understanding of accessibility and security compliance
• Knowledge of user authentication and authorization between multiple systems, servers, and environments
• Understanding of fundamental design principles behind a scalable application
• Familiarity with event-driven programming in Python
• Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform
• Able to create extendible database schemas that represent and support business processes
• Strong unit test and debugging skills
• Proficient understanding of code versioning tools such as Git or SVN
• Make sure to mention other frameworks, libraries, or any other technology related to your development stack

• Deliver features in an end-to-end manner: technical design, development, testing, deployment, and maintenance.
• Provide technical leadership and own specific areas of the platform.
• Work closely with Product Managers to translate product requirements to engineering specifications.
• Lead code review efforts and quality efforts in your area of ownership.
• Participate in product discussions, taking ownership and initiative.
• Work independently in a fast-paced environment.
• Mentored and guide junior engineers.

Must Haves:

• Minimum 2 years of working experience in Ruby on Rails/ Python/ Node.JS.
• Strong problem-solving skills, data structures, and algorithms.
• Excellent experience on databases like MySQL, PostgreSQL, etc.
• Familiarity with tools for code reviews, version control (GIT).
• A knack for writing clean, readable Ruby/ Python/Node.JS code.
• Experience in application server hosting and monitoring.
• Understanding of fundamental design principles behind a scalable application.

Nice to Have:

• Hands-on with search platforms (Solr, Elasticsearch, etc).
• Prior experience with microservices-based architecture/SOA/distributed systems.
• Able to implement automated testing platforms and unit tests.
• Experience with common AWS service EC2, RDS, S3, SES, etc.

Key Competencies:

• Building Effective Team
• Solving Problems Creatively
• Learning Agility
• Drive For Result

• Experience of using Python/ Django frameworks in building back end for Full Stack Applications
• Hands on experience on Web frameworks, Restful APIs and SOAP
• Strong command on SQL (or relevant query language or ORM queries)
• Knowledge of front-end technologies such as React Native, React.js, Angular.js or Javascript

We are seeking a lead Python Developer to lead the backend efforts and, in the process design, develop, and deploy its customer centric applications.

The person will have the opportunity to design and build an early stage, rapidly evolving platform from scratch and carry out these primary responsibilities -

Optimize components for maximum performance across multiple devices and browsers

Write performant REST APIs for both internal and external consumption

Build micro services and their deployment process

Work with problems of scale, leveraging technologies that are distributed in nature.

Perform code reviews

Required qualifications and must have skills

Excellent analytical and problem-solving skills

Proven-deep-expertise with Python programming (4+ years of hands-on experience in Python and backend development)

Building performant and scalable applications from scratch

Experience in working with frameworks like Django, Flask, etc.

Experience with building APIs and services using REST, SOAP, etc.

Experience with any RDBMS and strong SQL knowledge

Comfortable with Unix / Linux command line

Object-oriented concepts & design patterns

Sytem and database desinging skills

Nice to have Skills

Knowledge of other programming languages beyond Python

Familiarity with managing infrastructure on AWS/GCloud

Experience with working with/building data analytics pipleline

Familiarity with NoSQL databases

Good understanding of Docker and container platforms like Mesos and Kubernetes

Security-first architecture approach

Application benchmarking and optimization

Interpersonal Attributes

You are driven by the impact your work creates

You can answer the why behind any technological choice you make

You can work independently as well as part of a team