Python backend developer

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.

Required Skills:

• Python: Advanced proficiency with extensive experience in building data pipelines.
• AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
• Spark: Proficient in using Apache Spark for large-scale data processing.
• Scala: Working knowledge of Scala for Spark programming.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with SQL and relational databases.
• Familiarity with data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Job Description:

We are looking for a Python Developer to join our team and help us

develop and maintain various software products. A self-driven coder with a zeal to

learn and work on multiple projects. Ultimately responsible for building highly

responsive web applications that align with our business needs.

Required Skills:

1. Extensive experience developing enterprise applications using Python.

2. Extensive experience in designing applications using the framework Django Flask.

3. Must have good hands-on Django and Django Rest Framework for web

framework.

4. Familiarity with some ORM (Object Relational Mapper) libraries.

5. Able to integrate multiple data sources and databases into one system

6. Understanding of the threading limitations of Python, and multi-process

architecture.

7. Basic understanding of web mark-up, front-end technologies such as JavaScript,

HTML5, and CSS3 .

8. Extensive experience with MySQL or any relational database.

9. Familiarity with event-driven programming in Python.

10. Must be well versed with Docker.

11. Understanding of the differences between multiple delivery platforms, such as

mobile vs desktop, and optimizing output to match the specific platform.

12. Strong unit test and debugging skills.

13. Knowledge of AI, and chat GPT will be added.

14. Should have experience in LANG Chain.

15. Proficient understanding of code versioning tools.

16. Must have basic knowledge of Machine Learning or Bots & and work experience is a plus.

Roles and Responsibilities:

1. Should be responsible for the development of applications in Python (Framework).

2. Integration of user-facing elements developed by front-end developers with server-side logic.

3. Will be mainly responsible for developing with Django & Flask framework.

4. Will be responsible for writing reusable, testable, and efficient code.

5. Will be working in a team or individually as per the requirement.

6. Can also be involved in client handling, and requirement gathering as per the demand of the project.

7. Prime focus will be ensuring high performance and responsiveness to requests from the front-end

Required Skills/Qualifications: 

∙         B.Tech/MCA in Comput

Required Skills/Qualifications: 

Any Backend Technology is acceptable

∙         B.Tech/MCA in Computer Science or equivalent with 1-3 years’ experience with server-side web application development.

∙         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

∙         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

∙         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

∙         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

∙         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

∙         Understanding of Version Management Tools like GitHub.

er Science or equivalent with 1-3 years’ experience with server-side web application development.

∙         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

∙         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

∙         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

∙         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

∙         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

∙         Understanding of Version Management Tools like GitHub.

About the role

Checking quality is one of the most important tasks at Anakin. Our clients are pricing their products based on our data, and minor errors on our end can lead to our client's losses of millions of dollars. You would work with multiple tools and with people across various departments to ensure the accuracy of the data being crawled. You would setup manual and automated processes and make sure they run to ensure the highest possible data quality.

You are the engineer other engineers can count on. You embrace every problem with enthusiasm. You remove hurdles, are a self-starter, team player. You have the hunger to venture into unknown areas and make the system work.

Your Responsibilities would be to:

• Understand customer web scraping and data requirements; translate these into test approaches that include exploratory manual/visual testing and any additional automated tests deemed appropriate
• Take ownership of the end-to-end QA process in newly-started projects
• Draw conclusions about data quality by producing basic descriptive statistics, summaries, and visualisations
• Proactively suggest and take ownership of improvements to QA processes and methodologies by employing other technologies and tools, including but not limited to: browser add-ons, Excel add-ons, UI-based test automation tools etc.
• Ensure that project requirements are testable; work with project managers and/or clients to clarify ambiguities before QA begins
• Drive innovation and advanced validation and analytics techniques to ensure data quality for Anakin's customers
• Optimize data quality codebases and systems to monitor the Anakin family of app crawlers
• Configure and optimize the automated and manual testing and deployment systems used to check the quality of billions of data points of over 1000+ crawlers across the company
• Analyze data and bugs that require in-depth investigations
• Interface directly with external customers including managing relationships and steering requirements

Basic Qualifications:

• 2+ years of experience as a backend or a full-stack software engineer
• Web scraping experience with Python or Node.js
• 2+ years of experience with AWS services such as EC2, S3, Lambda, etc.
• Should have managed a team of software engineers
• Should be paranoid about data quality

Preferred Skills and Experience:

• Deep experience with network debugging across all OSI layers (Wireshark)
• Knowledge of networks or/and cybersecurity
• Broad understanding of the landscape of software engineering design patterns and principles
• Ability to work quickly and accurately in a highly stressful environment during removing bugs in run-time within minutes
• Excellent communicator, both written and verbal

Additional Requirements:

• Must be available to work extended hours and weekends when needed to meet critical deadlines
• Must have an aversion to politics and BS. Should let his/her work speak for him/her.
• Must be comfortable with uncertainty. In almost all the cases, your job will be to figure it out.
• Must not be bounded to comfort zone. Often, you will need to challenge yourself to go above and beyond.

What You'll Do


You will be part of our data platform & data engineering team. As part of this agile team, you will work in our cloud native environment and perform following activities to support core product development and client specific projects:

• You will develop the core engineering frameworks for an advanced self-service data analytics product.
• You will work with multiple types of data storage technologies such as relational, blobs, key-value stores, document databases and streaming data sources.
• You will work with latest technologies for data federation with MPP (Massive Parallel Processing) capabilities
• Your work will entail backend architecture to enable data modeling, data queries and API development for both back-end and front-end data interfaces.
• You will support client specific data processing needs using SQL and Python/Pyspark
• You will integrate our product with other data products through Django APIs
• You will partner with other team members in understanding the functional / non-functional business requirements, and translate them into software development tasks
• You will follow the software development best practices in ensuring that the code architecture and quality of code written by you is of high standard, as expected from an enterprise software
• You will be a proactive contributor to team and project discussions

Who you are


• Strong education track record - Bachelors or an advanced degree in Computer Science or a related engineering discipline from Indian Institute of Technology or equivalent premium institute.
• 2-3 years of experience in data queries, data processing and data modeling
• Excellent ANSI SQL skills to handle complex queries
• Excellent Python and Django programming skills.
• Strong knowledge and experience in modern and distributed data stack components such as the Spark, Hive, Airflow, Kubernetes, Docker etc.
• Experience with cloud environments (AWS, Azure) and native cloud technologies for data storage and data processing
• Experience with relational SQL and NoSQL databases, including Postgres, Blobs, MongoDB etc.
• Familiarity with ML models is highly preferred
• Experience with Big Data processing and performance optimization
• Should know how to write modular, optimized and documented code.
• Should have good knowledge around error handling.
• Experience in version control systems such as GIT
• Strong problem solving and communication skills.
• Self-starter, continuous learner.

Good to have some exposure to

• Start-up experience is highly preferred
• Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
• Agile software development methodologies.
• Working in multi-functional, multi-location teams

What You'll Love About Us – Do ask us about these!

• Be an integral part of the founding team. You will work directly with the founder
• Work Life Balance. You can't do a good job if your job is all you do!
• Prepare for the Future. Academy – we are all learners; we are all teachers!
• Diversity & Inclusion. HeForShe!
• Internal Mobility. Grow with us!
• Business knowledge of multiple sectors

Rapido is India’s largest bike taxi player focused on solving the first and last mile connectivity problem for India. The primary focus is mobility and changing all facets of mobility across India. We believe that 2 Wheeler are the right mode of transport for developing countries like India and have much more scope than 4 wheelers, which is also reflected in the fact that the number of 2 wheelers is significantly more than the number of 4-wheelers.We have operations in close to 100 cities and are the undisputed market leader in this space. Growing close to 500% year-on-year, we have ambitious targets set for ourselves in the future as well.

What you will do :   

We are looking for a Technical Architect to design the structure of our IT systems and oversee programs to ensure the proper architecture is implemented.

Should have experience in data modelling, distributed system design, Microservice architecture and communications protocol and is passionate about writing code and the art of management

In this role, you should be an excellent communicator who is able to translate complex requirements into functional architecture. We'd also like you to have hands-on experience on software development and be able to manage complex programs. Overseeing development and implementation of programs. Providing technical leadership and support to software development teams. Your goal will be to ensure our internal IT framework operates properly.

Responsibilities:

• Understand company needs to define system specifications
• Plan and design the structure of a technology solution
• Communicate system requirements to software development teams
• Evaluate and select appropriate software or hardware and suggest integration methods
• Oversee assigned programs (e. g. conduct code review) and provide guidance to team members
• Assist with solving technical problems when they arise
• Ensure the implementation of agreed architecture and infrastructure
• Address technical concerns, ideas and suggestions
• Monitor systems to ensure they meet both user needs and business goals

Requirements:

• Proven experience as a Technical Architect
• Hands-on experience with software development and system administration
• Understanding of strategic IT solutions
• Experience in project management and service-oriented architecture (SOA)
• Knowledge of selected coding languages (e. g. JavaScript, Java)
• Familiarity with various operating systems
• Experience in cloud technologies
• Excellent communication skills
• Problem-solving aptitude
• Organisational and leadership skills

Role Competencies:

• Proven work experience as a Back-end developer.
• Hands on experience with programming languages like Java/NodeJS/Golang, JavaScript, Familiarity with Git,
• Database (SQL/Mysql/NO SQL).Good to have Kafka/queuing/messaging system.
• Familiarity with front-end languages (e.g. HTML, JavaScript and CSS)
• Strong knowledge of design principles, user interfaces, web standards and usability.

Functional Behavioral:

• Excellent analytical and time and people management skills.
• Teamwork skills with a problem-solving attitude.