Data Engineer

Job Summary

We are seeking a skilled Python Developer with experience in building scalable applications using Python frameworks such as Flask and Django. The ideal candidate should have hands-on experience with PySpark for big data processing and strong SQL skills for data analysis and database management.

Key Responsibilities

• Design, develop, test, and maintain Python-based applications.
• Develop RESTful APIs using Flask and/or Django.
• Build scalable data processing pipelines using PySpark.
• Write efficient SQL queries, stored procedures, and optimize database performance.
• Integrate applications with databases and third-party services.
• Collaborate with cross-functional teams to gather and implement business requirements.
• Troubleshoot, debug, and enhance application performance.
• Follow coding standards, perform code reviews, and maintain technical documentation.

Required Skills

• Strong proficiency in Python.
• Hands-on experience with Flask and/or Django.
• Experience with PySpark for large-scale data processing.
• Strong knowledge of SQL (writing complex queries, joins, indexing, optimization).
• Understanding of REST APIs and microservices architecture.
• Experience with Git/version control.
• Knowledge of relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Good problem-solving and analytical skills.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Familiarity with Docker and Kubernetes.
• Knowledge of CI/CD pipelines.
• Experience with Airflow or other workflow orchestration tools.
• Understanding of Agile/Scrum methodologies.

• Python Scripting: Proficient in writing clean, efficient scripts using Python for automation and problem-solving.

• Web Frameworks: Skilled in Django/Flask/FastAPI for backend and REST API development, with frontend knowledge (React/Angular/Vue).

• Testing: Experienced in unit and integration testing with pytest and ensuring code quality using linting tools.

• Data Analytics: Capable of processing and analysing data using Pandas, NumPy, and visualization libraries like Matplotlib.

• Version Control: Proficient in using Git for source code management and collaboration through branching and merge strategies.

• Databases: Strong in SQL and NoSQL database design, query optimization, and management.

• Tools: Familiarity with additional build tools and CI/CD systems (e.g., Jenkins, GitLab CI/CD).

• Cloud technologies: Familiarity with AWS/Azure or GCP.

• Problem-Solving: Excellent analytical and problem-solving skills related to build systems and processes.

• Communication: Strong verbal and written communication abilities.

Job Description:

We are looking for a skilled Python Developer with 2+ years of hands-on experience in backend development and data processing. The ideal candidate should be proficient in Python and have working experience with web frameworks like Flask and FastAPI, along with exposure to data engineering and machine learning workflows.

Key Responsibilities:

Design, develop, and maintain scalable Python applications and APIs using Flask and FastAPI

Work with PySpark and Kafka for real-time data processing

Perform data manipulation and analysis using Pandas and NumPy

Develop and maintain modular, reusable, and testable code following OOP principles

Collaborate with data scientists to integrate ML models (TensorFlow, PyTorch, Scikit-learn) into production

Participate in code reviews, design discussions, and contribute to best practices

Write and maintain documentation for developed modules and workflows

Required Skills:

Strong proficiency in Python programming

Hands-on experience with Flask and/or FastAPI

Experience working with PySpark and Kafka

Solid understanding of Pandas, NumPy, and data handling in Python

Familiarity with TensorFlow, PyTorch, and scikit-learn

Good grasp of Object-Oriented Programming (OOP) concepts

Ability to write modular and maintainable code

Nice to Have:

Understanding of Machine Learning concepts and pipelines

Exposure to Generative AI (GenAI) technologies and tools

Experience with CI/CD tools, Docker, or cloud environments (AWS, GCP, etc.)

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

We are looking for a skilled Python Developer to design, develop, and maintain robust backend systems. You will be responsible for building scalable web applications using the Flask micro-framework and managing high-performance NoSQL data storage with MongoDB. Your role involves creating RESTful APIs, optimizing database queries, and ensuring seamless integration between the backend logic and frontend components.

Key Responsibilities

• API Development: Design and implement scalable, secure RESTful APIs using Flask.
• Database Management: Architect and maintain MongoDB schemas; develop complex aggregation pipelines and optimize query performance.
• Backend Logic: Write clean, efficient, and testable Python code to handle server-side logic and data processing.
• Integration: Integrate third-party services and internal data sources using libraries like Requests or Flask-PyMongo.
• Performance Optimization: Identify and resolve bottlenecks in the application and database layers to ensure low latency.
• Testing & Security: Implement unit tests (using pytest or unittest) and follow security best practices (OAuth2, JWT, data encryption).
• Collaboration: Work closely with frontend developers to integrate user-facing elements and with DevOps to support deployment.

Required Technical Skills

CategoryRequirementsLanguageExpert-level Python (OOP, decorators, generators, and async programming).Frameworks Strong experience with Flask (routing, blueprints, middleware).DatabaseProficiency in MongoDB (BSON, indexing, sharding, and aggregation framework).ODMs/DriversExperience with PyMongo or MongoEngine.ArchitectureSolid understanding of RESTful API design and Microservices.Tools/DevOpsVersion control with Git; familiarity with Docker and CI/CD pipelines

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

We are looking for a skilled Python & PySpark Developer with strong expertise in Big Data technologies, Spark, SQL/PL-SQL, and REST API development using Flask or Django. The ideal candidate should have experience building scalable data pipelines, processing large datasets, developing APIs, and working with distributed computing frameworks.

Key Responsibilities

• Develop, optimize, and maintain scalable data pipelines using PySpark and Apache Spark.
• Design, develop, and optimize complex SQL and PL/SQL queries, stored procedures, functions, and database objects.
• Build and maintain RESTful APIs using Flask or Django.
• Develop robust Python applications for data engineering and backend services.
• Process and analyze large-scale datasets using Big Data technologies.
• Optimize Spark jobs for performance, scalability, and reliability.
• Integrate APIs with internal and external systems.
• Collaborate with cross-functional teams including Data Engineers, Data Scientists, and Application Developers.
• Troubleshoot production issues and implement performance improvements.
• Follow coding standards, version control, and CI/CD best practices.

Mandatory Skills

• Strong proficiency in Python programming.
• Hands-on experience with PySpark and Apache Spark.
• Strong SQL coding skills.
• Experience with PL/SQL development.
• Experience in Big Data ecosystem.
• REST API development using Flask or Django.
• Experience in developing and consuming Python APIs.
• Knowledge of data processing, ETL, and distributed computing.
• Experience with Git/version control.

Preferred Skills

• Experience with Hadoop ecosystem (Hive, HDFS, YARN).
• Exposure to cloud platforms such as AWS, Azure, or GCP.
• Knowledge of Airflow or other workflow orchestration tools.
• Experience with Docker and Kubernetes.
• Familiarity with Kafka or other streaming technologies.
• Understanding of CI/CD pipelines.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4–8+ years of experience in Python and Big Data development (can be adjusted based on the role).

Required Experience

• Strong hands-on experience in Python, PySpark, and Apache Spark.
• Extensive experience writing optimized SQL and PL/SQL code.
• Experience developing REST APIs using Flask or Django.
• Experience working with large-scale data processing and ETL pipelines.
• Strong analytical, debugging, and problem-solving skills.

Mandatory Skills: Python, PySpark, SQL Coding, Apache Spark, Big Data, Flask/Django (REST API), PL/SQL, Python APIs.

1st virtual , 2nd round F2F -

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Role Overview:

We are seeking a backend-focused Software Engineer with deep expertise in REST APIs,

real-time integrations, and cloud-based application services. The ideal candidate will build

scalable backend systems, integrate real-time data flows, and contribute to system design

and documentation. This is a hands-on role working with global teams in a fast-paced, Agile

environment.

Key Responsibilities:

• Design, develop, and maintain REST APIs and backend services using Python, FastAPI,

and SQLAlchemy.

• Build and support real-time integrations using AWS Lambda, API Gateway, and

EventBridge.

• Develop and maintain Operational Data Stores (ODS) for real-time data access.

• Write performant SQL queries and work with dimensional data models in PostgreSQL.

• Contribute to cloud-based application logic and data orchestration.

• Containerize services using Docker and deploy via CI/CD pipelines.

• Implement automated testing using pytest, pydantic, and related tools.

• Collaborate with cross-functional Agile teams using tools like Jira.

• Document technical workflows, APIs, and system integrations with clarity and

consistency.

• Should have experience in team management

Required Skills & Experience:

• 8+ years of backend or integrations engineering experience.

• Expert-level knowledge of REST API development and real-time system design.

• Strong experience with: Python (FastAPI preferred), SQLAlchemy.

• PostgreSQL and advanced SQL.

• AWS Lambda, API Gateway, EventBridge.

• Operational Data Stores (ODS) and distributed system integration.

• Experience with Docker, Git, CI/CD tools, and automated testing frameworks.

• Experience working in Agile environments and collaborating with cross-functional

teams.

• Comfortable producing and maintaining clear technical documentation.

• Working knowledge of React is acceptable but not a focus.

• Hands-on experience working with Databricks or similar data platforms.

Education & Certifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field (required).

• Master’s degree is a plus.

• Certifications in AWS (e.g., Developer Associate, Solutions Architect) or Python

frameworks are highly preferred.

• 10+ years of software development experience
• 3+ years in a technical leadership role
• Strong expertise in Python and SQL
• Experience building scalable APIs and backend systems
• Solid understanding of database design and performance tuning
• Experience with Azure cloud services (AWS familiarity preferred)
• Working knowledge of ML/AI integration in enterprise systems
• Experience in client-facing or consulting environments preferred
• Experience with Databricks or modern data platforms
• Exposure to ETL tools such as Talend
• Experience with BI tools (e.g., Power BI)
• Exposure to regulated domains such as Pharma, Healthcare