Data Engineer For Python at A2Tech Consultants · Pune · 4 - 12 years · ₹6L - ₹15L / yr · Posted 6 Oct 2021

- Strong Python Coding skills and OOP skills
- Should have worked on Big Data product Architecture
- Should have worked with any one of the SQL-based databases like MySQL, PostgreSQL and any one of
- NoSQL-based databases such as Cassandra, Elasticsearch etc.
- Hands on experience on frameworks like Spark RDD, DataFrame, Dataset
- Experience on development of ETL for data product
- Candidate should have working knowledge on performance optimization, optimal resource utilization, Parallelism and tuning of spark jobs
- Working knowledge on file formats: CSV, JSON, XML, PARQUET, ORC, AVRO
- Good to have working knowledge with any one of the Analytical Databases like Druid, MongoDB, Apache Hive etc.
- Experience to handle real-time data feeds (good to have working knowledge on Apache Kafka or similar tool)
- Python and Scala (Optional), Spark / PySpark, Parallel programming

About A2Tech Consultants
About
Connect with the team
Similar jobs (10)
Company: Wissen Technology
Position: Databricks Engineer
Experience: 6-10 Years
Location: Bengaluru/Mumbai
Employment Type: Full-time
About Wissen Technology
Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.
With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.
At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.
Key Responsibilities
- Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
- Develop and optimize data pipelines and workflows on Databricks.
- Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
- Ensure data integrity, quality, performance, and reliability across data processing pipelines.
- Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
- Perform data analysis and implement appropriate data validation and quality checks.
- Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
- Work with relational databases and develop efficient SQL queries for data extraction and transformation.
- Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
- Use Git/version control and follow established software development and deployment practices.
Required Skills & Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
- Proven experience as a Databricks Developer, Data Engineer, or similar role.
- Strong hands-on expertise in Apache Spark and PySpark.
- Strong programming skills in Python; experience with Scala is an advantage.
- Strong proficiency in SQL and hands-on experience with relational databases.
- Practical experience developing and optimizing data pipelines and data processing applications.
- Familiarity with Git and version control systems.
- Strong understanding of data engineering concepts, data transformation, and data validation.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
Description
We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.
The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.
You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
- Build and optimize distributed data applications using Apache Spark and Python Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Design and manage data workflows using Apache Airflow.
- Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
- Work with large datasets to ensure data quality, consistency, reliability, and performance.
- Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, performance, and cost efficiency.
- Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.
Requirements
Candidates who demonstrate:
- 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
- Strong hands-on experience with Apache Spark and Scala.
- Experience designing, building, and maintaining large-scale ETL pipelines.
- Strong hands-on experience with AWS, particularly Amazon S3.
- Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
- Strong SQL skills and a solid understanding of distributed data processing concepts.
- Experience working with batch and/or streaming data pipelines.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
- Experience with Databricks and the broader Databricks data platform.
- Familiarity with streaming technologies such as Apache Kafka.
- Experience working on large-scale data platforms handling high-volume data workloads.
- Exposure to additional AWS data services and cloud-native data architectures.
🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨
Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!
🔹 Role: Senior Data Engineer
🔹 Experience: 7+ Years
🔹 Location: Bangalore
🔹 CTC: Up to 26 LPA
🔹 Notice Period: Immediate to 10 Days Preferred
💻 Mandatory Skills
✅ PySpark
✅ Oracle SQL / PL/SQL
✅ Data Modeling & Design / Modernization
✅ Python
✅ ETL
✅ Data Pipelines
⚙️ Good to Have / Ecosystem Skills
✅ Kafka
✅ Hadoop
✅ AWS / Azure / GCP
✅ Git
✅ JIRA
📌 Key Responsibilities
• Develop and maintain scalable data pipelines using PySpark
• Work extensively with Oracle SQL/PLSQL for data processing and transformation
• Design and implement data models and data architecture
• Work on data design and modernization initiatives
• Develop and optimize ETL processes and data pipelines
• Handle large volumes of data using PySpark and Python
• Work with technologies such as Kafka, Hadoop, and Cloud platforms
• Collaborate with cross-functional teams to deliver scalable data solutions
• Use Git and JIRA for version control and project tracking
📩 Interested candidates can share their updated CV along with:
Total Experience:
Relevant PySpark Experience:
Relevant Oracle SQL/PLSQL Experience:
Data Modeling Experience:
Current Location:
Notice Period:
Current CTC:
Expected CTC:
#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, Hadoop, and Apache Spark.
- Develop efficient data processing and transformation workflows for large datasets.
- Write, optimize, and maintain complex SQL queries and PL/SQL procedures.
- Perform data extraction, transformation, and loading (ETL) from multiple data sources.
- Work with structured and unstructured data to support analytics and reporting requirements.
- Optimize data pipelines and queries for performance, scalability, and reliability.
- Ensure data quality, consistency, security, and integrity across data platforms.
- Collaborate with cross-functional teams to understand business requirements and deliver data engineering solutions.
- Use Git, automation, and CI/CD practices to support development and deployment.
Required Skills
- 4.5–10 years of experience in software development or data engineering.
- Strong proficiency in AWS
- Hands-on experience with Hadoop and Apache Spark.
- Good knowledge of SQL and PL/SQL, including query optimization and stored procedures.
- Experience in ETL development, data processing, and data pipeline design.
- Understanding of data warehousing concepts and distributed computing.
- Strong problem-solving, debugging, and performance-tuning skills.
Data Engineer Hiring Post
🚨 Hiring: Data Engineer | PySpark + Python + SQL
We are looking for experienced Data Engineers to join our team!
🔹 Experience: 5 to 9 Years
🔹 Locations: Bangalore / Hyderabad
🔹 Interview Process:
• 1st Round – Virtual
• 2nd Round – Face-to-Face (Karat Test)
🔑 Key Skills:
✅ PySpark
✅ SQL
✅ Python
✅ ETL
📩 Interested candidates can share their updated resume.
#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring
1st virtual , 2nd round F2F -
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.
Senior Data Engineer – PySpark & Oracle
Experience: 7+ Years
Location: Bangalore
Notice Period: Immediate to 10 Days
Key Skills:
- Strong expertise in Data Modeling, Data Design & Modernization
- Primary skills: PySpark, Oracle SQL/PLSQL
- Secondary skills: Python, ETL & Data Pipelines
- Experience with Kafka and Hadoop
- Exposure to AWS / Azure / GCP
- Good knowledge of Git and JIRA
Roles & Responsibilities:
- Design, develop, and modernize scalable data models and data architecture.
- Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
- Build and maintain robust ETL workflows and data pipelines.
- Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
- Perform data transformation, optimization, and performance tuning.
- Collaborate with technical teams on data design, development, testing, and deployment.
Technical Stack
- PySpark
- Databricks
- Microsoft Azure
- SQL
- Kubernetes
Key Responsibilities & Expectations
- Must be self-driven, proactive, and capable of independently delivering high-quality solutions.
- Demonstrate strong ownership and accountability for assigned tasks and deliverables.
- Ability to work with minimal supervision while consistently meeting project objectives and quality standards.
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.








