Abinitio Developer

Senior Data Engineer – Ab Initio | GCP | Spark | Agentic AI

Location: Bangalore

Experience: 5+ Years

Role: Senior Data Engineer

Work Mode: Bangalore

Job Summary

We are looking for an experienced Senior Data Engineer with strong expertise in Ab Initio, GCP, Apache Spark, and Agentic AI. The ideal candidate will have hands-on experience designing and developing scalable data engineering solutions, building data pipelines, and working with modern cloud and AI technologies.

The candidate should be comfortable working across traditional enterprise data platforms and emerging Generative AI / Agentic AI solutions.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines using Ab Initio, Spark, and GCP services.
• Develop and optimize complex ETL/ELT workflows using Ab Initio.
• Build and maintain data processing solutions using Apache Spark / PySpark.
• Develop cloud-based data solutions on Google Cloud Platform (GCP).
• Work with GCP data services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, or equivalent services.
• Perform data integration, transformation, cleansing, and validation.
• Optimize data pipelines for performance, scalability, reliability, and cost.
• Collaborate with data architects,
• 
  

Position: Backup Data ETL Developer

Experience: 6–9 Years

Location:Mumbai

Employment Type: Full-time

Job Description:

We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.

The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.

Key Skills:

Hadoop

Spark

Informatica

Snowflake

ETL Development

Data Integration

Data Transformation

Large-Scale Data Processing

ETL Workflows and Data Pipelines

Troubleshooting and Problem-Solving

Strong analytical and collaboration skills

Job Description:

Skill Set

Informatica, IDMC, Informatica MDM

Experience

4-6 Years

Location

Faridabad, Haryana, India

Work Mode- Hybrid

Job Description

Roles & Responsibilities

• Lead project team members through all activities required to successfully deliver Informatica.
• Define technical specifications for workflows and business rules.
• Prepare detailed design documents for data migration.
• Configure, build and unit test Informatica components, including data structures, roles, workflows, and portals.
• Train and mentor colleagues in Informatica implementation activities and best practices.
• Support integration, system, and user acceptance testing.
• Accountable for the Master Data Management, Technical Architecture, providing data modeling solutions and recommendations.
• Profile & Analyze Source Data usage using ETL tool.
• Automation, job scheduling, dependencies, monitoring.
• Configure/Script Business rules and transformation rules in ETL
• Data pipeline using IICS
• Hands on experience in Informatica MFT, Data Exchange (DX),and Data Transform (DT) modules
• Integration experience using various adapters (MLLP, SOAP, REST, SFTP, ODBC) will be essential.
• Strong knowledge and experience with developing complex SQL Queries, stored procedures, and triggers for RDBMS systems.
• Experience in administering, supporting, and performance tuning using Informatica.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

Dear Candidate,

Thanks for showing interest in the opportunity!!!

As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.

Job Description:

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.

Primary & Mandatory Skills:

• ETL Development
• Hadoop / HDFS
• PySpark / Apache Spark
• Data Extraction, Transformation & Loading
• SQL and Data Processing

Good to Have:

• Hive / Spark SQL
• Data Pipeline Development
• Big Data Processing
• Python Programming

Company: Mphasis

Role: ETL Developer – Hadoop & PySpark

Experience: As per requirement

Location: Bangalore

Employment Type: Permanent

Hiring: ETL Developer – Hadoop & PySpark

Location: Bangalore

Experience: 6–10 Years

Budget: 25–30 LPA

Work Mode: Weekdays

Job Description

We are looking for an experienced ETL Developer with strong expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
• Develop data transformation workflows using PySpark and Python.
• Work with Hadoop and other big data technologies to process and manage large datasets.
• Write complex SQL queries for data extraction, transformation, validation, and analysis.
• Implement data cleansing, data quality checks, and data validation processes.
• Develop and optimize data integration workflows for data warehousing solutions.
• Troubleshoot ETL failures, performance issues, and data discrepancies.
• Optimize PySpark jobs and SQL queries for performance and scalability.
• Collaborate with data engineers, architects, analysts, and other stakeholders to deliver reliable data solutions.
• Ensure data accuracy, consistency, and adherence to established data governance standards.

Mandatory Skills

• Strong hands-on experience in ETL development.
• Good experience with Hadoop and big data technologies.
• Proficiency in PySpark and Python programming.
• Strong SQL skills, including complex queries and data manipulation.
• Experience in data processing, data transformation, and data integration.
• Understanding of data warehousing concepts and architecture.
• Experience in developing, debugging, and optimizing ETL pipelines.

Required Experience

• 6–10 years of relevant experience in ETL development and data engineering.
• Practical experience handling large datasets using Hadoop and PySpark.
• Strong analytical, problem-solving, and troubleshooting skills.
• Ability to work independently and collaborate effectively within a team.

Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Data Engineer – Contract Opportunity

We are looking for an experienced Data Engineer with 5+ years of experience to work on subscriber activation, churn, FTE, and future reporting requirements.

Key Responsibilities:

• Work on data requirements related to Subscriber Activation, Churn, FTE, and future reporting.
• Work with BigQuery as the centralized data warehouse.
• Develop and maintain data ingestion and integration pipelines across multiple source systems.
• Design and implement ETL/ELT processes.
• Develop data models for reporting and analytics.
• Integrate BigQuery with Power BI or similar reporting tools.

Required Skills:

• Strong hands-on experience with GCP & BigQuery
• Data warehouse architecture, design, and implementation
• Data ingestion/integration across multiple source systems
• ETL/ELT and data pipeline development
• Data modelling for reporting and analytics
• Experience integrating BigQuery with Power BI or similar reporting tools

Contract: 1 month initially, with potential extension

Compensation: ₹6–7 LPA

Work Mode: Remote

Important

Since this is only a 1-month contract, mention “Potential extension” rather than saying it will definitely be extended.

Job Description

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, PySpark, Python, and SQL. The candidate should have hands-on experience in developing data pipelines, processing and transforming large datasets, and working with data warehousing and big data technologies.

Key Responsibilities

• Design, develop, and maintain ETL processes and data pipelines.
• Work with Hadoop and PySpark to process and transform large volumes of data.
• Develop and optimize Python scripts for data processing and automation.
• Write complex SQL queries for data extraction, transformation, and validation.
• Perform data cleansing, integration, transformation, and validation.
• Work with data warehousing concepts and large-scale data processing systems.
• Optimize ETL workflows for performance, scalability, and reliability.
• Troubleshoot data pipeline failures and resolve data quality issues.
• Collaborate with data engineers, analysts, and other technical teams.
• Follow data governance, quality, and development best practices.

Required Skills

• Strong experience in ETL Development – Mandatory
• Hands-on experience with Hadoop – Mandatory
• Strong experience in PySpark – Mandatory
• Good programming skills in Python – Mandatory
• Strong knowledge of SQL – Mandatory
• Experience in Data Processing and Transformation – Mandatory
• Knowledge of Data Warehousing – Mandatory
• Experience with Big Data Technologies – Mandatory

Opportunity Details

Role: ETL Developer – Hadoop & PySpark

Experience: 6–10 Years

Location: Bangalore

Mandatory Skills

ETL Development | Hadoop | PySpark | Python | SQL | Data Processing & Transformation | Data Warehousing | Big Data Technologies