Abinitio Developer

We are looking for Data engineer with strong expertise in Data warehousing to join our team.

Key skills : ab initio, ssis , Informatica, Hadoop and Teradata

Position: Backup Data ETL Developer

Experience: 6–9 Years

Location:Mumbai

Employment Type: Full-time

Job Description:

We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.

The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.

Key Skills:

Hadoop

Spark

Informatica

Snowflake

ETL Development

Data Integration

Data Transformation

Large-Scale Data Processing

ETL Workflows and Data Pipelines

Troubleshooting and Problem-Solving

Strong analytical and collaboration skills

Job Description:

Skill Set

Informatica, IDMC, Informatica MDM

Experience

4-6 Years

Location

Faridabad, Haryana, India

Work Mode- Hybrid

Job Description

Roles & Responsibilities

• Lead project team members through all activities required to successfully deliver Informatica.
• Define technical specifications for workflows and business rules.
• Prepare detailed design documents for data migration.
• Configure, build and unit test Informatica components, including data structures, roles, workflows, and portals.
• Train and mentor colleagues in Informatica implementation activities and best practices.
• Support integration, system, and user acceptance testing.
• Accountable for the Master Data Management, Technical Architecture, providing data modeling solutions and recommendations.
• Profile & Analyze Source Data usage using ETL tool.
• Automation, job scheduling, dependencies, monitoring.
• Configure/Script Business rules and transformation rules in ETL
• Data pipeline using IICS
• Hands on experience in Informatica MFT, Data Exchange (DX),and Data Transform (DT) modules
• Integration experience using various adapters (MLLP, SOAP, REST, SFTP, ODBC) will be essential.
• Strong knowledge and experience with developing complex SQL Queries, stored procedures, and triggers for RDBMS systems.
• Experience in administering, supporting, and performance tuning using Informatica.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

Shift: Second Shift (2:00 PM – 10:00 PM)

Joining: Immediate

About the Role

We are looking for an experienced Data Integration Developer with strong hands-on expertise in SQL, Python, ETL development, Snowflake, and AWS data services.

The ideal candidate should have extensive experience in designing, developing, and maintaining data integration solutions, building data warehouse architectures, and implementing scalable ETL pipelines. Strong SQL development and performance optimization skills are essential for this role.

This is a remote position; however, candidates must be available to visit our Mumbai or Bangalore location for three days during the onboarding process.

Key Responsibilities

SQL Development & Performance Optimization

• Develop complex SQL queries, stored procedures, and data transformation logic.
• Optimize SQL queries for performance, scalability, and efficiency.
• Perform advanced data analysis, validation, and reconciliation.
• Troubleshoot complex SQL and data-related issues.

ETL Development & Data Integration

• Design, develop, and maintain ETL pipelines and data integration workflows.
• Work with SQL and Python for data extraction, transformation, and loading.
• Ensure data accuracy, consistency, and integrity across systems.
• Identify and resolve data pipeline failures and integration issues.

Data Warehousing & Data Modeling

• Design and maintain data warehouse architectures.
• Develop data warehouse schemas based on business requirements.
• Work on dimensional data modeling, including Facts and Dimensions.
• Implement Slowly Changing Dimensions (SCD).
• Support data analysis and business information reconciliation.

Snowflake & AWS

• Develop and manage data solutions using Snowflake.
• Work with AWS services, particularly Amazon S3.
• Manage AWS connections and data access configurations.
• Build and maintain cloud-based data integration solutions.

Python & Apache Airflow

• Develop data processing and automation solutions using Python.
• Build, schedule, and monitor workflows using Apache Airflow.
• Troubleshoot workflow failures and improve pipeline reliability.

Agile & Development Lifecycle

• Participate in Agile development processes, sprint planning, and team discussions.
• Contribute throughout all stages of the software development lifecycle.
• Collaborate with cross-functional teams to understand business and technical requirements.
• Perform root cause analysis and implement appropriate corrective actions.

Required Skills

• Advanced SQL – Strong hands-on expertise is mandatory.
• Python Development
• ETL Development and Data Integration
• Snowflake
• Apache Airflow
• AWS Services, particularly Amazon S3
• AWS Connection Management
• Data Warehouse Architecture
• Data Modeling (Facts & Dimensions)
• Slowly Changing Dimensions (SCD)
• SQL Query Optimization and Performance Tuning
• Data Analysis and Reconciliation
• Troubleshooting and Root Cause Analysis
• Agile Development Methodologies
• Strong understanding of the Software Development Life Cycle (SDLC)

Experience & Qualifications

• 8–10 years of overall experience in Data Engineering / Data Integration / ETL Development.
• Strong professional experience in advanced SQL and Python.
• Hands-on experience with Snowflake, Apache Airflow, and AWS.
• Proven experience designing and developing data warehouse solutions.
• Experience working across the complete product development lifecycle.
• Ability to independently troubleshoot complex technical challenges.

Additional Requirements

• Immediate joiners preferred.
• Must be comfortable working in the second shift (2:00 PM – 10:00 PM).
• Position is remote, with a mandatory three-day onboarding visit to Mumbai or Bangalore.
• Strong communication, analytical, and problem-solving skills.
• Ability to work independently and collaboratively in an Agile environment.

Job Summary – Axiom Technical Analyst

🔹 Experience: 5+ Years

🔹 Skill Set: Axiom + SQL + ETL

🔹 Locations: Bangalore / Hyderabad

🔹 Notice Period: Immediate to 15 Days Joiners Preferred

Required Skills:

🔹 Strong hands-on experience in Axiom

🔹 Good knowledge of SQL and database concepts

🔹 Hands-on experience with ETL processes

🔹 Experience in data extraction, transformation, and loading

🔹 Good understanding of data integration and data processing

🔹 Experience in developing, maintaining, and troubleshooting data workflows

🔹 Strong analytical and problem-solving skills

🔹 Good communication and collaboration skills

🔹 Ability to troubleshoot technical issues and support application/data processes

🔹 Understanding of SDLC and Agile methodologies

Dear Candidate,

Thanks for showing interest in the opportunity!!!

As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.

Job Description:

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.

Primary & Mandatory Skills:

• ETL Development
• Hadoop / HDFS
• PySpark / Apache Spark
• Data Extraction, Transformation & Loading
• SQL and Data Processing

Good to Have:

• Hive / Spark SQL
• Data Pipeline Development
• Big Data Processing
• Python Programming

Company: Mphasis

Role: ETL Developer – Hadoop & PySpark

Experience: As per requirement

Location: Bangalore

Employment Type: Permanent

Hiring: ETL Developer – Hadoop & PySpark

Location: Bangalore

Experience: 6–10 Years

Budget: 25–30 LPA

Work Mode: Weekdays

Job Description

We are looking for an experienced ETL Developer with strong expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
• Develop data transformation workflows using PySpark and Python.
• Work with Hadoop and other big data technologies to process and manage large datasets.
• Write complex SQL queries for data extraction, transformation, validation, and analysis.
• Implement data cleansing, data quality checks, and data validation processes.
• Develop and optimize data integration workflows for data warehousing solutions.
• Troubleshoot ETL failures, performance issues, and data discrepancies.
• Optimize PySpark jobs and SQL queries for performance and scalability.
• Collaborate with data engineers, architects, analysts, and other stakeholders to deliver reliable data solutions.
• Ensure data accuracy, consistency, and adherence to established data governance standards.

Mandatory Skills

• Strong hands-on experience in ETL development.
• Good experience with Hadoop and big data technologies.
• Proficiency in PySpark and Python programming.
• Strong SQL skills, including complex queries and data manipulation.
• Experience in data processing, data transformation, and data integration.
• Understanding of data warehousing concepts and architecture.
• Experience in developing, debugging, and optimizing ETL pipelines.

Required Experience

• 6–10 years of relevant experience in ETL development and data engineering.
• Practical experience handling large datasets using Hadoop and PySpark.
• Strong analytical, problem-solving, and troubleshooting skills.
• Ability to work independently and collaborate effectively within a team.

Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners