Data Engineer

Shift: Second Shift (2:00 PM – 10:00 PM)

Joining: Immediate

About the Role

We are looking for an experienced Data Integration Developer with strong hands-on expertise in SQL, Python, ETL development, Snowflake, and AWS data services.

The ideal candidate should have extensive experience in designing, developing, and maintaining data integration solutions, building data warehouse architectures, and implementing scalable ETL pipelines. Strong SQL development and performance optimization skills are essential for this role.

This is a remote position; however, candidates must be available to visit our Mumbai or Bangalore location for three days during the onboarding process.

Key Responsibilities

SQL Development & Performance Optimization

• Develop complex SQL queries, stored procedures, and data transformation logic.
• Optimize SQL queries for performance, scalability, and efficiency.
• Perform advanced data analysis, validation, and reconciliation.
• Troubleshoot complex SQL and data-related issues.

ETL Development & Data Integration

• Design, develop, and maintain ETL pipelines and data integration workflows.
• Work with SQL and Python for data extraction, transformation, and loading.
• Ensure data accuracy, consistency, and integrity across systems.
• Identify and resolve data pipeline failures and integration issues.

Data Warehousing & Data Modeling

• Design and maintain data warehouse architectures.
• Develop data warehouse schemas based on business requirements.
• Work on dimensional data modeling, including Facts and Dimensions.
• Implement Slowly Changing Dimensions (SCD).
• Support data analysis and business information reconciliation.

Snowflake & AWS

• Develop and manage data solutions using Snowflake.
• Work with AWS services, particularly Amazon S3.
• Manage AWS connections and data access configurations.
• Build and maintain cloud-based data integration solutions.

Python & Apache Airflow

• Develop data processing and automation solutions using Python.
• Build, schedule, and monitor workflows using Apache Airflow.
• Troubleshoot workflow failures and improve pipeline reliability.

Agile & Development Lifecycle

• Participate in Agile development processes, sprint planning, and team discussions.
• Contribute throughout all stages of the software development lifecycle.
• Collaborate with cross-functional teams to understand business and technical requirements.
• Perform root cause analysis and implement appropriate corrective actions.

Required Skills

• Advanced SQL – Strong hands-on expertise is mandatory.
• Python Development
• ETL Development and Data Integration
• Snowflake
• Apache Airflow
• AWS Services, particularly Amazon S3
• AWS Connection Management
• Data Warehouse Architecture
• Data Modeling (Facts & Dimensions)
• Slowly Changing Dimensions (SCD)
• SQL Query Optimization and Performance Tuning
• Data Analysis and Reconciliation
• Troubleshooting and Root Cause Analysis
• Agile Development Methodologies
• Strong understanding of the Software Development Life Cycle (SDLC)

Experience & Qualifications

• 8–10 years of overall experience in Data Engineering / Data Integration / ETL Development.
• Strong professional experience in advanced SQL and Python.
• Hands-on experience with Snowflake, Apache Airflow, and AWS.
• Proven experience designing and developing data warehouse solutions.
• Experience working across the complete product development lifecycle.
• Ability to independently troubleshoot complex technical challenges.

Additional Requirements

• Immediate joiners preferred.
• Must be comfortable working in the second shift (2:00 PM – 10:00 PM).
• Position is remote, with a mandatory three-day onboarding visit to Mumbai or Bangalore.
• Strong communication, analytical, and problem-solving skills.
• Ability to work independently and collaboratively in an Agile environment.

Location: Bangalore (Hybrid)

Experience: 4–8 Years

About the Role

At Twenty20 Systems, we are looking for a Senior Software Engineer (Integration) who can build and support scalable integrations across enterprise applications, APIs, and data systems.

This role is ideal for someone who is hands-on, technically strong, and excited to solve real integration challenges in a fast-paced environment. You will work closely with engineering, product, and delivery teams to build reliable integration solutions while contributing to architecture and engineering best practices.

What You’ll Do

• Design, develop, and maintain enterprise integrations, APIs, and automation workflows across internal and third-party systems.
• Build and manage integrations using Workato and other iPaaS/middleware platforms.
• Develop and optimize API-based services, data pipelines, and workflow automations for business-critical use cases.
• Work with product, engineering, and business teams to understand requirements and build scalable solutions.
• Troubleshoot, monitor, and improve integration performance in production environments.
• Build reusable components, connectors, and automation logic to improve delivery efficiency.
• Ensure integrations follow security, reliability, performance, and governance standards.
• Support delivery teams in resolving integration issues and improving system performance.

Requirements

• 4–6 years of experience in software engineering, middleware, or enterprise integrations.
• Strong hands-on experience in Workato (Boomi, MuleSoft, WSO2, TIBCO experience is a plus).
• Good understanding of REST/SOAP APIs, webhooks, OAuth, and connector-based integrations.
• Strong skills in JSON, XML, SQL, JavaScript/Python, and data transformation logic.
• Experience working with enterprise applications like Salesforce, NetSuite, Workday, Snowflake, Shopify, etc.
• Exposure to cloud platforms (AWS/Azure/GCP) and automation architectures is a plus.
• Good debugging, troubleshooting, and problem-solving skills.
• Ability to work in a fast-paced delivery-oriented environment with strong ownership.

What Your First 3 Months Will Look Like

• Take ownership of assigned integration projects and support ongoing delivery pipelines.
• Work on API integrations, automations, and troubleshooting real-time production scenarios.
• Collaborate with senior engineers and product teams to improve integration quality and performance.

Where You’ll Be in 6 Months

• Independently handling multiple integration workflows and delivery requirements.
• Contributing to reusable frameworks and engineering best practices.
• Becoming a key technical contributor for integration design and production support.
• Driving faster delivery through automation and optimized integration patterns.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

We are looking for an integration engineer to assist our rapidly growing customer base. As part of our integration team, you will be the primary point of contact for all integrations. You would be responsible for helping our clients integrate with OneFin APIs, configuring our system for clients, and providing ongoing help to them to resolve any issues.

Application form: https://forms.gle/KbbeXxqhwpwnCzcDA

Responsibilities

• Understand and explain APIs to clients. Help clients integrate OneFin APIs. Research and identify solutions to issues during integration.
• Escalate unresolved issues to appropriate internal teams (e.g., software developers).
• Become a product expert for clients.
• Configure the OneFin system for customized usage by clients. Identify and write internal and external technical articles or knowledge-base entries, like typical troubleshooting steps, workarounds, or best practices, how-to guides, etc.
• Automate the solution of common issues using Python.
• Help live clients resolve issues and coordinate with the development team for issue resolution.

Requirements and Qualifications:

• BS/B.Tech. in Computer Science, Engineering, or an equivalent.
• Strong verbal and written communication skills.
• Experience in writing code in Python.
• Understanding web-based systems.
• Proficient in understanding and writing JSON.
• Experience in SQL databases.
• Experience working with REST APIs.
• Excellent analytical skills, passion for pinning down technical issues, and solving problems.
• Enjoys a fast-paced startup environment.

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

SHARE YOUR RESUME : { pavithra.e @vysystems.com },

{ 8 9 2 5 8 0 2 4 5 7 }

Job Description – Data / Metadata Engineer

Position

Data / Metadata Engineer

Location

Pune

Experience

• 6–9 Years: Up to 28 LPA
• 10–17 Years: Up to 32 LPA

Notice Period

Immediate to 15 Days Joiners Preferred

Role Overview

We are looking for an experienced Data / Metadata Engineer with strong expertise in Data Engineering, Metadata Management, Data Modeling, Cloud technologies, Python/PySpark, and ETL/Data Pipelines.

The ideal candidate should have hands-on experience designing and developing data solutions, working with metadata and data models, and building scalable data pipelines on cloud platforms.

Mandatory Skills

• Strong experience in Data Engineering
• Hands-on experience in Metadata Management / Metadata Engineering
• Strong understanding of Data Modeling
• Experience with DDL and ER/Data Modeling
• Experience with Cloud technologies – Any Cloud Platform
• Strong programming experience in Python or PySpark
• Experience with ETL processes and Data Pipelines
• Good understanding of data architecture and data integration concepts

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions.
• Develop and manage data pipelines and ETL workflows.
• Work with metadata and data cataloging concepts.
• Create and maintain data models, DDLs, ER diagrams, and database structures.
• Develop data processing solutions using Python or PySpark.
• Work with cloud-based data platforms and services.
• Collaborate with Data Architects, Data Engineers, Developers, and Business teams.
• Ensure data quality, consistency, availability, and reliability across data pipelines.
• Troubleshoot and optimize existing data pipelines and data processes.
• Follow best practices for data engineering, modeling, and cloud-based implementations.

Candidate Profile

• Strong experience in Data Engineering + Metadata + Data Modeling.
• Good hands-on experience with Python/PySpark and ETL/Data Pipelines.
• Experience working with any major cloud platform.
• Strong understanding of databases, data structures, and data modeling concepts.
• Candidates who can join immediately or within 15 days are preferred.

Job Details

Role: Data / Metadata Engineer

Location: Pune

Experience: 6–17 Years

Budget: 28 LPA (6–9 Yrs) / 32 LPA (10–17 Yrs)

Notice Period: Immediate to 15 Days

We are looking for Data engineer with strong expertise in Data warehousing to join our team.

Key skills : ab initio, ssis , Informatica, Hadoop and Teradata