Cutshort logo
For Employers
Fintech Company logo
Data Engineer Lead
Fintech Company
Data Engineer Lead

Data Engineer Lead at Fintech Company · Bengaluru (Bangalore) · 6 - 8 years · ₹15L - ₹25L / yr · Posted 24 Jan 2022

Jobdost's logo

Data Engineer Lead

at Fintech Company

Agency job
6 - 8 yrs
₹15L - ₹25L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark

Purpose of Job:
We are looking for an exceptionally talented Lead data engineer who has
exposure in implementing AWS services to build data pipelines, api
integration and designing data warehouse. Candidate with both hands-on
and leadership capabilities will be ideal for this position.

 

Job Responsibilities:
• Total 6+ years of experience as a Data Engineer and 2+
years of experience in managing a team
• Have minimum 3 years of AWS Cloud experience.
• Well versed in languages such as Python, PySpark, SQL, NodeJS etc
• Has extensive experience in Spark ecosystem and has
worked on both real time and batch processing
• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.
• Experience with modern Database systems such as
Redshift, Presto, Hive etc.
• Worked on building data lakes in the past on S3 or
Apache Hudi • Solid understanding of Data Warehousing Concepts
• Good to have experience on tools such as Kafka or Kinesis
• Good to have AWS Developer Associate or Solutions
Architect Associate Certification
• Have experience in managing a team


Qualifications:
At least a bachelor’s degree in Science, Engineering, Applied
Mathematics. Preferred Masters degree. Other Requirements: Team Management skills, Learning Attitude, Ownership skills

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
It is an Product Based Company(Domain- EV Charging)
It is an Product Based Company(Domain- EV Charging)
Agency job
via Unique Occupational by Mantasha Naaz
Bengaluru (Bangalore)
3 - 5 yrs
₹13L - ₹15L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
SQL
ETL
+2 more

Data Engineer

Location: Bengaluru, India (Hybrid)

Employment Type: Full-time

Experience: 3-5 years



Role Overview  

What We’re Looking For:

  • Bachelor’s degree in Computer Science/Engineering or equivalent experience required.
  • Experience designing and shipping cloud services products.
  • Experience driving and managing technical and architectural dependencies on AWS Cloud.
  • A firm understanding of system architecture, cloud computing, PaaS/SaaS design principles, S3, DynamoDB, RDS mandatory.
  • Experience in building or maintaining ETL processes and tools, i.e., AWS Glue or any open-source tool.
  • Proven system-level design contribution to a current “Live” (in production / under daily high load) multi-region SaaS or PaaS offering.
  • Proven experience with S3, DynamoDB, SQL, and AWS RDS services.
  • Proficiency in programming languages such as Python.
  • Strong analytical and problem-solving skills.

Required Skills & Experience

  • Experience with Python, SQL, and data visualization/exploration tools.
  • Familiarity with the AWS ecosystem, specifically S3, DynamoDB, and RDS.
  • Communication skills, especially for explaining technical concepts to nontechnical business leaders.
  • Ability to work on a dynamic, research-oriented team that has concurrent projects.
  • Experience in AWS cost optimization (Savings Plans, Reserved Instances, Spot Instances) and governance frameworks.
  • Experience developing solutions using infrastructure orchestration tools (SSM, automation account, Ansible, etc.).
  • Excellent leadership, stakeholder management, and communication skills.

 

What We Offer

  • Work with some of the brightest minds in the emerging EV industry.
  • Make a tangible impact in reducing carbon emissions and enabling sustainable energy.
  • Freedom to suggest, implement, and innovate on systems, processes, and technologies.
  • Daily ownership in a high-growth, challenging environment.
  • Flexible work environment with hybrid schedules and virtualization options.
  • Competitive pay and benefits including health coverage, innovative PTO program, and performance bonuses.


Read more
NeoGenCode Technologies Pvt Ltd
Akshay Patil
Posted by Akshay Patil
Gurugram
7 - 12 yrs
₹12L - ₹18L / yr
skill iconAmazon Web Services (AWS)
Amazon S3
Amazon EMR
athena
Amazon Redshift
+17 more

Job Title : Tech Lead – Data Lake Platform

Number of Positions : 2

Experience : 7+ Years

Role Type : Technical Lead / Data Platform Lead

Domain : Data Engineering / Data Platform / AWS


About the Role :

We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.

The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.

As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.


Core Tech Stack :

AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka


Key Responsibilities :

  • Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
  • Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
  • Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
  • Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
  • Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
  • Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
  • Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
  • Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
  • Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
  • Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
  • Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
  • Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.


Must-Have Skills :

  • 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
  • Strong hands-on experience with AWS Data Services, including:
  • Amazon S3
  • AWS EMR
  • AWS Glue
  • Amazon Athena
  • Amazon Redshift
  • AWS DMS
  • AWS Lambda
  • Amazon RDS
  • AWS IAM
  • Strong production experience with Apache Airflow.
  • Strong hands-on experience with Apache Spark / PySpark.
  • Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
  • Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
  • Strong understanding of data lake architecture and enterprise data platforms.
  • Proven experience leading engineers and driving technical decisions.
  • Hands-on experience with production support, troubleshooting, incident management, and RCA.
  • Strong understanding of data platform performance, scalability, reliability, and SLA management.


Good-to-Have Skills :

  • Experience with DBT and modern data transformation practices.
  • Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
  • Strong knowledge of Amazon Redshift workload optimization, including :
  • Distribution keys
  • Sort keys
  • Spectrum
  • External tables
  • Experience with Kafka or other streaming/data ingestion technologies.
  • Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
  • Experience with Lambda and API Gateway for API-based data serving.
  • Experience with enterprise data governance, data quality, security, and compliance.
  • Experience in BFSI / Banking / Financial Services / Insurance domain.


Ideal Candidate :

The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Read more
Tatvic
at Tatvic
2 recruiters
TatvicDigital AnalyticsPrivateLimited
Posted by TatvicDigital AnalyticsPrivateLimited
Ahmedabad
6 - 9 yrs
₹15L - ₹25L / yr
Google Cloud Platform (GCP)
ETL architecture

1. Company Description:


Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.


Website: www.tatvic.com


2. Role Details

  • Role: Lead Data Engineer
  • Band: L4
  • Department: Data Engineering
  • Reporting to: L5 / Head of Delivery
  • Location: Ahmedabad
  • Job Type: Full Time
  • Experience: 6-8 years of relevant experience
  • Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.



3. Mission & Role Overview

  • Mission: To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellence—specifically in BigQuery optimization and secure GCP/AWS architectures—while driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
  • Role Overview: This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.

4. Key Responsibilities

  • Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
  • Build reusable data solutions and software components that serve multiple customers and use cases.
  • Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
  • Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
  • Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
  • Design and build production-grade software (APIs, services, internal tools) with sound engineering practices — version control, testing, CI/CD, and code review.
  • Extend data platforms with AI capabilities — integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
  • Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
  • Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
  • Document architectures, design decisions, and operations clearly and consistently.
  • Coach and mentor team members, ensuring technical excellence and continuous learning.
  • Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.

5. Must-Have & Good-to-Have Skills

Must-Have Skills:

  • Strong understanding of clickstream data and data pipeline architecture
  • Hands-on experience with cloud platforms (GCP)
  • Expertise in SQL, Python, and Airflow
  • Solid software engineering foundation — API design, testing, version control, and deployment practices
  • Proven ability to perform exploratory data analysis and data validation
  • Knowledge of cloud security, IAM, and networking best practices
  • Working knowledge of building or integrating AI/LLM-based components into existing systems
  • Excellent problem-solving, stakeholder management, and communication skills


Good-to-Have Skills:

  • Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
  • AWS Certified Data Analytics or Azure Data Engineer Associate
  • Google Analytics 4 (GAIQ)
  • Experience in marketing attribution, commerce data, or analytics ecosystems
  • Exposure to cost optimization and cloud resource management
  • Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
  • Experience building automation frameworks or internal data tools

6. Not-a-Fit Criteria

  • Individual Contributor Focus: Operates as the team's best individual contributor instead of building team capability or empowering L3s.
  • Information Hoarding: Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
  • Avoidance of Conflict: Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
  • Activity Over Outcomes: Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
  • Functional Siloing: Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.



Our Culture & Perks - Where Passion Meets Purpose:

  • Competitive CTC: Based on experience and skillset
  • Medical Insurance for you and your family
  • Return-to-Work Program for New Moms — because career breaks shouldn’t break momentum
  • 1 Work From Home Day/Month — flexibility when life calls
  • 2 Birthday Leaves/Year — one for you, one for someone you love
  • Monthly Engagement Activities — from game nights to learning sessions
  • Inclusive Culture & Equal Opportunity Employer — diversity drives our innovation
  • We Think Like Engineers & Athletes: we build, we iterate, we scale, we win — together
  • 5-day workweek — because balance drives brilliance


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
7 - 13 yrs
₹10L - ₹24L / yr
skill iconPython
PySpark
Oracle
PL/SQL
Google Cloud Platform (GCP)
+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

  • Strong expertise in Data Modeling, Data Design & Modernization
  • Primary skills: PySpark, Oracle SQL/PLSQL
  • Secondary skills: Python, ETL & Data Pipelines
  • Experience with Kafka and Hadoop
  • Exposure to AWS / Azure / GCP
  • Good knowledge of Git and JIRA

Roles & Responsibilities:

  • Design, develop, and modernize scalable data models and data architecture.
  • Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
  • Build and maintain robust ETL workflows and data pipelines.
  • Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
  • Perform data transformation, optimization, and performance tuning.
  • Collaborate with technical teams on data design, development, testing, and deployment.


Read more
Proximity Works
at Proximity Works
1 video
5 recruiters
Tushar Vaghela
Posted by Tushar Vaghela
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconPython
skill iconScala
Apache Spark
Apache Kafka
databricks
+1 more

Description


We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.



Key Responsibilities

  • Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
  • Build and optimize distributed data applications using Apache Spark and Python Scala.
  • Develop reliable, high-performance data pipelines for batch and streaming workloads.
  • Design and manage data workflows using Apache Airflow.
  • Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
  • Work with large datasets to ensure data quality, consistency, reliability, and performance.
  • Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
  • Optimize data workflows for scalability, reliability, performance, and cost efficiency.
  • Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.



Requirements

Candidates who demonstrate:

  • 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
  • Strong hands-on experience with Apache Spark and Scala.
  • Experience designing, building, and maintaining large-scale ETL pipelines.
  • Strong hands-on experience with AWS, particularly Amazon S3.
  • Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
  • Strong SQL skills and a solid understanding of distributed data processing concepts.
  • Experience working with batch and/or streaming data pipelines.
  • Excellent debugging, problem-solving, and performance optimization skills.
  • Strong communication and collaboration skills.


Good to Have

  • Experience with Databricks and the broader Databricks data platform.
  • Familiarity with streaming technologies such as Apache Kafka.
  • Experience working on large-scale data platforms handling high-volume data workloads.
  • Exposure to additional AWS data services and cloud-native data architectures.
Read more
Solutionara Private Limited
Noida
6 - 9 yrs
₹16L - ₹22L / yr
SQL
skill iconPython
ETL
databricks
Apache Airflow
+4 more

About Solutionara

Solutionara is an AI-led IT Consulting and Technology Services organization delivering enterprise transformation through Cloud, Integration, Data Engineering, Digital Experience, AI, and Enterprise Applications.

Headquartered in the United States with a Global Delivery Center (GDC) in Noida, India, Solutionara partners with enterprise organizations across retail, manufacturing, distribution, consumer goods, and other industries to design, implement, and support scalable technology solutions.

As a rapidly growing consulting organization, we foster a culture of ownership, innovation, collaboration, and continuous improvement, empowering our teams to contribute beyond their immediate responsibilities while delivering exceptional value to our global clients.

Every team member is expected to think like a consultant and business problem solver—understanding client objectives, challenging assumptions when appropriate, leveraging AI responsibly, and continuously identifying opportunities to improve quality, productivity, and customer outcomes.

AI is embedded into how we work, but it is an enabler—not a replacement for expertise, critical thinking, or accountability.


Role Overview

Solutionara is seeking a Senior Data Engineer with strong data engineering and database expertise to design, build, optimize, and support enterprise-scale data solutions.

This is a hands-on engineering position requiring strong SQL, Python, ETL/ELT, database, cloud, and troubleshooting capabilities. The engineer will work closely with technical leads and client stakeholders while taking ownership of major engineering components.

Location: Noida, India – Onsite | Employment Type: Full-Time | Experience: 6–9 Years


Key Responsibilities

Data Engineering

  • Design, develop, test, deploy, and support scalable ETL/ELT pipelines.
  • Build ingestion and transformation solutions across databases, APIs, files, and enterprise applications.
  • Develop high-quality SQL and Python-based data processing solutions.
  • Implement batch and incremental data-processing patterns.
  • Develop reusable engineering components and frameworks.
  • Support complex data migration and transformation activities.
  • Perform source-to-target mapping and technical data analysis.
  • Implement pipeline logging, monitoring, exception handling, and recovery mechanisms.

Database & Platform Engineering

  • Design and optimize relational database schemas and data structures.
  • Analyze and improve SQL/query performance.
  • Support indexing, partitioning, storage optimization, and database performance.
  • Implement appropriate database security and access controls.
  • Support database monitoring, availability, backup/recovery, and operational requirements in collaboration with infrastructure/platform teams.
  • Troubleshoot database and pipeline performance issues.
  • Contribute to cloud data-platform configuration and optimization.

Data Quality

  • Implement automated validation and data-quality controls.
  • Develop reconciliation processes between source and target systems.
  • Identify duplicate, incomplete, inconsistent, and invalid data.
  • Implement cleansing, standardization, validation, and exception-management logic.
  • Work with technical and business stakeholders to understand and implement business data rules.

Technical Delivery

  • Convert technical designs into reliable production solutions.
  • Participate in technical design and code reviews.
  • Mentor junior/mid-level engineers.
  • Support estimation and technical planning.
  • Troubleshoot complex production and integration issues.
  • Collaborate with technical leads, application teams, DevOps, QA, BI, and client teams.
  • Document technical designs, mappings, configurations, operational procedures, and engineering decisions.

Consulting & AI-Led Working

  • Understand the business purpose behind assigned engineering requirements.
  • Raise risks, assumptions, dependencies, and potential improvements proactively.
  • Communicate effectively with client and internal stakeholders.
  • Use AI-assisted tools to improve coding, testing, analysis, documentation, and troubleshooting productivity.
  • Independently verify AI-generated code and recommendations before implementation.
  • Identify opportunities for engineering automation and process improvement.


Required Qualifications

  • 6–9 years of experience in data engineering, database engineering, data integration, or related areas.
  • Advanced SQL skills.
  • Strong hands-on Python experience.
  • Strong ETL/ELT development experience.
  • Strong relational database knowledge, such as SQL Server, PostgreSQL, Oracle, or equivalent.
  • Experience with data modeling and database design.
  • Experience with AWS, Azure, or another major cloud platform.
  • Experience with modern data technologies such as Databricks, Snowflake, Redshift, Synapse, Glue, ADF, Airflow, dbt, or equivalent.
  • Experience with performance tuning and optimization.
  • Experience with data validation and reconciliation.
  • Strong troubleshooting and analytical skills.
  • Ability to take ownership of engineering deliverables with limited supervision.

Preferred Qualifications

  • Experience working with enterprise ERP, CRM, PIM, PLM, MES, or related systems.
  • Experience with manufacturing, retail, distribution, or consumer-goods data.
  • Experience with CI/CD and infrastructure/platform engineering practices.
  • Experience with API and event-driven integrations.
  • Previous consulting or technology-services experience.

What Success Looks Like

  • Pipelines and databases perform reliably at enterprise scale.
  • Engineering solutions are maintainable, reusable, and well documented.
  • Data issues are detected and addressed systematically.
  • Junior engineers receive effective technical guidance.
  • Problems are owned through resolution rather than simply escalated.
  • Engineering decisions reflect both technical requirements and client business objectives.


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
5 - 7 yrs
₹4L - ₹20L / yr
Data Engineer,
skill iconPython
ETL
DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
  • Develop complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain reliable data integration workflows across multiple data sources.
  • Perform data cleansing, validation, transformation, and quality checks.
  • Analyze data and provide insights to support business and technical requirements.
  • Implement and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
  • Troubleshoot data pipeline failures, performance issues, and production incidents.
  • Optimize data processing workflows for performance, scalability, and reliability.
  • Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
  • Follow best practices for version control, testing, documentation, and deployment.
  • Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

  • 5–7 years of hands-on experience in Data Engineering.
  • Strong programming skills in Python.
  • Strong expertise in Advanced SQL and database concepts.
  • Hands-on experience with ETL/ELT processes and data pipelines.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience with CI/CD practices and tools.
  • Strong understanding of DevOps principles, automation, and deployment processes.
  • Strong data analytics and problem-solving skills.
  • Experience working with large datasets and performance optimization.
  • Good understanding of Git/version control and software development best practices.

Good to Have

  • Hands-on experience with Google Cloud Platform (GCP).
  • Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
  • Experience with containerization/orchestration technologies such as Docker/Kubernetes.
  • Experience with workflow orchestration tools such as Airflow.
  • Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

  • Strong analytical and problem-solving abilities.
  • Good communication and stakeholder management skills.
  • Ability to work independently as well as in a collaborative team environment.
  • Strong ownership of data pipelines and production systems.
  • Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops


Read more
QuaXigma IT solutions Private Limited
Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos