14 Datawarehousing Jobs in Pune | Datawarehousing Job openings in Pune

Job Title: Senior Data Engineer

Position Summary

We are seeking a highly skilled Data Engineer with strong expertise in reporting infrastructure, data modeling, and analytics platforms. This role will focus on building scalable reporting solutions, optimizing data pipelines, and enabling data-driven decision-making across the organization. The ideal candidate will have deep experience with databases, data warehousing, and complex query development. While Ruby on Rails experience is beneficial, the primary emphasis is on data engineering and reporting systems.

Key Responsibilities

• Design, develop, and maintain reporting infrastructure and data platforms.
• Build and optimize complex SQL queries, data models, and reporting datasets.
• Develop scalable ETL/ELT pipelines and data integration processes.
• Design and maintain database schemas to support analytics and reporting requirements.
• Collaborate with business stakeholders to understand reporting needs and translate them into technical solutions.
• Implement data quality, governance, and performance best practices.
• Support and enhance enterprise reporting solutions and dashboards.
• Work with large-scale datasets in cloud data warehouse environments.
• Troubleshoot reporting issues and optimize database performance.
• Partner with engineering and product teams to establish sustainable data architecture.

Must Have: Technical Skills

• PostgreSQL
• Snowflake
• Advanced SQL
• Data Modeling
• Data Warehousing
• Reporting & Analytics Infrastructure
• ETL/ELT Development
• Query Performance Tuning

Success Profile:

The ideal candidate is a data-focused engineer who enjoys working with complex datasets, designing scalable reporting solutions, and building foundational infrastructure that empowers analytics and business intelligence teams. They should be comfortable navigating databases, optimizing queries, and translating business reporting needs into robust technical implementations.

Experience Range: 5-10 years

Role Type: Individual Contributor / Senior Engineer

Primary Focus: Reporting Infrastructure, Data Engineering, Data Warehousing, and Analytics Enablement.

We are looking for a MuleSoft Developer to build APIs and integrations across our systems.

Responsibilities

• Design and build APIs on the Anypoint Platform
• Write data transformations in DataWeave
• Define API specifications in RAML
• Deploy, monitor and support integrations

Requirements

• 2+ years of MuleSoft development
• Strong DataWeave and Anypoint experience
• MuleSoft certification is a plus

Job Title : Senior Backend Engineer – Node.js & TypeScript

Experience : 4+ Years

Employment Type : Contract – 3 Months

Location : Pune

Work Mode : On-site

Working Hours : 03:00 PM to 11:00 PM OR 03:00 PM to 12:00 AM

Time Zone : Minimum 4-hour overlap with Eastern Time (ET)

About the Role :

We are looking for a Senior Backend Engineer to design, develop, and scale an AI-led digital platform. The role involves working closely with the Founder/CEO and technical team on architecture, product development, innovation, and end-to-end feature ownership.

Mandatory Skills :

Node.js, TypeScript, REST, GraphQL, PostgreSQL, SQL, Prisma / TypeORM / Sequelize, AWS (ECS, EC2, S3, RDS, Lambda), Airbyte / dbt / Airflow / AWS Glue, Data Warehousing, Event-Driven Architecture, Message Queues, CI/CD, Automated Testing, Backend Architecture, Scalability & Performance.

Key Responsibilities :

• Design and develop scalable backend services using Node.js and TypeScript.
• Build and optimize REST and GraphQL APIs.
• Work with PostgreSQL, SQL, and ORMs such as Prisma / TypeORM / Sequelize.
• Design data pipelines using Airbyte, dbt, Airflow, or AWS Glue.
• Manage and optimize AWS infrastructure including ECS, EC2, S3, RDS, and Lambda.
• Implement CI/CD, automated testing, event-driven architectures, and message queues.
• Optimize API performance, scalability, reliability, and data warehouse solutions.
• Own features end-to-end from design to production.
• Participate in code reviews, on-call support, and production troubleshooting.
• Collaborate with Product, QA, and Engineering teams and mentor junior developers.
• Work closely with the Founder / CEO on technical solutioning and product innovation.

Requirements :

• 4+ years of hands-on Node.js & TypeScript backend development.
• Strong experience with AWS, PostgreSQL, SQL, APIs, and backend architecture.
• Hands-on experience with data pipelines and data warehousing.
• Experience with CI/CD, automated testing, event-driven systems, and message queues.
• Strong problem-solving skills and end-to-end ownership mindset.
• Ability to work independently in a fast-paced environment.
• Good communication and collaboration skills.
• Bachelor's degree in Computer Science, IT, or a related field.

Preferred :

• Terraform / CloudFormation and Infrastructure as Code.
• Docker / Kubernetes and strong DevOps exposure.
• AWS backup / disaster recovery experience.
• Exposure to GCP / Azure.
• Startup / early-stage product development experience.

Roles & Responsibilities

• Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration

of enterprise-wide data from diverse sources

• Build and optimize data engineering workflows using Databricks and PySpark

• Write efficient, high-performance SQL for data transformation and analysis

• Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing,

data models, and pipelines

• Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the

development lifecycle

• Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production

environments with proper change control processes

• Collaborate with cross-functional teams to translate business requirements into scalable data solutions

• Ensure data quality, reliability, and performance across all pipelines and platforms

Ideal Candidate

1Strong Azure Databricks Engineer / Senior Data Engineer Profile

2Mandatory (Experience 1) – Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.

3Mandatory (Experience 2) – Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.

4Mandatory (Experience 3) – Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.

5Mandatory (Experience 4) – Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.

6Mandatory (Experience 5) – Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.

7Mandatory (Experience 6) – Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.

8Mandatory (Experience 7) – Must have proven technical leadership experience, including code reviews, enforcing development best practices, mentoring developers, and providing technical guidance to a data engineering team.

9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 15 days.

10Mandatory (Note) - The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location.

15+ years of IT Delivery and Technology Services experience.

15+ years managing large offshore delivery organizations.

Proven leadership of portfolios exceeding 200+ resources.

Financial Services or Banking experience is a MUST

Extensive technical experience in Data Engineering, Data Platforms, Data Brics.

Cloud Data Transformation Programs, Data Warehousing, Azure Data Platform and compliance experience

Job Title : Report (Power BI) Engineer / Developer

Experience : 5+ Years

Work Mode : Remote (4 days/month office visit)

Locations : Noida, Hyderabad, Chennai, Pune, Bengaluru

Job Summary :

We are looking for an experienced Report (Power BI) Engineer / Developer to design and develop business-critical reporting solutions. The ideal candidate should have strong expertise in Power BI dashboards and paginated reports, along with hands-on experience in SQL Server, Snowflake, and Databricks.

Mandatory Skills :

Power BI, Power BI Dashboards, Paginated Reports, SQL Server, T-SQL, Snowflake, Databricks, Data Warehousing, ETL, SQL Query Optimization.

Key Skills Required :

• 5+ years of experience in Power BI development.
• Strong hands-on experience with Power BI Dashboards and Paginated Reports.
• Excellent knowledge of SQL Server and T-SQL development.
• Experience with Snowflake and Databricks.
• Understanding of data warehousing concepts, ETL processes, and SQL performance optimization.
• Strong communication and collaboration skills.

Preferred Skills :

• Experience with cloud data modernization projects.
• Knowledge of data security and compliance practices.

Note : Comprehensive background verification, including education, employment, criminal, credit, and drug screening, is mandatory.

Lead Data Engineer

What are we looking for

real solver?

Solver? Absolutely. But not the usual kind. We're searching for the architects of the audacious & the pioneers of the possible. If you're the type to dismantle assumptions, re-engineer ‘best practices,’ and build solutions that make the future possible NOW, then you're speaking our language.

Your Responsibilities

What you will wake up to solve.

• Lead Technical Design & Data Architecture: Architect and lead the end-to-end development of scalable, cloud-native data platforms. You’ll guide the squad on critical architectural decisions—choosing between Batch vs. Streaming or ETL vs. ELT—while remaining 100% hands-on, contributing high-quality, production-grade code.
• Build High-Velocity Data Pipelines: Drive the implementation of robust data transports and ingestion frameworks using Python, SQL, and Spark. You will build integration layers that connect heterogeneous sources (SaaS, RDBMS, NoSQL) into unified, high-availability environments like BigQuery, Snowflake, or Redshift.
• Mentor & Elevate the Squad: Foster a culture of technical excellence by mentoring and inspiring a team of data analysts and engineers. Lead deep-dive code reviews, promote best-practice data modeling (Star/Snowflake schema), and ensure the squad adopts modern engineering standards like CI/CD for data.
• Drive AI-Ready Data Strategy: Be the expert in designing data foundations optimized for AI and Machine Learning. You will champion the use of GCP (Dataflow, Pub/Sub, BigQuery) and AWS (Lambda, Glue, EMR) to create "clean room" environments that fuel advanced analytics and generative AI models.
• Partner with Clients as a Technical DRI: Act as the Directly Responsible Individual for client success. Translate ambiguous business questions into elegant data services, manage project deliverables using Agile methodologies, and ensure that the data provided is accurate, consistent, and mission-critical.
• Troubleshoot & Optimize for Scale: Own the reliability of the reporting layer. You will proactively monitor pipelines, troubleshoot complex transformation bottlenecks, and propose ways to improve platform performance and cost-efficiency.
• Innovate and Build Reusable IP: Spearhead the creation of reusable data frameworks, custom operators, and transformation libraries that accelerate future projects and establish Searce’s unique technical advantage in the market.

Welcome to Searce

The AI-Native tech consultancy that's rewriting the rules.

Searce is an AI-native, engineering-led, modern tech consultancy that empowers clients to futurify their business by delivering intelligent, impactful, real business outcomes. Searce solvers co-innovate with clients as their trusted transformational partners ensuring sustained competitive advantage. Searce clients realize smarter, faster, better business outcomes delivered by AI-native Searce solver squads. 

Functional Skills 

the solver personas.

• The Data Architect: This persona deconstructs ambiguous business goals into scalable, elegant data blueprints. They don't just move data; they design the foundation—from schema design to partitioning strategies—that allows data scientists and analysts to thrive, foreseeing technical bottlenecks and making pragmatic trade-offs.
• The Player-Coach: As a hands-on leader, this persona leads from the front by writing exemplary, production-grade SQL and Python while simultaneously mentoring and elevating the skills of the squad. Their success is measured by the team's ability to deliver high-quality, maintainable code and their growth as engineers.
• The Pragmatic Innovator: This individual balances a passion for modern data tech (like Generative AI and Real-time Streaming) with a sharp focus on business outcomes. They champion new tools where they add real value but are disciplined enough to choose stable, cost-effective solutions to meet deadlines and deliver robust products.
• The Client-Facing Technologist: This persona acts as the crucial technical bridge between the data squad and the client. They build trust by listening actively, explaining complex data concepts (like data latency or idempotency) in simple terms, and demonstrating how engineering decisions align with the client’s strategic goals.
• The Quality Craftsman: This individual possesses an unwavering commitment to data integrity and treats data engineering as a craft. They are the guardian of the reporting layer, advocating for robust testing, data validation frameworks, and clean, modular code to ensure the long-term reliability of the data platform.

Experience & Relevance 

• Engineering Depth: 7-10 years of professional experience in end-to-end data product development. You have a portfolio that proves your ability to build complex, high-velocity pipelines for both Batch and Streaming workloads.
• Cloud-Native Fluency: Deep, hands-on experience designing and deploying scalable data solutions on at least one major cloud platform (AWS, GCP, or Azure). You are comfortable navigating the nuances of EMR, BigQuery, or Synapse at scale.
• AI-Native Workflow: You don’t just build for AI; you build with AI. You must be proficient in using AI coding assistants (e.g., GitHub Copilot) to accelerate your delivery and have a track record of building the data foundations required for Generative AI.
• Architectural Portfolio: Evidence of leading 2-3 large-scale transformations—including platform migrations, data lakehouse builds, or real-time analytics architectures.
• Client-Facing Acumen: You have direct experience in a consultative, client-facing role. You can confidently translate a CEO’s business vision into a Lead Engineer’s technical specification without losing anything in translation.

Join the ‘real solvers’

ready to futurify?

If you are excited by the possibilities of what an AI-native engineering-led, modern tech consultancy can do to futurify businesses, apply here and experience the ‘Art of the possible’. Don’t Just Send a Resume. Send a Statement.

Job Details

- Job Title: Lead I - Data Engineering 

- Industry: Global digital transformation solutions provider

- Domain - Information technology (IT)

- Experience Required: 6-9 years

- Employment Type: Full Time

- Job Location: Pune

- CTC Range: Best in Industry

Job Description

Job Title: Senior Data Engineer (Kafka & AWS)

Responsibilities:

• Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services.
• Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems.
• Demonstrate strong expertise in the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry.
• Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data.
• Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue.
• Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platforms.
• Uphold data security, governance, and compliance standards across all data operations.

Requirements:

• Minimum of 5 years of experience in Data Engineering or related roles.
• Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.).
• Proficient in coding with Python, SQL, and Java — with Java strongly preferred.
• Experience with Infrastructure-as-Code (IaC) tools (e.g., CloudFormation) and CI/CD pipelines.
• Excellent problem-solving, communication, and collaboration skills.
• Flexibility to write production-quality code in both Python and Java as required.

Skills: Aws, Kafka, Python

Must-Haves

Minimum of 5 years of experience in Data Engineering or related roles.

Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.).

Proficient in coding with Python, SQL, and Java — with Java strongly preferred.

Experience with Infrastructure-as-Code (IaC) tools (e.g., CloudFormation) and CI/CD pipelines.

Excellent problem-solving, communication, and collaboration skills.

Flexibility to write production-quality code in both Python and Java as required.

Skills: Aws, Kafka, Python

Notice period - 0 to 15days only

Job Title : Ab Initio Developer

Location : Pune

Experience : 5+ Years

Notice Period : Immediate Joiners Only

Job Summary :

We are looking for an experienced Ab Initio Developer to join our team in Pune.

The ideal candidate should have strong hands-on experience in Ab Initio development, data integration, and Unix scripting, with a solid understanding of SDLC and data warehousing concepts.

Mandatory Skills :

Ab Initio (GDE, EME, graphs, parameters), SQL/Teradata, Data Warehousing, Unix Shell Scripting, Data Integration, DB Load/Unload Utilities.

Key Responsibilities :

• Design and develop Ab Initio graphs/plans/sandboxes/projects using GDE and EME.
• Manage and configure standard environment parameters and multifile systems.
• Perform complex data integration from multiple source and target systems with business rule transformations.
• Utilize DB Load/Unload Utilities effectively for optimized performance.
• Implement generic graphs, ensure proper use of parallelism, and maintain project parameters.
• Work in a data warehouse environment involving SDLC, ETL processes, and data analysis.
• Write and maintain Unix Shell Scripts and use utilities like sed, awk, etc.
• Optimize and troubleshoot performance issues in Ab Initio jobs.

Mandatory Skills :

• Strong expertise in Ab Initio (GDE, EME, graphs, parallelism, DB utilities, multifile systems).
• Experience with SQL and databases like SQL Server or Teradata.
• Proficiency in Unix Shell Scripting and Unix utilities.
• Data integration and ETL from varied source/target systems.

Good to Have :

• Experience in Ab Initio and AWS integration.
• Knowledge of Message Queues and Continuous Graphs.
• Exposure to Metadata Hub.
• Familiarity with Big Data tools such as Hive, Impala.
• Understanding of job scheduling tools.

We are seeking a skilled Cloud Data Engineer who has experience with cloud data platforms like AWS or Azure and especially Snowflake and dbt to join our dynamic team. As a consultant, you will be responsible for developing new data platforms and create the data processes. You will collaborate with cross-functional teams to design, develop, and deploy high-quality frontend solutions. 

Responsibilities:

Customer consulting: You develop data-driven products in the Snowflake Cloud and connect data & analytics with specialist departments. You develop ELT processes using dbt (data build tool) 

Specifying requirements: You develop concrete requirements for future-proof cloud data architectures.

Develop data routes: You design scalable and powerful data management processes.

Analyze data: You derive sound findings from data sets and present them in an understandable way.

Requirements:

Requirements management and project experience: You successfully implement cloud-based data & analytics projects.

Data architectures: You are proficient in DWH/data lake concepts and modeling with Data Vault 2.0.

Cloud expertise: You have extensive knowledge of Snowflake, dbt and other cloud technologies (e.g. MS Azure, AWS, GCP).

SQL know-how: You have a sound and solid knowledge of SQL.

Data management: You are familiar with topics such as master data management and data quality.

Bachelor's degree in computer science, or a related field.

Strong communication and collaboration abilities to work effectively in a team environment.

Skills & Requirements

Cloud Data Engineering, AWS, Azure, Snowflake, dbt, ELT processes, Data-driven consulting, Cloud data architectures, Scalable data management, Data analysis, Requirements management, Data warehousing, Data lake, Data Vault 2.0, SQL, Master data management, Data quality, GCP, Strong communication, Collaboration.

Required Skills:

• Proven work experience as an Enterprise / Data / Analytics Architect - Data Platform in HANA XSA, XS, Data Intelligence and SDI
• Can work on new and existing architecture decision in HANA XSA, XS, Data Intelligence and SDI
• Well versed with data architecture principles, software / web application design, API design, UI / UX capabilities, XSA / Cloud foundry architecture
• In-depth understand of database structure (HANA in-memory) principles.
• In-depth understand of ETL solutions and data integration strategy.
• Excellent knowledge of Software and Application design, API, XSA, and microservices concepts

Roles & Responsibilities:

• Advise and ensure compliance of the defined Data Architecture principle.
• Identifies new technologies update and development tools including new release/upgrade/patch as required. 
• Analyzes technical risks and advises on risk mitigation strategy.
• Advise and ensures compliance to existing and development required data and reporting standard including naming convention.

The time window is ideally AEST (8 am till 5 pm) which means starting at 3:30 am IST. We understand it can be very early for an SME supporting from India. Hence, we can consider the candidates who can support from at least 7 am IST (earlier is possible).

ABOUT US:
Pingahla was founded by a group of people passionate about making the world a better place by harnessing
the power of Data. We are a data management firm with offices in New York and India.Our mission is to help transform the way companies operate and think about their business. We make it easier
to adopt and stay ahead of the curve in the ever-changing digital landscape. One of our core beliefs is
excellence in everything we do!

JOB DESCRIPTION:
Pingahla is recruiting ETL & BI Test Manager who can build and lead a team, establish infrastructure, processes
and best practices for our Quality Assurance vertical. The candidates are expected to have at least 5+ years of experience with ETL Testing and working in Data Management project testing. Being a growing company, we will be able to provide very good career opportunities and a very attractive remuneration.

JOB ROLE & RESPONSIBILITIES:
• Plans and manages the testing activities;
• Defect Management and Weekly & Monthly Test report Generation;
• Work as a Test Manager to design Test Strategy and approach for DW&BI - (ETL & BI) solution;
• Provide leadership and directions to the team on quality standards and testing best practices;
• Ensured that project deliverables are produced, including, but not limited to: quality assurance plans,
test plans, testing priorities, status reports, user documentation, online help, etc. Managed and
motivated teams to accomplish significant deliverables within tight deadlines.
• Test Data Management; Reviews and approves all test cases prior to execution;
• Coordinates and reviews offshore work efforts for projects and maintenance activities.

REQUIRED SKILLSET:
• Experience in Quality Assurance Management, Program Management, DW - (ETL & BI)
Management
• Minimum 5 years in ETL Testing, at least 2 years in the Team Lead role
• Technical abilities complemented by sound communication skills, user interaction abilities,
requirement gathering and analysis, and skills in data migration and conversion strategies.
• Proficient in test definition, capable of developing test plans and test cases from technical
specifications
• Single handedly looking after complete delivery from testing side.
• Experience working with remote teams, across multiple time zones.
• Must have a strong knowledge of QA processes and methodologies
• Strong UNIX and PERL scripting skills
• Expertise with ETL testing & hands-on with working on ETL tool like Informatica, DataStage
PL/SQL is a plus.
• Excellent problem solving, analytical and technical troubleshooting skills.
• Familiar with Data Management projects.
• Eager to learn, adopt and apply rapidly changing new technologies and methodologies.
• Efficient and effective at approaching and escalating quality issues when appropriate.

We at Datametica Solutions Private Limited are looking for SQL Engineers who have a passion for cloud with knowledge of different on-premise and cloud Data implementation in the field of Big Data and Analytics including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike. 

Ideal candidates should have technical experience in migrations and the ability to help customers get value from Datametica's tools and accelerators.

Job Description

Experience : 4-10 years

Location : Pune

Mandatory Skills - 

• Strong in ETL/SQL development
• Strong Data Warehousing skills
• Hands-on experience working with Unix/Linux
• Development experience in Enterprise Data warehouse projects
• Good to have experience working with Python, shell scripting
•  

Opportunities -

• Selected candidates will be provided training opportunities on one or more of the following: Google Cloud, AWS, DevOps Tools, Big Data technologies like Hadoop, Pig, Hive, Spark, Sqoop, Flume and Kafka
• Would get chance to be part of the enterprise-grade implementation of Cloud and Big Data systems
• Will play an active role in setting up the Modern data platform based on Cloud and Big Data
• Would be part of teams with rich experience in various aspects of distributed systems and computing

About Us!

A global Leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.

Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.

We have our own products!

Eagle – Data warehouse Assessment & Migration Planning Product

Raven – Automated Workload Conversion Product

Pelican - Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.

Why join us!

Datametica is a place to innovate, bring new ideas to live and learn new things. We believe in building a culture of innovation, growth and belonging. Our people and their dedication over these years are the key factors in achieving our success.

Benefits we Provide!

Working with Highly Technical and Passionate, mission-driven people

Subsidized Meals & Snacks

Flexible Schedule

Approachable leadership

Access to various learning tools and programs

Pet Friendly

Certification Reimbursement Policy

Check out more about us on our website below!

http://www.datametica.com/">www.datametica.com