Snowflake Data Engineer

We are looking for a Data Engineer with at least 1 year of hands-on experience building solutions on Snowflake. The candidate should be comfortable designing, building, and managing reliable data pipelines that move data from multiple sources into a central data platform.

Responsibilities

• Build and maintain data pipelines for ingesting, transforming, and loading data into Snowflake
• Design scalable data models, schemas, tables, and views in Snowflake
• Develop ETL/ELT workflows using SQL, Python, or data orchestration tools
• Integrate data from APIs, databases, files, and third-party platforms
• Monitor pipeline performance, failures, data quality, and freshness
• Optimize Snowflake queries, warehouses, storage, and compute usage
• Implement incremental loads, change data capture, and scheduled workflows
• Work with engineering and business teams to understand data requirements
• Maintain documentation for pipelines, datasets, and data transformations

Requirements

• 1+ year of hands-on experience working with Snowflake
• Strong SQL skills and experience writing complex queries
• Experience building and managing ETL or ELT data pipelines
• Knowledge of data warehousing concepts, dimensional modelling, and data quality
• Experience with Python or another scripting language
• Familiarity with orchestration tools such as Airflow, Dagster, Prefect, dbt, or similar
• Understanding of APIs, relational databases, file formats, and cloud storage
• Ability to troubleshoot pipeline failures and performance issues
• Strong analytical, problem-solving, and communication skills

Good to Have

• Experience with dbt and Snowflake Tasks, Streams, Snowpipe, or Dynamic Tables
• Knowledge of AWS, Azure, or Google Cloud
• Experience with Kafka or other streaming platforms
• Familiarity with CI/CD, Git, monitoring, and data governance practices
• Experience integrating ERP, finance, or operational systems

Design, build, and maintain end-to-end data pipelines to ingest, process, and transform data from files, streams,

APIs, and relational/non-relational databases into Snowflake.   Develop and optimize ELT/ETL pipelines using Snowflake SQL,

Snowpipe, Streams & Tasks, and cloud-native orchestration tools.   Implement scalable data models and schemas (staging, curated, and consumption layers) to support analytics and reporting use cases.   Develop transformations and business logic using SQL and Python, including Snowflake UDFs and stored procedures.   Optimize Snowflake performance and cost through query tuning, warehouse sizing, clustering, and resource management.   Integrate Snowflake with cloud storage and services across AWS and Azure (e.g., object storage, data integration, and mess

Location: Hyderabad / Chennai

Experience: 5+ years

Employment type: Full-time, permanent

Work Hours: General Shift

website: www.amazech.com

Qualifications: 

• B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Data Science, or related disciplines.
• Strong academic background with relevant industry experience in Data Engineering and Data Warehousing.

Key Responsibilities:

·       Design, develop, and maintain scalable data warehouse solutions using Snowflake.

·       Write, optimize, troubleshoot, and enhance Snowflake SQL queries with a focus on performance and scalability.

·       Develop and support ETL processes using Talend to ensure reliable and efficient data movement.

·       Collaborate with business, analytics, and application teams to enable reporting, dashboards, metrics, and data exploration capabilities.

·       Perform data analysis and resolve issues across data ingestion, transformation, and reporting pipelines.

·       Debug and troubleshoot Python-based data processing scripts and automation workflows.

·       Implement best practices for data quality, testing, deployment, and code reviews.

·       Work across UI, API, and Data Warehouse layers to support end-to-end data integration and business requirements.

·       Monitor, optimize, and maintain data warehouse performance and operational stability.

·       Create and maintain technical documentation, data models, and process workflows.

Required Skills and Experience: 

·       Strong hands-on expertise in Snowflake Data Warehouse.

·       Advanced SQL skills with experience handling large-scale datasets.

·       Strong understanding of Data Warehousing concepts, dimensional modelling, and data architecture.

·       Hands-on experience with Analytical SQL functions, query tuning, and performance optimization.

·       Experience developing and maintaining ETL solutions using Talend.

·       Proficiency in Python for scripting, debugging, automation, and data processing.

·       Experience integrating UI, API, and Data Warehouse workflows.

·       Strong problem-solving and analytical skills.

·       Experience with testing, code reviews, and deployment best practices.

·       Excellent communication and stakeholder management skills.

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Job Description

This is a remote position.

Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.

Role Overview

If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.

What You'll Do

• Design, build, and maintain data pipelines and infrastructure using SQL and Python
• Work within Snowflake to build and optimize data models supporting business use cases
• Parse and process structured and semi-structured data (JSON, XML) from varied sources
• Diagnose issues across raw, intermediate, and summary tables
• Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
• Investigate and resolve data quality issues, including time-sensitive or urgent ones
• Identify opportunities to consolidate models and maintain a single source of truth (SSOT)

Requirements

What We're Looking For

• 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
• 2+ years of experience with Python for data engineering tasks (required)
• Experience with Snowflake or an equivalent cloud data warehouse (required)
• Experience parsing JSON and XML data (a plus)
• A strong eye for data quality and attention to detail
• Knowledge of Git (required)
• Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
• Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
• Experience with BI tools like Power BI(a plus, not core to this role)
• Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
• Knowledge of SSIS packages (a plus)
• Familiarity with CI/CD methodologies

Benefits

Life at Incubyte  

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance.
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

Strong Senior Developer – PL/SQL, SQL & ETL (Microsoft SSIS) Profile

2

Mandatory (Experience 1) – Must have minimum 5+ years of strong hands-on experience in PL/SQL and SQL development, including complex stored procedures, functions, queries, joins, data manipulation, and query/performance optimization.

3

Mandatory (Experience 2) – Must have strong hands-on experience in ETL development using Microsoft SSIS, including building, maintaining, optimizing, and troubleshooting SSIS packages for large-volume data movement and transformation.

4

Mandatory (Experience 3) – Must have solid experience working with Data Warehousing concepts and architectures, including data models, fact/dimension structures, ETL data flows, and enterprise reporting/data warehouse environments.

5

Mandatory (Experience 4) – Must have experience managing batch jobs, scheduling, and data pipelines, ensuring timely and reliable execution of enterprise ETL workflows.

6

Mandatory (Experience 5) – Must have hands-on experience in production support for SSIS/ETL and data warehouse jobs, including monitoring job execution, troubleshooting failures, performing root cause analysis, and implementing preventive fixes.

7

Mandatory (Experience 6) – Must have experience with data quality, validation, and troubleshooting, including identifying and resolving data discrepancies/issues affecting downstream reports, dashboards, and analytics.

8

Mandatory (Experience 7) – Must have experience with unit, integration, and regression testing of SQL, PL/SQL, and ETL components, along with strong documentation of technical designs, data mappings, data flows, and deployment processes.

9

Mandatory (Location) – Must be willing to work in a hybrid model from a city where Cognizant has an office.

10

Mandatory (Notice Period) – Immediate joiners or candidates who can join within 2–4 weeks.

• Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time data ingestion and transformation.
• Develop and optimize data lake and data warehouse architectures (e.g., Snowflake, BigQuery, Redshift).
• Work with cloud platforms GCP, Azure to manage data infrastructure.
• GCP as mandatory skills
• Collaborate with analytics and product teams to understand data needs and deliver solutions.
• Ensure data quality, reliability, security, and compliance across all data systems.
• Mentor junior data engineers and contribute to best practices and code reviews.
• Monitor and troubleshoot data pipeline performance and resolve data-related issues.
• Automate data validation, monitoring, and alerting processes.
• 8+ years of experience in data engineering or software engineering with a data focus.
• Proficient in SQL and at least one programming language (e.g., Python, Scala, Java).
• Experience with modern data warehousing tools (e.g., Snowflake, Redshift, BigQuery).
• Strong understanding of data modeling, data lakes, and ETL/ELT design.
• Hands-on experience with orchestration tools like Airflow, dbt, or similar.
• Solid experience with cloud data platforms (AWS/GCP/Azure).
• Familiarity with CI/CD pipelines, containerization (Docker/Kubernetes), and version control (Git).
• Experience working in a DevOps or DataOps environment.
• Knowledge of data governance, lineage, and cataloging tools (e.g., Collibra, Alation).
• Familiarity with streaming technologies (Kafka, Spark Streaming, Flink).
• Experience supporting machine learning workflows and data science initiatives.

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Job Summary

We are seeking a motivated Data Engineer with strong skills in SQL, Python, and Linux to design, build, and maintain scalable data pipelines and support data-driven decision-making. The ideal candidate should have experience working with large datasets, ETL processes, and relational databases while ensuring data quality and performance.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write optimized SQL queries, stored procedures, and database objects.
• Develop Python scripts for data extraction, transformation, and automation.
• Work in Linux environments to manage scripts, cron jobs, and system processes.
• Monitor and troubleshoot data pipeline failures.
• Ensure data integrity, consistency, and quality across systems.
• Collaborate with data analysts, software engineers, and business stakeholders.
• Optimize database performance and query execution.
• Participate in code reviews and follow best engineering practices.

Required Skills

• Strong proficiency in SQL (joins, subqueries, window functions, CTEs, indexing, query optimization).
• Good programming experience in Python.
• Hands-on experience with Linux commands and shell scripting.
• Understanding of ETL/ELT concepts and data warehousing.
• Knowledge of relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server.
• Familiarity with Git for version control.
• Strong problem-solving and analytical skills.

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
• Develop automation scripts using Python for data processing and workflow optimization.
• Work with Linux environments for deployment, monitoring, and troubleshooting.
• Ensure data quality, integrity, and reliability across data platforms.
• Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Implement best practices for data security, governance, and documentation.

Required Skills

• Strong experience in Data Engineering concepts and ETL/ELT processes.
• Proficiency in SQL, including query optimization and database design.
• Strong programming skills in Python.
• Hands-on experience with Linux commands, shell scripting, and system administration basics.
• Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Familiarity with Git/version control.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
• Experience with data warehousing solutions and big data technologies.
• Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant certifications in cloud or data engineering are an added advantage.

Must have experience in Java

Must have experience in Spark

Must have experience in ETL coding

Strong expertise in coding