Data Engineer at Technology Industry · Kochi (Cochin) · 5 - 8 years · ₹12L - ₹27L / yr · Posted 25 Mar 2026

Job Description & Specification:
Post Title: Data Engineer
Work Mode: Kochi Onsite - UK Time zone
Role Overview:
We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have expertise in technologies such as Metabases, Dbt, Stitch, Snowflake, Avo, and MongoDB. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support our analytics and data-driven decision-making processes.
Responsibilities:
- Designing, developing and implementing scalable data pipelines and ETL processes using tools such as Stitch and Dbt to ingest, transform, and load data from various sources into our data warehouse (Snowflake).
- Implement data modeling best practices and standards using Dbt to create and manage data models for reporting and analytics.
- Collaborating with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Develop and maintain dashboards and visualizations in Metabases to enable self-service analytics and data exploration for internal teams.
- Building and optimizing ETL processes to ensure data quality and integrity.
- Optimizing data processing and storage solutions for performance, scalability and reliability, leveraging cloud-based technologies.
- Implementing monitoring and alerting systems to proactively identify and address data issues.
- Implementing data quality checks and monitoring processes to ensure the accuracy, completeness, and integrity of data.
- Managing and optimizing databases (like MongoDB for performance and scalability).
- Developing and maintaining documentation, best practices, and standards for data engineering processes and workflows.
- Stay up to date with emerging technologies and trends in data engineering, machine learning, and analytics, and evaluate their potential impact on data strategy and architecture.
Requirements:
- Bachelor's or Master's degree in Computer Science.
- Minimum of 4 years of experience working as a data engineer with expertise in Metabases, Dbt, Stitch, Snowflake, Avo, MongoDB.
- Strong programming skills in languages like Python, and experience with SQL and database technologies (e.g., PostgreSQL, MySQL, MongoDB).
- Hands-on experience with data integration tools (e.g., Stitch), data modeling tools (e.g., Dbt), and BI platforms (e.g., Metabases).
- Experience with cloud platforms such as AWS.
- Strong understanding of data modeling concepts, database design, and data warehousing principles
- Experience with big data technologies and frameworks (e.g., Hadoop, Spark, Kafka) and cloud-based data platforms (e.g., AWS EMR, Azure Databricks, Google BigQuery).
- Familiarity with data integration tools, ETL processes, and workflow orchestration tools (e.g., Apache Airflow, Apache NiFi).
- Excellent problem-solving skills and attention to detail.
- Strong communication skills with the ability to work effectively in a global team environment.
- Experience in the education or Edtech industry is a plus.
- Knowledge of Avo for schema management and versioning will be an added advantage.
- Familiarity with machine learning algorithms, data science workflows, and analytics tools (e.g., TensorFlow, PyTorch, scikit-learn, Tableau).
- Knowledge of distributed computing concepts and containerization technologies.
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Certifications in cloud computing (e.g., AWS Certified Developer, Google Cloud Professional Data Engineer) or data engineering (e.g., Databricks Certified Associate Developer) are desirable.
Benefits:
- Competitive salary and bonus structure based on performance and achievement of goals.
- Comprehensive benefits package including medical insurance.
Join us in shaping the future of technology by applying your expertise as a Data Engineer. If you are passionate about driving innovation and delivering impactful solutions, we invite you to be part of our dynamic team. Apply now!!

Similar jobs (9)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About Us
We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable.
Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.
We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life.
Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk.
Our Guiding Principles
These principles define how we work at Incubyte. They are non-negotiable.
Relentless Pursuit of Quality with Pragmatism
We build high-quality systems without losing sight of delivery.
Extreme Ownership
We take responsibility end-to-end for decisions, execution, and outcomes.
Proactive Collaboration
We collaborate closely, challenge each other, and solve problems together.
Active Pursuit of Mastery
We continuously improve our craft and raise our bar.
Invite, Give, and Act on Feedback
We seek, give, and act on feedback to get better every day.
Ensuring Client Success
We act as trusted partners and focus on real outcomes, not just output.
Job Description
This is a remote position.
Experience Level
2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.
Role Overview
If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.
What You'll Do
- Design, build, and maintain data pipelines and infrastructure using SQL and Python
- Work within Snowflake to build and optimize data models supporting business use cases
- Parse and process structured and semi-structured data (JSON, XML) from varied sources
- Diagnose issues across raw, intermediate, and summary tables
- Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
- Investigate and resolve data quality issues, including time-sensitive or urgent ones
- Identify opportunities to consolidate models and maintain a single source of truth (SSOT)
Requirements
What We're Looking For
- 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
- 2+ years of experience with Python for data engineering tasks (required)
- Experience with Snowflake or an equivalent cloud data warehouse (required)
- Experience working with Snowflake Coco or any other AI tools(required)
- Experience parsing JSON and XML data (a plus)
- A strong eye for data quality and attention to detail
- Knowledge of Git (required)
- Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
- Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
- Experience with BI tools like Power BI(a plus, not core to this role)
- Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
- Knowledge of SSIS packages (a plus)
- Familiarity with CI/CD methodologies
Benefits
Life at Incubyte
We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered.
Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion.
Perks
- Dedicated learning & development budget.
- Sponsorship for conference talks.
- Comprehensive medical & term insurance.
- Employee-friendly leave policies.
- Home Office fund
- Medical Insurance
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Immediate Joining
We are looking for a Dedicated Resource on Contract for –
Role: Data Engineer
Experience: 5+ Years
Location: Remote
Duration: 3+ Months
Strong hands-on experience with Snowflake, including writing SQL queries, creating views, stored procedures, and functions.
Good knowledge of AI tools such as Claude.
Experience with ETL tools like Alteryx is good to have.
Power BI experience is good to have.
Strong communication skills.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Summary
Role Overview
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.
Experience with Google Cloud Platform (GCP) will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
- Develop complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain reliable data integration workflows across multiple data sources.
- Perform data cleansing, validation, transformation, and quality checks.
- Analyze data and provide insights to support business and technical requirements.
- Implement and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
- Troubleshoot data pipeline failures, performance issues, and production incidents.
- Optimize data processing workflows for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
- Follow best practices for version control, testing, documentation, and deployment.
- Contribute to cloud-based data engineering initiatives, preferably on GCP.
Required Skills
- 5–7 years of hands-on experience in Data Engineering.
- Strong programming skills in Python.
- Strong expertise in Advanced SQL and database concepts.
- Hands-on experience with ETL/ELT processes and data pipelines.
- Good understanding of Data Warehousing and Data Modeling concepts.
- Experience with CI/CD practices and tools.
- Strong understanding of DevOps principles, automation, and deployment processes.
- Strong data analytics and problem-solving skills.
- Experience working with large datasets and performance optimization.
- Good understanding of Git/version control and software development best practices.
Good to Have
- Hands-on experience with Google Cloud Platform (GCP).
- Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
- Experience with containerization/orchestration technologies such as Docker/Kubernetes.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of cloud-based data architecture and distributed data processing.
Preferred Candidate Profile
- Strong analytical and problem-solving abilities.
- Good communication and stakeholder management skills.
- Ability to work independently as well as in a collaborative team environment.
- Strong ownership of data pipelines and production systems.
- Candidates who can join at short notice are preferred.
Mandatory Skills
Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Overview:
We are seeking an experienced Cloud Data Engineer to the architecture, development, Data migration, ETL pipeline in cloud and optimization of a next-generation data platform. This is a development role for an individual with over 4 years of deep data engineering and data migration, data pipeline in AWS expertise, capable of driving technical direction, and delivering high-impact solutions in a fast-paced
4+ Years of hands-on, progressive experience in Cloud Data Engineering, cloud ecosystems AWS, Data Architecture
• Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management
• Ability to translate complex business needs into actionable technical requirements.
• Strong troubleshooting and problem-solving skills in distributed systems.
• Agile/Scrum teamwork capabilities and version control practices
• Insurance industry experience preferred but not mandatory
• Tools:
o Cloud Environment: AWS (S3, IAM, VPC, Glue, Lambda etc.)
o Experience with dbt Core, Iceberg, AWS Glue Catalog, AWS lambda, Redshift, Athena, Splunk, AmazonQ, AWS streaming services, Git
o Strong SQL, Pyspark and Python
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Title : Data Platform Engineer (SDE 2 / SDE 3)
Experience : 3 to 8 Years (SDE2 : 3 to 5 Years | SDE3 : 5.5 to 8 Years)
Location : Remote (Contract) → Pune (Post Conversion)
Employment Type : Contract-to-Hire (3 Months)
Mandatory Skills :
Java / Python / Go, SQL, Data Engineering, ETL / ELT, Apache Airflow, Apache Spark / Flink, Kafka, AWS/GCP/Azure, Distributed Systems, API Development, Docker, Kubernetes, CI/CD, System Design
Role Overview :
We are looking for a Data Platform Engineer with strong backend engineering expertise to build scalable, high-performance data platforms and distributed systems. The ideal candidate should have hands-on experience in developing production-grade backend applications along with designing and maintaining modern data pipelines.
Key Responsibilities :
- Build and maintain scalable ETL/ELT and data processing pipelines.
- Develop backend services and APIs using Java (preferred), Python, or Go.
- Design batch and real-time data pipelines using Spark, Flink, Kafka, and Airflow.
- Optimize SQL queries, data models, and distributed data systems.
- Work with cloud platforms (AWS, GCP, or Azure) and container technologies (Docker, Kubernetes).
- Implement CI/CD, monitoring, logging, and performance optimization.
- Collaborate with product and engineering teams on scalable system design and architecture.
Required Qualifications :
- SDE 2 : 3 to 5 years of Backend + Data Engineering experience.
- SDE 3 : 5.5 to 8 years of Backend + Data Engineering experience.
- Strong coding skills in Java (preferred), Python, or Go.
- Excellent SQL and data modeling knowledge.
- Hands-on experience with Airflow, Apache Spark / Apache Flink, or similar technologies.
- Experience building scalable backend services and APIs.
- Good understanding of distributed systems, system design. and scalable architecture.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Docker and Kubernetes.
- Strong understanding of CI/CD pipelines.
- Excellent problem-solving and debugging skills.
Good to Have :
- Experience with Snowflake, BigQuery, or Redshift.
- Understanding of Kafka, Kinesis, or Pub/Sub
- Performance optimization of large-scale distributed systems
- FinTech or high-scale distributed systems experience.
- Knowledge of data governance, security, and compliance.
Preferred Candidate Profile :
- Strong Backend + Data Engineering experience
- Experience building scalable production systems
- Strong ownership mindset
- Good system design knowledge
- Experience processing millions of events using Kafka/Spark
- Built APIs supporting data infrastructure
- Production engineering experience
Interview Process :
- Take-home Coding Assignment (48 Hours)
- Leadership & Strategy Round (1 Hour)
- Technical Depth – Data Engineering & Performance (1 Hour)
- Culture & Values Fit (30 Minutes)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Title : AWS Data Engineer
Experience : 4+ Years
Location : Bengaluru (HSR – Hybrid, 3 Days WFO)
Notice Period : Immediate Joiner
💡 Role Overview :
We are looking for a skilled AWS Data Engineer to design, build, and scale modern data platforms. The role involves working with AWS-native services, Python, Spark, and DBT to deliver secure, scalable, and high-performance data solutions in an Agile environment.
🔥 Mandatory Skills :
Python, SQL, Spark, AWS (S3, Glue, EMR, Redshift, Athena, Lambda), DBT, ETL/ELT pipeline development, Airflow/Step Functions, Data Lake (Parquet/ORC/Iceberg), Terraform & CI/CD, Data Governance & Security
🚀 Key Responsibilities :
- Design, build, and optimize ETL/ELT pipelines using Python, DBT, and AWS services
- Develop and manage scalable data lakes on S3 using formats like Parquet, ORC, and Iceberg
- Build end-to-end data solutions using Glue, EMR, Lambda, Redshift, and Athena
- Implement data governance, security, and metadata management using Glue Data Catalog, Lake Formation, IAM, and KMS
- Orchestrate workflows using Airflow, Step Functions, or AWS-native tools
- Ensure reliability and automation via CloudWatch, CloudTrail, CodePipeline, and Terraform
- Collaborate with data analysts and data scientists to deliver actionable insights
- Work in an Agile environment to deliver high-quality data solutions
✅ Mandatory Skills :
- Strong Python (including AWS SDKs), SQL, Spark
- Hands-on experience with AWS data stack (S3, Glue, EMR, Redshift, Athena, Lambda)
- Experience with DBT and ETL/ELT pipeline development
- Workflow orchestration using Airflow / Step Functions
- Knowledge of data lake formats (Parquet, ORC, Iceberg)
- Exposure to DevOps practices (Terraform, CI/CD)
- Strong understanding of data governance and security best practices
- Minimum 4–7 years in Data Engineering (3+ years on AWS)
➕ Good to Have :
- Understanding of Data Mesh architecture
- Experience with platforms like Data.World
- Exposure to Hadoop / HDFS ecosystems
🤝 What We’re Looking For :
- Strong problem-solving and analytical skills
- Ability to work in a collaborative, cross-functional environment
- Good communication and stakeholder management skills
- Self-driven and adaptable to fast-paced environments
📝 Interview Process :
- Online Assessment
- Technical Interview
- Fitment Round
- Client Round
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Title : Data / AI / GenAI – Engineering & Analytics
Experience : 4+ Years
Location : Noida / Gurugram / Ahmedabad
Employment Type : Full-time | On-site at client location
Working Days : 5 days per week
Working Hours : Standard business hours
Position Overview : We are seeking professionals to deliver modern data engineering, business intelligence, cloud analytics and AI-powered applications, according to their specialization.
Mandatory Skills :
Python, SQL, ETL/ELT, Data Engineering, Power BI, Azure Data Factory, Databricks, PySpark, Data Modeling, GenAI/LLMs, RAG, Vector Databases, AI Agents (as per role specialization).
Key Roles / Specializations :
- Power BI Developers : Dashboards, DAX, Power Query, reporting and data modeling
- Azure Data Engineers : Azure Data Factory, Data Lake, Azure SQL and cloud pipelines
- Databricks Engineers : Apache Spark, PySpark, Delta Lake and scalable processing
- Data Engineers : ETL/ELT, SQL, Python, data warehousing and quality
- GenAI / RAG Engineers : LLMs, prompts, embeddings, vector databases and retrieval pipelines
- Agentic AI Engineers : AI agents, tool calling, orchestration and multi-agent workflows
Key Responsibilities :
- Design, develop and maintain data pipelines, analytics solutions or AI applications.
- Build and optimize data integration, transformation and processing workflows.
- Develop dashboards and analytical models for business decision-making.
- Use cloud data platforms and modern engineering frameworks.
- Develop and evaluate LLM applications, RAG solutions or AI agents as applicable.
- Ensure data quality, security, performance and reliability.
- Collaborate with engineering teams and stakeholders on testing, deployment and documentation.
Required Skills & Qualifications :
- Bachelor’s degree in Computer Science, IT, Data Science, Engineering or related discipline.
- 4–5 years of relevant experience in data, analytics, AI or software engineering.
- Hands-on expertise in at least one listed specialization; not all technologies are required.
- Relevant Python, SQL, DAX or other technical skills depending on the position.
- Understanding of cloud platforms, APIs, integration and software practices.
Preferred Qualifications :
- Azure, Databricks or Microsoft Fabric experience.
- For GenAI roles : Azure OpenAI, OpenAI APIs, LangChain, LlamaIndex or LangGraph.
- For relevant roles : vector databases, CI/CD, Docker, MLOps or LLMOps.
Note : Candidates are expected to have expertise in their relevant specialization, not in every listed technology or role.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Strong Data Engineer (AWS) Profile
2
Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3
Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4
Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
5
Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6
Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7
Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8
Mandatory (Education) – B.Tech / B.E./ M.Tech











