redshift engineer

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Position title: Business Intelligence and Data Analyst

Summary -

• Operate and continuously improve the CARS/BI backend within the global Enterprise Data and Business Intelligence platform, ensuring system stability, continuous data loading, and Warehouse the timely delivery of business-critical reports.

• Own the underlying data foundation — SQL pipelines, relational data models, and data warehouse structures — that internal reporting teams and global Data Management initiatives depend on, and act as 1st and 2nd level support for internal customers such as SCM and Sales.

• The role is needed to secure daily BI availability in the Asian time zone, reduce the risk of late or incorrect reporting, and add dedicated database and ETL capacity to the global BI team, including support to the Data Centre team on infrastructure-related issues.

Responsibilities:

• Operate, monitor, and maintain the CARS/BI data integration and data processing workflows, ensuring continuous data loading and stable daily business operations.

• Provide 1st and 2nd level support for CARS/BI, including user support, incident handling, and root-cause analysis of data issues.

• Develop, maintain, and optimise SQL-based data pipelines and transformations within the Enterprise Data Warehouse.

• Design and maintain relational data models and data warehouse structures for CARS BI.

• Integrate data from ERP and other enterprise systems into the BI backend.

• Ensure data consistency, integrity, and performance at the database level, including query tuning and database efficiency improvements.

• Administer the BI technical environment and contribute to its continuous enhancement as part of a global team.

• Support reporting teams by providing structured, reliable datasets and safeguarding the timely delivery of business-critical reports.

• Contribute to global Data Management initiatives, with a focus on Master Data Management and the development of a Common Data Model within the Business Integration Platform.

• Collaborate with the Data Centre team to resolve infrastructure-related issues affecting BI availability.

Education and Experience:

Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology, or a comparable technical field.

Minimum 3 years of relevant professional experience in Business Intelligence, data warehousing, or database development, including hands-on SQL and ETL work in an enterprise environment.

Experience supporting business users in a global or multi-time-zone IT organisation is an advantage.

Competencies:

• Knowledge about either BI platforms (e.g. IBM Cognos BI suite) or ETL tools (e.g. Informatica PowerCenter)

• Database, data modeling and SQL (preferred Oracle PLSQL)

• Good analytical and communication skills

• Teamplayer

• English

• Strong hands-on experience with SQL (advanced level)

• Solid understanding of relational databases and data warehouse concepts

• Experience with ETL tools and database technologies (e.g., Oracle, SQL Server, SAP BW,Informatica or similar)

• Performance tuning and query optimization skills

• Structured, detail-oriented, and quality-focused working style

• Good understanding of enterprise data flows (SAP/CARS is a plus)

Key Interfaces and Stakeholders:

Only internal customers with different topics: e.g. SCM, Sales etc.

Geography to cover and Travel requirements:

Asian Time Zone, Sometimes travel is required

Behavioral Characteristics

Reliability and accountability — the role safeguards daily reporting availability, so dependable ownership of monitoring and issue follow-up is expected. Structured, analytical problem solving with the patience for thorough root-cause analysis. Service orientation and clear communication towards internal customers such as SCM and Sales. Initiative taking and self-reliance, given largely independent work in the Asian time zone. Cooperation and team spirit within a globally distributed BI team across cultures and time zones. Flexibility and resilience under time pressure, including occasional off-hours support during critical data loads. Integrity and discretion when handling confidential business data. Quality focus and attention to detail, with a continuous improvement mindset.

Interview process

2 rounds - Virtual interview and 1 round Face to Face

Any other Criteria

• Notice Period: Below 60 or 90 Days . No Negotiation on Notice Period
• Gender: Female and Male; Female preferred
• Qualification:Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology, 

Data Engineer

Experience - 5+ years

6-7 LPA

Remote

Duration: 1 month contract (We can take as a tentative, It can be extended)

Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.

Key Skills:

Strong hands-on experience with GCP & BigQuery

Data warehouse architecture, design and implementation

Data ingestion/integration across multiple source systems

ETL/ELT and data pipeline development

Data modelling for reporting and analytics

Experience integrating BigQuery with Power BI or similar reporting tools

Location: Hyderabad / Chennai

Experience: 5+ years

Employment type: Full-time, permanent

Work Hours: General Shift

website: www.amazech.com

Qualifications: 

• B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Data Science, or related disciplines.
• Strong academic background with relevant industry experience in Data Engineering and Data Warehousing.

Key Responsibilities:

·       Design, develop, and maintain scalable data warehouse solutions using Snowflake.

·       Write, optimize, troubleshoot, and enhance Snowflake SQL queries with a focus on performance and scalability.

·       Develop and support ETL processes using Talend to ensure reliable and efficient data movement.

·       Collaborate with business, analytics, and application teams to enable reporting, dashboards, metrics, and data exploration capabilities.

·       Perform data analysis and resolve issues across data ingestion, transformation, and reporting pipelines.

·       Debug and troubleshoot Python-based data processing scripts and automation workflows.

·       Implement best practices for data quality, testing, deployment, and code reviews.

·       Work across UI, API, and Data Warehouse layers to support end-to-end data integration and business requirements.

·       Monitor, optimize, and maintain data warehouse performance and operational stability.

·       Create and maintain technical documentation, data models, and process workflows.

Required Skills and Experience: 

·       Strong hands-on expertise in Snowflake Data Warehouse.

·       Advanced SQL skills with experience handling large-scale datasets.

·       Strong understanding of Data Warehousing concepts, dimensional modelling, and data architecture.

·       Hands-on experience with Analytical SQL functions, query tuning, and performance optimization.

·       Experience developing and maintaining ETL solutions using Talend.

·       Proficiency in Python for scripting, debugging, automation, and data processing.

·       Experience integrating UI, API, and Data Warehouse workflows.

·       Strong problem-solving and analytical skills.

·       Experience with testing, code reviews, and deployment best practices.

·       Excellent communication and stakeholder management skills.

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
• Develop automation scripts using Python for data processing and workflow optimization.
• Work with Linux environments for deployment, monitoring, and troubleshooting.
• Ensure data quality, integrity, and reliability across data platforms.
• Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Implement best practices for data security, governance, and documentation.

Required Skills

• Strong experience in Data Engineering concepts and ETL/ELT processes.
• Proficiency in SQL, including query optimization and database design.
• Strong programming skills in Python.
• Hands-on experience with Linux commands, shell scripting, and system administration basics.
• Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Familiarity with Git/version control.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
• Experience with data warehousing solutions and big data technologies.
• Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant certifications in cloud or data engineering are an added advantage.

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

• 7+ years of hands-on experience in Data Engineering
• 5+ years of experience in Python
• 4+ years of experience in Snowflake
• 5+ years of experience in SQL
• 5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
• Hands-on experience with AWS / Azure
• Experience with Airflow or equivalent orchestration tools
• Strong experience in ETL/ELT and Data Pipelines
• Experience with APIs, JSON, XML and Webhooks
• Knowledge of CI/CD, Git and automated testing
• Exposure to dbt or similar transformation tools
• Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines
• Build batch, real-time and on-demand data processing workflows
• Integrate data from cloud and on-premise sources
• Ensure data quality, reliability, performance and SLA adherence
• Work closely with Data Scientists, Analysts, DevOps and Business teams
• Implement data engineering best practices, CI/CD and automated testing
• Troubleshoot pipeline issues and perform root cause analysis
• Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

• Opportunity to work with a reputed product-based organization
• Work on modern data engineering and cloud technologies
• Exposure to large-scale data platforms and business-critical data solutions
• Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Job Description

This is a remote position.

Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.

Role Overview

If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.

What You'll Do

• Design, build, and maintain data pipelines and infrastructure using SQL and Python
• Work within Snowflake to build and optimize data models supporting business use cases
• Parse and process structured and semi-structured data (JSON, XML) from varied sources
• Diagnose issues across raw, intermediate, and summary tables
• Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
• Investigate and resolve data quality issues, including time-sensitive or urgent ones
• Identify opportunities to consolidate models and maintain a single source of truth (SSOT)

Requirements

What We're Looking For

• 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
• 2+ years of experience with Python for data engineering tasks (required)
• Experience with Snowflake or an equivalent cloud data warehouse (required)
• Experience working with Snowflake Coco or any other AI tools(required) 
• Experience parsing JSON and XML data (a plus)
• A strong eye for data quality and attention to detail
• Knowledge of Git (required)
• Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
• Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
• Experience with BI tools like Power BI(a plus, not core to this role)
• Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
• Knowledge of SSIS packages (a plus)
• Familiarity with CI/CD methodologies

Benefits

Life at Incubyte  

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance.
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

Role Overview

We are seeking a skilled Senior Data Analyst with substantial hands-on experience in Source System Analysis, data mapping, data modeling, SQL analysis, and integration testing. The ideal candidate will support seamless data flow across business applications, ensure data accuracy, and contribute to system improvements.

Key Responsibilities

• Conduct detailed data mapping between source and target systems, ensuring consistency and accuracy.
• Build and maintain data models to support business processes, reporting needs, and integration workflows.
• Write and optimize SQL queries for data validation, analysis, migration, and troubleshooting.
• Work closely with cross-functional teams to gather data requirements and understand business logic.
• Develop and execute integration test plans, including functional, data validation, and regression testing.
• Support data migration activities, including extraction, transformation, and loading (ETL).
• Monitor and troubleshoot integration issues, ensuring timely resolution.
• Document integration flows, data dictionaries, mapping catalogs, and knowledge artifacts.
• Ensure integration security, data integrity, and compliance with organizational standards.

Required Skills & Qualifications

• 5+ years of experience insource system integrations, data mapping, and system-to-system data workflows.
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.
• Hands-on experience with data mapping, data modelling, and database schema design.
• Proficiency in SQL (complex joins, stored procedures, performance tuning).
• Experience with ETL tools or integration platforms (Informatica, Boomi, MuleSoft, Talend, Pentaho).
• Strong analytical and problem-solving skills.
• Experience with API-based integrations (REST/SOAP) is a plus.
• Familiarity with testing methodologies for integrations and data validation.
• Ability to work with business users, understand workflows, and translate requirements into technical solutions.

Preferred Qualifications

• Experience with cloud ERP or cloud integration (AWS/Azure/GCP).
• Knowledge of JSON, XML, CSV transformation.
• Exposure to scripting languages (Python, Shell).
• Experience in Agile/Scrum environments.
• Prior involvement in ERP implementation or upgrade projects.

Competencies

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
• Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
• Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
• Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
• Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.

Why Join Us?

• Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
• Work on impactful projects that make a difference across industries.
• Opportunities for professional growth and continuous learning.
• Competitive salary and benefits package.

Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!

We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.

Qualifications and Skills:

• Minimum 5 years of experience as a Data Engineer
• Hands-on experience with Azure cloud-based data solutions
• Expertise in database design and management, including SQL databases such as SQL Server
• Proficient in ETL (Extract, Transform, Load) design for data integration and processing
• Strong knowledge of data modeling principles and techniques
• Ability to analyze and translate data into actionable insights, reports, and visualizations
• Proficiency in Power BI for reporting and data visualization

Desirable Skills:

• Experience with Power BI Report Builder / Reporting Services
• Knowledge of statistical analysis or Data Science
• Experience within the UK Insurance industry is a plus
• Python or R coding skills

Responsibilities:

• Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
• Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
• Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
• Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
• Implement different methods of streaming data and create reconciliations for datasets
• Build analytical models to support reporting and analytics
• Collaborate with an agile delivery team to work on the backlog of specified work