Python Developer

Data Engineer

Experience - 5+ years

6-7 LPA

Remote

Duration: 1 month contract (We can take as a tentative, It can be extended)

Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.

Key Skills:

Strong hands-on experience with GCP & BigQuery

Data warehouse architecture, design and implementation

Data ingestion/integration across multiple source systems

ETL/ELT and data pipeline development

Data modelling for reporting and analytics

Experience integrating BigQuery with Power BI or similar reporting tools

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.

Qualifications and Skills:

• Minimum 5 years of experience as a Data Engineer
• Hands-on experience with Azure cloud-based data solutions
• Expertise in database design and management, including SQL databases such as SQL Server
• Proficient in ETL (Extract, Transform, Load) design for data integration and processing
• Strong knowledge of data modeling principles and techniques
• Ability to analyze and translate data into actionable insights, reports, and visualizations
• Proficiency in Power BI for reporting and data visualization

Desirable Skills:

• Experience with Power BI Report Builder / Reporting Services
• Knowledge of statistical analysis or Data Science
• Experience within the UK Insurance industry is a plus
• Python or R coding skills

Responsibilities:

• Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
• Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
• Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
• Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
• Implement different methods of streaming data and create reconciliations for datasets
• Build analytical models to support reporting and analytics
• Collaborate with an agile delivery team to work on the backlog of specified work

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.

Technical Skills

• Strong hands-on experience in Python and PySpark development.
• Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
• Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
• Experience with Power BI Data Modeling and Semantic Layer development.
• Proficiency in DAX (Data Analysis Expressions).
• Experience designing and managing Semantic Models in Power BI.
• Strong SQL skills and experience working with large datasets.
• Knowledge of data warehousing concepts and best practices.

Preferred Skills

• Experience with cloud platforms such as Azure, AWS, or GCP.
• Exposure to modern data platforms like Databricks.
• Understanding of data governance and data quality frameworks.

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
• Develop automation scripts using Python for data processing and workflow optimization.
• Work with Linux environments for deployment, monitoring, and troubleshooting.
• Ensure data quality, integrity, and reliability across data platforms.
• Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Implement best practices for data security, governance, and documentation.

Required Skills

• Strong experience in Data Engineering concepts and ETL/ELT processes.
• Proficiency in SQL, including query optimization and database design.
• Strong programming skills in Python.
• Hands-on experience with Linux commands, shell scripting, and system administration basics.
• Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Familiarity with Git/version control.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
• Experience with data warehousing solutions and big data technologies.
• Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant certifications in cloud or data engineering are an added advantage.

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Job Description

This is a remote position.

Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.

Role Overview

If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.

What You'll Do

• Design, build, and maintain data pipelines and infrastructure using SQL and Python
• Work within Snowflake to build and optimize data models supporting business use cases
• Parse and process structured and semi-structured data (JSON, XML) from varied sources
• Diagnose issues across raw, intermediate, and summary tables
• Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
• Investigate and resolve data quality issues, including time-sensitive or urgent ones
• Identify opportunities to consolidate models and maintain a single source of truth (SSOT)

Requirements

What We're Looking For

• 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
• 2+ years of experience with Python for data engineering tasks (required)
• Experience with Snowflake or an equivalent cloud data warehouse (required)
• Experience working with Snowflake Coco or any other AI tools(required) 
• Experience parsing JSON and XML data (a plus)
• A strong eye for data quality and attention to detail
• Knowledge of Git (required)
• Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
• Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
• Experience with BI tools like Power BI(a plus, not core to this role)
• Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
• Knowledge of SSIS packages (a plus)
• Familiarity with CI/CD methodologies

Benefits

Life at Incubyte  

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance.
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

Position title: Business Intelligence and Data Analyst

Summary -

• Operate and continuously improve the CARS/BI backend within the global Enterprise Data and Business Intelligence platform, ensuring system stability, continuous data loading, and Warehouse the timely delivery of business-critical reports.

• Own the underlying data foundation — SQL pipelines, relational data models, and data warehouse structures — that internal reporting teams and global Data Management initiatives depend on, and act as 1st and 2nd level support for internal customers such as SCM and Sales.

• The role is needed to secure daily BI availability in the Asian time zone, reduce the risk of late or incorrect reporting, and add dedicated database and ETL capacity to the global BI team, including support to the Data Centre team on infrastructure-related issues.

Responsibilities:

• Operate, monitor, and maintain the CARS/BI data integration and data processing workflows, ensuring continuous data loading and stable daily business operations.

• Provide 1st and 2nd level support for CARS/BI, including user support, incident handling, and root-cause analysis of data issues.

• Develop, maintain, and optimise SQL-based data pipelines and transformations within the Enterprise Data Warehouse.

• Design and maintain relational data models and data warehouse structures for CARS BI.

• Integrate data from ERP and other enterprise systems into the BI backend.

• Ensure data consistency, integrity, and performance at the database level, including query tuning and database efficiency improvements.

• Administer the BI technical environment and contribute to its continuous enhancement as part of a global team.

• Support reporting teams by providing structured, reliable datasets and safeguarding the timely delivery of business-critical reports.

• Contribute to global Data Management initiatives, with a focus on Master Data Management and the development of a Common Data Model within the Business Integration Platform.

• Collaborate with the Data Centre team to resolve infrastructure-related issues affecting BI availability.

Education and Experience:

Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology, or a comparable technical field.

Minimum 3 years of relevant professional experience in Business Intelligence, data warehousing, or database development, including hands-on SQL and ETL work in an enterprise environment.

Experience supporting business users in a global or multi-time-zone IT organisation is an advantage.

Competencies:

• Knowledge about either BI platforms (e.g. IBM Cognos BI suite) or ETL tools (e.g. Informatica PowerCenter)

• Database, data modeling and SQL (preferred Oracle PLSQL)

• Good analytical and communication skills

• Teamplayer

• English

• Strong hands-on experience with SQL (advanced level)

• Solid understanding of relational databases and data warehouse concepts

• Experience with ETL tools and database technologies (e.g., Oracle, SQL Server, SAP BW,Informatica or similar)

• Performance tuning and query optimization skills

• Structured, detail-oriented, and quality-focused working style

• Good understanding of enterprise data flows (SAP/CARS is a plus)

Key Interfaces and Stakeholders:

Only internal customers with different topics: e.g. SCM, Sales etc.

Geography to cover and Travel requirements:

Asian Time Zone, Sometimes travel is required

Behavioral Characteristics

Reliability and accountability — the role safeguards daily reporting availability, so dependable ownership of monitoring and issue follow-up is expected. Structured, analytical problem solving with the patience for thorough root-cause analysis. Service orientation and clear communication towards internal customers such as SCM and Sales. Initiative taking and self-reliance, given largely independent work in the Asian time zone. Cooperation and team spirit within a globally distributed BI team across cultures and time zones. Flexibility and resilience under time pressure, including occasional off-hours support during critical data loads. Integrity and discretion when handling confidential business data. Quality focus and attention to detail, with a continuous improvement mindset.

Interview process

2 rounds - Virtual interview and 1 round Face to Face

Any other Criteria

• Notice Period: Below 60 or 90 Days . No Negotiation on Notice Period
• Gender: Female and Male; Female preferred
• Qualification:Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology, 

Job Title: Senior Data Engineer

Position Summary

We are seeking a highly skilled Data Engineer with strong expertise in reporting infrastructure, data modeling, and analytics platforms. This role will focus on building scalable reporting solutions, optimizing data pipelines, and enabling data-driven decision-making across the organization. The ideal candidate will have deep experience with databases, data warehousing, and complex query development. While Ruby on Rails experience is beneficial, the primary emphasis is on data engineering and reporting systems.

Key Responsibilities

• Design, develop, and maintain reporting infrastructure and data platforms.
• Build and optimize complex SQL queries, data models, and reporting datasets.
• Develop scalable ETL/ELT pipelines and data integration processes.
• Design and maintain database schemas to support analytics and reporting requirements.
• Collaborate with business stakeholders to understand reporting needs and translate them into technical solutions.
• Implement data quality, governance, and performance best practices.
• Support and enhance enterprise reporting solutions and dashboards.
• Work with large-scale datasets in cloud data warehouse environments.
• Troubleshoot reporting issues and optimize database performance.
• Partner with engineering and product teams to establish sustainable data architecture.

Must Have: Technical Skills

• PostgreSQL
• Snowflake
• Advanced SQL
• Data Modeling
• Data Warehousing
• Reporting & Analytics Infrastructure
• ETL/ELT Development
• Query Performance Tuning

Success Profile:

The ideal candidate is a data-focused engineer who enjoys working with complex datasets, designing scalable reporting solutions, and building foundational infrastructure that empowers analytics and business intelligence teams. They should be comfortable navigating databases, optimizing queries, and translating business reporting needs into robust technical implementations.

Experience Range: 5-10 years

Role Type: Individual Contributor / Senior Engineer

Primary Focus: Reporting Infrastructure, Data Engineering, Data Warehousing, and Analytics Enablement.

Location : Mumbai

Big Picture (The Opportunity) :

Are you looking for an opportunity to advance your Career? & If you are able to maintain a positive attitude even when everything goes wrong, if you are detail oriented and self motivated with a passion to learn and improve your skills and knowledge, we have a perfect job for you !

What do we want from you ? (Our Expectations) :

• Zero to 2 years experience in Linux Operating System.
• Flexible working hours - able to support occasional nights, weekends, and call-ins, able to quickly adapt to a constantly changing faced paced environment. Open to travel to sites.
• An ideal person who is excited and motivated about running and supporting a production - grade critical infrastructure and looks for opportunities to improve processes with automation.

What are you required to do ? (Your Responsibilities) :

• Proactively maintain and develop all linux infrastructure technology to maintain a 24*7*365 uptime service.
• Engineering of systems administration-related various solutions for our various SAAS products and projects as well as operational needs.
• Proactively monitoring system performance and capacity planning.
• Providing technical support to customers for Applications, Operating systems, and networking.
• Will also be the first point of contact for our clients, where installations are placed on a permanent basis, for basic troubleshooting and problem solving.
• Fault finding, analysis and logging information for reporting of performance exceptions.
• Maintain best practices on managing systems and services across all environments.

Skills & Qualification Required (Add Value) :

• Graduate - Preferred to have Bachelor‘s Degree in Engineering, Computer Science or related field.
• He / She should be familiar with the installation and configuration of Linux operating systems and setup and operation of TCP/IP networking on Linux systems also familiar with Internet concepts including SMTP, IMAP, POP, HTTP, DNS, LDAP and related protocols.
• You should possess excellent communication skills .
• Knowledge of Email concepts, Helpdesk Concept , VoIP Concept , Cloud computing will be an added advantage.

4 - 10 years of experience in designing and buildingarchitecting highly resilient data platforms 

∙Strong knowledge of data engineering, architecture and data modeling 

∙Experience in platforms like Databricks and Snowflake 

∙Experience on building applications on cloud (AWS or Azure or Google Cloud) 

∙Strong analytical and problem-solving skills 

∙Prior experience in developing data or computation intensive (e.g. grid based) backend applications is an 

advantage 

∙OOP design skills with an understanding or at least personal interest towards the concepts of Functional 

Programming  

∙Willingness to understand and enhance other people’s code, being able to work in an environment where 

developers will oversee and work on wider components also dealing with older “legacy” code 

∙Strong programming skills (Java/ Scala / Python) skills with the willingness to pick up the other language if not 

already mastered at a sufficient level is important 

∙Spring knowledge is an advantage, but in general willingness to learn, work with and even enhance in-house 

developed frameworks is a must 

∙Prior experience in working with Git, Bitbucket, Jenkins, working with PR-s, using JIRA, following the Scrum Agile 

methodology is an advantage 

∙Prior knowledge of financial products is an advantage 

∙Bachelors or Masters in any relevant field of IT/Engineering area is an advantage