Cutshort logo
For Employers
Softobiz Technologies Private limited logo
Sr Data Engineer or Data Architect
Sr Data Engineer or Data Architect

Sr Data Engineer or Data Architect at Softobiz Technologies Private limited · Hyderabad · 8 - 18 years · ₹15L - ₹30L / yr · Profitable · Posted 30 Aug 2023

Softobiz Technologies Private limited's logo

Sr Data Engineer or Data Architect

Adlin Asha's profile picture
Posted by Adlin Asha
8 - 18 yrs
₹15L - ₹30L / yr
Hyderabad
Skills
ETL
Informatica
Data Warehouse (DWH)
Amazon Redshift
skill iconPostgreSQL
Business Intelligence (BI)
skill iconAmazon Web Services (AWS)

Experience: 8+ Years

Work Location: Hyderabad

Mode of work: Work from Office


Senior Data Engineer / Architect

 

Summary of the Role

 

The Senior Data Engineer / Architect will be a key role within the data and technology team, responsible for engineering and building data solutions that enable seamless use of data within the organization. 

 

Core Activities

-         Work closely with the business teams and business analysts to understand and document data usage requirements

-         Develop designs relating to data engineering solutions including data pipelines, ETL, data warehouse, data mart and data lake solutions

-         Develop data designs for reporting and other data use requirements

-         Develop data governance solutions that provide data governance services including data security, data quality, data lineage etc.

-         Lead implementation of data use and data quality solutions

-         Provide operational support for users for the implemented data solutions

-         Support development of solutions that automate reporting and business intelligence requirements

-         Support development of machine learning and AI solution using large scale internal and external datasets

 

Other activities

-         Work on and manage technology projects as and when required

-         Provide user and technical training on data solutions

 

Skills and Experience

-         At least 5-8 years of experience in a senior data engineer / architect role

-         Strong experience with AWS based data solutions including AWS Redshift, analytics and data governance solutions

-         Strong experience with industry standard data governance / data quality solutions  

-         Strong experience with managing a Postgres SQL data environment

-         Background as a software developer working in AWS / Python will be beneficial

-         Experience with BI tools like Power BI and Tableau

Strong written and oral communication skills

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Softobiz Technologies Private limited

Founded :
2007
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Softobiz is a leading Service & Product development company that has been developing custom-made mobile and web solutions for businesses for the last 15 years.

Read more

Tech stack

Dot Net
skill iconReact.js
skill iconReact Native
Microsoft Dynamics
skill iconNodeJS (Node.js)
skill iconJava
Test Automation (QA)
Mobile App Development
skill iconAmazon Web Services (AWS)
Windows Azure
Integration
Selenium
Microsoft Visual Studio
ASP.NET
skill iconPHP

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Softobiz is a software development company that provides custom software development, application maintenance and support, mobile app development, web development, cloud computing services, DevOps consulting, agile development, and quality assurance services. The company was founded in 2007 and is headquartered in Mohali, Punjab, Hyderabad India. Softobiz has a team of over 350 experienced software engineers who are experts in a variety of technologies, including Java, .NET, PHP, and mobile development.

Connect with the team

Parameswar Reddy

Company social profiles

linkedin

Similar jobs (10)

company logo
Roshani Mhatre
Posted by Roshani Mhatre
Mumbai, Navi Mumbai
12 - 14 yrs
₹25L - ₹30L / yr
Data architecture

Example:

We are looking for an experienced Data Architect to design, develop, and manage the organization's enterprise data architecture. The candidate will be responsible for building scalable data platforms, ensuring data quality and governance, and supporting business analytics through modern data solutions.

Experience Required

Mention the minimum years of experience.

Example:

  • Minimum 12 years of experience in Data Architecture, Data Engineering, or related fields.
  • 5+ years of experience in the Banking/Financial Services domain is preferred.

Educational Qualification

Mention the required degree.

Example:

  • BE/BTech in Computer Science, Information Technology, Software Engineering, Electronics & Communication Engineering, or equivalent.
  • OR MCA/MTech/MSc in Computer Science, IT, or related disciplines.
  • MBA is preferred.

Technical Skills

List the skills the candidate must have.

Example:

  • AWS, Azure, or GCP
  • Data Warehousing (DWH)
  • ETL/ELT
  • Database Management
  • Data Modeling
  • Data Analytics
  • Data Lakes
  • Data Governance

Key Responsibilities

Convert the points you received into simple action statements.

Example:

  • Design and maintain enterprise data architecture.
  • Develop data warehouses and data lakes.
  • Define data standards and governance policies.
  • Ensure data quality and security.
  • Design ETL/ELT processes.
  • Integrate data from multiple systems.
  • Plan and execute data migration projects.
  • Review existing data architecture and recommend improvements.
  • Provide technical guidance to project teams.
  • Evaluate new data technologies and tools.

Preferred Skills

These are not mandatory but are an advantage.

Example:

  • Banking domain experience
  • Strong analytical and problem-solving skills
  • Good communication skills
  • Leadership and stakeholder management
  • Experience mentoring technical teams


Read more
It is an Product Based Company(Domain- EV Charging)
It is an Product Based Company(Domain- EV Charging)
Agency job
via by Mantasha Naaz
Bengaluru (Bangalore)
3 - 5 yrs
₹13L - ₹15L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
SQL
ETL
+2 more

Data Engineer

Location: Bengaluru, India (Hybrid)

Employment Type: Full-time

Experience: 3-5 years



Role Overview  

What We’re Looking For:

  • Bachelor’s degree in Computer Science/Engineering or equivalent experience required.
  • Experience designing and shipping cloud services products.
  • Experience driving and managing technical and architectural dependencies on AWS Cloud.
  • A firm understanding of system architecture, cloud computing, PaaS/SaaS design principles, S3, DynamoDB, RDS mandatory.
  • Experience in building or maintaining ETL processes and tools, i.e., AWS Glue or any open-source tool.
  • Proven system-level design contribution to a current “Live” (in production / under daily high load) multi-region SaaS or PaaS offering.
  • Proven experience with S3, DynamoDB, SQL, and AWS RDS services.
  • Proficiency in programming languages such as Python.
  • Strong analytical and problem-solving skills.

Required Skills & Experience

  • Experience with Python, SQL, and data visualization/exploration tools.
  • Familiarity with the AWS ecosystem, specifically S3, DynamoDB, and RDS.
  • Communication skills, especially for explaining technical concepts to nontechnical business leaders.
  • Ability to work on a dynamic, research-oriented team that has concurrent projects.
  • Experience in AWS cost optimization (Savings Plans, Reserved Instances, Spot Instances) and governance frameworks.
  • Experience developing solutions using infrastructure orchestration tools (SSM, automation account, Ansible, etc.).
  • Excellent leadership, stakeholder management, and communication skills.

 

What We Offer

  • Work with some of the brightest minds in the emerging EV industry.
  • Make a tangible impact in reducing carbon emissions and enabling sustainable energy.
  • Freedom to suggest, implement, and innovate on systems, processes, and technologies.
  • Daily ownership in a high-growth, challenging environment.
  • Flexible work environment with hybrid schedules and virtualization options.
  • Competitive pay and benefits including health coverage, innovative PTO program, and performance bonuses.


Read more
NBFC for Digital Lending
NBFC for Digital Lending
Agency job
via by Bisman Gill
Mumbai
3yrs+
Upto ₹45L / yr (Varies
)
SQL
Data Structures
skill iconPython
skill iconAmazon Web Services (AWS)
skill iconPostgreSQL

Must-Have Skills

  • Minimum 3 years of experience in Data Engineering / Analytics Engineering / Fintech Data roles
  • Must have worked on SMS Parsing, intelligent platform, converting RAW customer SMS data into structured actionable financial signals and enabling downstream usage of SMS derived variables
  • Must have established a continuous learning cycle to expand parser coverage
  • Experience in Lending / NBFC / Fintech domain
  • Experience working with Bureau, SMS, Device, or Banking data
  • Strong Python and SQL (production level)
  • Experience handling unstructured data (SMS, logs, JSON, APIs)
  • Experience building data pipelines, schedulers, and cron jobs
  • Strong database design and data modelling skills
  • Ability to work in a startup environment with high ownership
  • Familiarity with modern platforms like AWS, Snowflake, Google BigQuery, Redshift


Good to Have

  • Experience in STPL, especially less than 25K ticket size
  • Experience with streaming (Kafka/Kinesis) and orchestration (Airflow or Step Functions)
  • Experience with feature stores and risk analytics datasets
  • Knowledge of regex, NLP basics for SMS parsing
  • Experience supporting real-time decision engines/underwriting systems


Role Summary

This role will be responsible for owning the end-to-end data-structuring layer across the organisation. The individual will transform large volumes of raw, unstructured, and semi-structured data (such as SMS, device, bureau, and app data) into clean, standardised, and analysis-ready datasets. These structured datasets will directly power risk analytics, fraud detection, marketing insights, collections strategy, and policy decisioning.


Key Objective of the Role

Ensure all raw lending data (SMS, Bureau, Device, AA, App logs) is captured, parsed, structured, and stored in a clean analytics-ready format inside databases (PostgreSQL, DynamoDB, AWS stack) so that the Risk and Data Science team can directly use it for feature creation, policy building, and portfolio monitoring.


Core Responsibilities

  1. End-to-End Data Ownership
  • Design, build, and maintain end-to-end data pipelines (batch + streaming) using AWS native services (Glue, Lambda, Step Functions, Kinesis, S3, Athena, Redshift, EMR/Spark, etc.): ingestion

→ parsing → structuring → storage

  • Work closely with Tech, Product, and Data Science to define what data should be captured
  • Maintain data documentation, data dictionaries, and schema governance
  • Ensure data quality, consistency, and version control
  1. Unstructured Data Processing (Highest Priority)
  • Parse raw SMS dumps and categorise into salary, EMI, loan apps, collections, credits, debits, OTP, etc.
  • Process device fingerprint, behavioural logs, and vendor data (FinBox, AA, Bureau APIs)


  • Convert JSON, logs, and raw API responses into structured feature tables
  • Build regex/keyword-based parsers for financial SMS classification
  1. Feature Implementation (From Risk & Data Science Team)
  • Implement feature creation logic provided by Risk/Data Science team
  • Translate business and policy logic into SQL/Python pipelines
  • Create reusable feature layers for underwriting, fraud, collections, and monitoring
  • Maintain a feature store for consistent model and policy usage
  1. Lending Data Understanding (Domain-Specific Requirement)
  • Work with Bureau data
  • Structure SMS-derived financial variables (income, stress, EMI signals)
  • Work with Account Aggregator and bank transaction datasets
  • Understand fintech alternate data used in underwriting and fraud detection
  1. Data Pipelines & Automation
  • Build and maintain ETL/ELT pipelines using Python & SQL
  • Create cron jobs for automated data ingestion and feature refresh
  • Automate vendor data pulls (Bureau, SMS SDK, AA, device data)
  • Ensure low-latency pipelines for real-time underwriting use cases
  1. Database Structuring & Storage Architecture
  • Structure clean datasets in PostgreSQL (analytics layer)
  • Manage raw data storage in DynamoDB / S3 data lake
  • Design normalized and denormalised tables for risk analytics
  • Optimise database performance for large-scale query workloads
  1. Dashboards & Readable Data Layer
  • Create analytics-ready datasets, implement & write Metabase queries and convert into dashboards (Metabase / Power BI)
  • Enable self-serve data access for Risk, Business, and Founders
  • Support ad-hoc analysis requirements from leadership
  1. Cross-Functional Collaboration (Very Important)
  • The role requires close collaboration with data science, tech, product, and business teams to ensure reliable data pipelines, well-defined schemas, API integrations, logging architecture and high data quality, enabling faster and more accurate decision-making across lending workflows.

Tech Stack (Current Environment)

  • AWS Services
  • PostgreSQL (Primary analytics DB)
  • DynamoDB (Raw/NoSQL storage)
  • Python (Pandas, NumPy, ETL frameworks)
  • Advanced SQL
  • APIs, JSON, and Log Data Handling
Read more
company logo
Agency job
via by Akash Bhatt
Bengaluru (Bangalore), Hyderabad, Chennai, Bhubaneswar, Kolkata, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 12 yrs
₹6L - ₹35L / yr
Amazon Redshift
Snow flake schema
Apache Airflow
Data Transformation Tool (DBT)
ETL
+1 more

We are looking for an AWS Data Engineer to build reliable, scalable data pipelines on AWS.


Responsibilities

  • Build ETL and ELT pipelines with AWS Glue and dbt
  • Model and optimise data warehouses in Redshift and Snowflake
  • Orchestrate workflows with Apache Airflow
  • Build streaming ingestion with Amazon Kinesis
  • Ensure data quality, monitoring and cost efficiency


Requirements

  • 2+ years of data engineering on AWS
  • Hands-on with Glue, Redshift or Snowflake, and Airflow
  • Strong data modelling and warehousing skills
Read more
company logo
Katarina Vasic
Posted by Katarina Vasic
Remote only
5 - 10 yrs
₹11L - ₹15L / yr
Windows Azure
ETL
PowerBI
skill iconPython

We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.


Qualifications and Skills:

  • Minimum 5 years of experience as a Data Engineer
  • Hands-on experience with Azure cloud-based data solutions
  • Fabric experience is a must – designing, implementing, and managing data workflows and pipelines
  • Expertise in database design and management, including SQL databases such as SQL Server
  • Proficient in ETL (Extract, Transform, Load) design for data integration and processing
  • Strong knowledge of data modeling principles and techniques
  • Experience with Azure Data Factory (ADF) for orchestrating data workflows
  • Ability to analyze and translate data into actionable insights, reports, and visualizations
  • Proficiency in Power BI for reporting and data visualization

Desirable Skills:

  • Experience with Power BI Report Builder / Reporting Services
  • Knowledge of statistical analysis or Data Science
  • Experience within the UK Insurance industry is a plus
  • Python or R coding skills


Responsibilities:

  • Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
  • Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
  • Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
  • Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
  • Implement different methods of streaming data and create reconciliations for datasets
  • Build analytical models to support reporting and analytics
  • Collaborate with an agile delivery team to work on the backlog of specified work
Read more
company logo
SaiSruthi Nuthanpati
Posted by SaiSruthi Nuthanpati
Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
company logo
Kanakavalli Kosuri
Posted by Kanakavalli Kosuri
Remote only
10 - 16 yrs
Best in industry
Snow flake schema
Data Transformation Tool (DBT)
fivetran
skill iconRuby on Rails (ROR)
skill iconReact.js
+6 more

At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.


For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.


As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!


Job Overview 

Principal Data Engineer

About Engineering at Mitratech Legal Solutions 

Mitratech's engineering organization is a collaborative and dynamic environment where engineers are empowered to drive technical direction and innovation. Our engineers are passionate about delivering high-quality products and solutions that meet the evolving needs of our customers, and we're committed to fostering a culture of continuous learning and growth. 


About the Role 

Mitratech is a fast-paced and dynamic environment, and this role requires someone who is adaptable, resilient, and able to thrive in a rapidly changing landscape. If you’re a seasoned engineer with a passion for technical leadership, innovation, and collaboration — including building the data foundations that power trusted reporting and agentic AI-driven products — we’d love to hear from you. 


What You Will Do

•  Drive technical direction for a significant product domain or platform capability, ensuring alignment with business objectives and customer needs 

•  Design and maintain data pipelines and reporting models that power trusted business metrics and increasingly feed agentic AI systems (e.g., RAG ingestion, embeddings, vector stores, AI agent workflows) 

•  Use AI-assisted and agentic engineering tools (e.g., Claude Code, Copilot, Cursor, AI agents) as part of your own workflow, and help other engineers adopt agentic development practices effectively 

•  Reduce systemic complexity by identifying and leading architectural debt remediation, and developing strategies for ongoing technical debt management 

•  Partner with Product and Engineering leadership to inform multi-quarter roadmap feasibility, and provide technical guidance and oversight to ensure successful implementation 

•  Elevate engineering craft across multiple teams through RFCs, mentorship, and knowledge sharing, and develop training programs to improve engineering skills and knowledge 

•  Represent Mitratech’s technical capabilities externally, including speaking at conferences, contributing to open-source projects, and engaging with industry peers and thought leaders 


What We Are Looking For 

To be successful in this role, you will need: 

•  10+ years of experience in software engineering, with a focus on technical leadership and architecture 

•  Deep understanding of data engineering principles, including data modeling, data warehousing, reporting, and data governance 

•  Strong technical expertise in SQL, PostgreSQL, ETL/ELT pipelines, BI tools, and analytics platforms 

•  Practical experience with AI/LLM-adjacent and agentic AI data work — e.g., RAG ingestion pipelines, embedding generation, vector store management, or building/operating AI agent workflows over data — using AI coding assistants (Claude Code, Copilot, Cursor, or similar) as a regular part of the engineering workflow 

•  Working knowledge of modern cloud platforms such as AWS 

•  Experience with BI, reporting, dashboards, and customer-facing analytics 

•  Experience leading cross-functional initiatives with product, engineering, analytics, and business teams 


Nice to Have 

•  Working knowledge of Ruby on Rails and React 

•  Experience with a semantic or metrics layer (e.g., dbt Semantic Layer, headless BI) 

•  Understanding of CI/CD, Git-based workflows, and infrastructure-as-code 

 

The Stack Context 

•  Modern data stack: Fivetran, Airbyte, dbt, Snowflake, GitHub, Terraform, or similar tools 

•  Application context (nice to have): Ruby on Rails, React, or similar backend/frontend frameworks 

•  Data modeling: SQL, analytics models, documentation, testing, naming standards, and version control 

•  Infrastructure: cloud-based data infrastructure, infrastructure-as-code, CI/CD, monitoring, and cloud storage 

•  Data workflows: ingestion, transformation, orchestration, reporting, deployment, and change management 

•  Reporting focus: trusted metrics, scalable reporting models, dashboards, exports, and data quality 

•  AI surface: data pipelines and quality practices supporting AI/LLM and agentic AI use cases (RAG, embeddings, vector stores, AI agents) alongside traditional BI 


Why This Role 

This role offers a unique opportunity to drive technical direction and innovation at a rapidly growing company, while also mentoring and coaching engineers to improve their craft. As a Principal Data Engineer at Mitratech, you will have the chance to work on complex and challenging problems spanning trusted reporting and agentic AI systems, collaborate with cross-functional teams, and represent the company's technical capabilities externally. If you're looking for a role that offers a mix of technical leadership, data and reporting depth, agentic AI innovation, and collaboration, this could be the perfect fit for you. 

 

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.

 

Read more
company logo
Bengaluru (Bangalore)
14 - 25 yrs
₹50L - ₹70L / yr
Data engineering
databricks
Apache Spark
PySpark
skill iconPython
+19 more

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds


Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.


Must-Have Skills :

  • 14 to 20 years of Data Engineering experience
  • Databricks & Apache Spark / PySpark
  • Python & SQL
  • AWS Cloud
  • Lakehouse Architecture
  • ETL / ELT & Distributed Data Processing
  • Batch & Streaming Pipelines
  • Data Pipeline Optimization & Data Modeling
  • CDC & Incremental Processing
  • Git, CI/CD & Testing
  • Data Quality, Monitoring & Observability
  • Technical Leadership & Stakeholder Management


Key Responsibilities :

  • Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
  • Own data products from design through production.
  • Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
  • Optimize pipelines for performance, scalability, reliability, and cost.
  • Design scalable data architectures and data models.
  • Implement data quality, monitoring, lineage, and CI/CD practices.
  • Lead technical discussions and mentor engineering teams.
  • Collaborate with business stakeholders, architects, product owners, and engineering teams.
  • Remain hands-on while providing technical leadership.


Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Read more
company logo
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
company logo
Sarika Shitole
Posted by Sarika Shitole
Remote only
2 - 6 yrs
Best in industry
Data engineering
skill iconPython
SQL
SQL Azure
Data Warehouse (DWH)

About Us


We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 


Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 


Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 


Job Description


This is a remote position.


Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.


Role Overview


If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.


What You'll Do


  • Design, build, and maintain data pipelines and infrastructure using SQL and Python
  • Work within Snowflake to build and optimize data models supporting business use cases
  • Parse and process structured and semi-structured data (JSON, XML) from varied sources
  • Diagnose issues across raw, intermediate, and summary tables
  • Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
  • Investigate and resolve data quality issues, including time-sensitive or urgent ones
  • Identify opportunities to consolidate models and maintain a single source of truth (SSOT)


Requirements


What We're Looking For


  • 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
  • 2+ years of experience with Python for data engineering tasks (required)
  • Experience with Snowflake or an equivalent cloud data warehouse (required)
  • Experience working with Snowflake Coco or any other AI tools(required) 
  • Experience parsing JSON and XML data (a plus)
  • A strong eye for data quality and attention to detail
  • Knowledge of Git (required)
  • Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
  • Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
  • Experience with BI tools like Power BI(a plus, not core to this role)
  • Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
  • Knowledge of SSIS packages (a plus)
  • Familiarity with CI/CD methodologies



Benefits


Life at Incubyte  


We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 


Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 


Perks


  • Dedicated learning & development budget. 
  • Sponsorship for conference talks. 
  • Comprehensive medical & term insurance.
  • Employee-friendly leave policies. 
  • Home Office fund 
  • Medical Insurance



Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos