Cutshort logo
For Employers
one-to-one, one-to-many, and many-to-many logo
Data Engineer
one-to-one, one-to-many, and many-to-many
Data Engineer

Data Engineer at one-to-one, one-to-many, and many-to-many · Chennai · 5 - 9 years · ₹1L - ₹15L / yr · Posted 6 Mar 2024

The Hub's logo

Data Engineer

at one-to-one, one-to-many, and many-to-many

Agency job
5 - 9 yrs
₹1L - ₹15L / yr
Chennai
Skills
PowerBI
skill iconPython
Spark
skill iconData Analytics
data brick

Position Overview: We are seeking a talented Data Engineer with expertise in Power BI to join our team. The ideal candidate will be responsible for designing and implementing data pipelines, as well as developing insightful visualizations and reports using Power BI. Additionally, the candidate should have strong skills in Python, data analytics, PySpark, and Databricks. This role requires a blend of technical expertise, analytical thinking, and effective communication skills.

Key Responsibilities:

  1. Design, develop, and maintain data pipelines and architectures using PySpark and Databricks.
  2. Implement ETL processes to extract, transform, and load data from various sources into data warehouses or data lakes.
  3. Collaborate with data analysts and business stakeholders to understand data requirements and translate them into actionable insights.
  4. Develop interactive dashboards, reports, and visualizations using Power BI to communicate key metrics and trends.
  5. Optimize and tune data pipelines for performance, scalability, and reliability.
  6. Monitor and troubleshoot data infrastructure to ensure data quality, integrity, and availability.
  7. Implement security measures and best practices to protect sensitive data.
  8. Stay updated with emerging technologies and best practices in data engineering and data visualization.
  9. Document processes, workflows, and configurations to maintain a comprehensive knowledge base.

Requirements:

  1. Bachelor’s degree in Computer Science, Engineering, or related field. (Master’s degree preferred)
  2. Proven experience as a Data Engineer with expertise in Power BI, Python, PySpark, and Databricks.
  3. Strong proficiency in Power BI, including data modeling, DAX calculations, and creating interactive reports and dashboards.
  4. Solid understanding of data analytics concepts and techniques.
  5. Experience working with Big Data technologies such as Hadoop, Spark, or Kafka.
  6. Proficiency in programming languages such as Python and SQL.
  7. Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud.
  8. Excellent analytical and problem-solving skills with attention to detail.
  9. Strong communication and collaboration skills to work effectively with cross-functional teams.
  10. Ability to work independently and manage multiple tasks simultaneously in a fast-paced environment.

Preferred Qualifications:

  • Advanced degree in Computer Science, Engineering, or related field.
  • Certifications in Power BI or related technologies.
  • Experience with data visualization tools other than Power BI (e.g., Tableau, QlikView).
  • Knowledge of machine learning concepts and frameworks.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Wissen Technology
at Wissen Technology
4 recruiters
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
Springer Capital
Andrew Rose
Posted by Andrew Rose
Remote only
0 - 0 yrs
₹5000 - ₹7000 / mo
Data Visualization
skill iconData Analytics
Microsoft BI
SQL
Microsoft Excel
+5 more

The Power BI Intern will assist the analytics team in using Microsoft Power BI to create interactive dashboards and reports. Working with actual datasets to assist well-informed business decision-making, this position provides practical exposure to data analysis, visualization, and business intelligence techniques.

Read more
Quantorus Pvt Ltd
at Quantorus Pvt Ltd
1 candid answer
Priya Rawat
Posted by Priya Rawat
Remote only
5 - 6 yrs
₹8L - ₹10L / yr
DAX
RLS
OLS
Power Brick
Server

About the Role


We are seeking an experienced Power BI Developer to design, develop, and maintain interactive dashboards and reports that drive data-informed decision-making across the business. The ideal candidate will have deep expertise in DAX, Power Query, data modeling, and enterprise data integration, along with strong communication skills to coordinate directly with clients, and the ability to mentor junior team members.


Key Responsibilities


  • Design, develop, and maintain interactive Power BI dashboards and reports
  • Develop complex DAX measures, calculated columns, and KPIs
  • Build and optimize data models using star and snowflake schema design
  • Perform data transformation and cleansing using Power Query (M Language)
  • Connect Power BI with enterprise data sources including SQL Server, Oracle, PostgreSQL, APIs, Excel, and SharePoint
  • Optimize report performance and troubleshoot data/report issues
  • Implement Row-Level Security (RLS) and manage Power BI Service workspaces
  • Partner with business stakeholders and clients to gather and translate reporting requirements
  • Mentor junior developers and contribute to overall BI solution architecture


Required Skills & Experience


  • 3-4 years of hands-on Power BI development experience
  • Strong proficiency in Power BI Desktop, Power BI Service, DAX, Power Query, SQL, and data modeling
  • Experience with relational databases such as SQL Server, Oracle, or PostgreSQL
  • Solid understanding of ETL processes and performance tuning
  • Excellent analytical, communication, and problem-solving skills, with the ability to coordinate directly with clients and stakeholders
  • Basic understanding of Object-Level Security (OLS) in Power BI (not mandatory, but working knowledge is a plus)
  • Experience with Incremental Refresh (Incremental Load) and DAX optimization for large datasets
  • Hands-on experience handling large datasets (4GB+) in Power BI/Power Query, along with performance and query optimization techniques
  • Exposure to big data platforms such as Databricks
  • Strong working knowledge of DAX queries and functions
  • Familiarity with Power BI MCP Server and AI-driven features (e.g., Copilot in Power BI, natural language querying via MCP)


Preferred / Nice-to-Have Skills


  • Experience with Microsoft Fabric
  • Knowledge of Azure Data Factory, Azure Synapse, or Azure SQL
  • Microsoft Power BI Certification


Eligibility Criteria


  • Immediate joiners only — maximum notice period of 15 days
  • Must be available to work the 4:00 PM – 11:40 PM IST shift
  • Comfortable working in a 100% remote setup
  • Excellent communication skills, as the role requires regular coordination with clients


Read more
IT services and consulting organization,
IT services and consulting organization,
Agency job
via Unique Occupational by Mantasha Naaz
Bengaluru (Bangalore)
5 - 8 yrs
₹16L - ₹18L / yr
Microsoft Fabric, Data Engineer, Azure Databricks

Job Description:

We are seeking a skilled Senior Data Engineer with expertise in Databricks to join our dynamic data team. The ideal candidate will design, build, and maintain scalable data pipelines and architectures to support our organization's data-driven initiatives and leverage Databricks to process large-scale datasets, optimize data workflows, enable advanced analytics and machine learning, and integrate Power BI for data visualization and reporting.

Key Responsibilities

·        5-8 years of professional work experience in a relevant field

·        Proficient in Microsoft Fabric platform, Azure Databricks, ADF, Delta Lake, SQL Data Warehouse, Unity Catalog.

·        Good Experience on Microsoft Dynamics 365

·        Experience/ prior knowledge on semi structure data and Structured Streaming, Azure synapse, data lake, data warehouse.

·        Proficient in creating Azure Data Factory pipelines for ETL/ELT processing; copy activity, custom Azure development etc.

·        Good knowledge of SQL and Python for data manipulation, transformation, and analysis

·        Understand business requirements to set functional specifications for reporting applications

  • Data Pipeline Development: Design, develop, and maintain robust, scalable data pipelines using Databricks, Apache Spark, and other cloud-based technologies.
  • Data Integration: Ingest, transform, and integrate data from diverse sources, including APIs, databases, streaming platforms, and third-party systems, into Databricks for analytics and reporting.
  • Power BI Integration: Develop and optimize data models and datasets in Databricks for use in Power BI, ensuring efficient data connections and high-quality visualizations.
  • Performance Optimization: Optimize data workflows, API calls, and queries on Databricks and Power BI for performance, cost-efficiency, and scalability.
  • Data Modeling: Build and maintain data models to support business requirements, ensuring data quality, consistency, and accessibility for analytics and reporting.
  • Cloud Integration: Implement data solutions on cloud platforms (e.g., AWS, Azure, GCP) integrated with Databricks, Power BI, and API ecosystems.
  • Security & Compliance: Implement data governance, security, and compliance best practices within Databricks, Power BI, and API environments.
  • Technical Skills:
  • Proficiency in Databricks, including Delta Lake, Spark SQL.
  • Strong programming skills in Python, Scala, or Java.
  • Experience with Apache Spark for big data processing.
  • Knowledge of SQL for querying and transforming data.
  • Proficiency in Power BI for creating data models, DAX queries, and interactive dashboards.

Preferred Qualifications

  • Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).

Experience with real-time data processing and streaming

Read more
Amazech Systems pvt Ltd
Sandhya Rani
Posted by Sandhya Rani
Bengaluru (Bangalore)
5 - 7 yrs
₹12L - ₹14L / yr
Data engineering
SQL Azure
skill iconPython
Agile/Scrum
databricks
+2 more

Location: Bangalore Experience: 5 to 7 years Employment type: Full-time, permanent Work Hours: General Shift (10.00 AM to 7.00 PM) website: www.amazech.com Qualifications: Minimum B.E./B.Tech, or higher in Computer Science, Information Technology, Data Engineering, or a related field, with a good academic background. Key Responsibilities: • Design, develop, and maintain end-to-end data pipelines. • Build and optimize ETL/ELT processes for large-scale data processing. • Implement Azure-based data solutions ensuring scalability and performance. • Collaborate with stakeholders to understand business data requirements. • Perform performance tuning and optimization across data platforms. • Support production environments, conduct root cause analysis, and resolve data-related issues. • Maintain comprehensive technical documentation and structured knowledge transfer documents. • Work effectively within Agile/Scrum frameworks and contribute to sprint planning and delivery. • Ensure secure and compliant data handling using Azure best practices. Required Skills & Experience • End-to-end ETL/ELT pipeline development, integration, and performance optimization • Azure Synapse, Azure Logic Apps, Azure SQL, and Azure Databricks, with a strong focus on performance tuning • Microsoft Azure services, including Storage Accounts, Key Vault, and Cognitive Services • Advanced proficiency in Python development and modern productivity tools such as GitHub Copilot and Cursor • Strong documentation discipline, including technical design documentation, and structured knowledge transfer documents • Experience operating within Agile/Scrum frameworks, including production support, root cause analysis, and effective stakeholder collaboration

Read more
NAM Info Pvt Ltd
Lata Deepak
Posted by Lata Deepak
Bengaluru (Bangalore)
3 - 6 yrs
₹6L - ₹12L / yr
SQL
PowerBI
DAX

Job Summary

We are seeking a skilled and detail-oriented Power BI Developer to design, develop, and maintain enterprise-level BI solutions. The ideal candidate should have strong expertise in Power BI, DAX, SQL, Data Modeling, and performance optimization tools such as DAX Studio, Tabular Editor, and ALM Toolkit. The candidate will collaborate with business stakeholders to transform data into actionable insights and deliver high-quality dashboards and reports.

Key Responsibilities

  • Design, develop, and maintain interactive Power BI dashboards and reports.
  • Create complex DAX measures, calculated columns, and calculated tables to meet business requirements.
  • Develop and optimize SQL queries, stored procedures, views, and ETL processes.
  • Design and implement scalable Star Schema and Snowflake Data Models.
  • Perform report and model performance tuning using DAX Studio.
  • Utilize Tabular Editor for model management, calculation groups, best practice analysis, and metadata enhancements.
  • Manage model deployment, comparison, and version control using ALM Toolkit.
  • Configure and manage Power BI Workspaces, Apps, Gateways, and Security (RLS/OLS).
  • Work extensively with Power BI Service/Web Experience, including dataset refresh schedules, deployment pipelines, subscriptions, and workspace administration.
  • Collaborate with business users to gather and analyze reporting requirements.
  • Ensure data accuracy, governance, security, and report performance.
  • Troubleshoot data-related issues and implement effective solutions.
  • Create technical documentation and provide knowledge transfer to support teams.

Required Skills

Technical Skills

  • Strong experience in Microsoft Power BI Development.
  • Expertise in DAX (Data Analysis Expressions).
  • Advanced knowledge of SQL Server/T-SQL and query optimization.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Fact & Dimension Tables).
  • Hands-on experience with Tabular Editor.
  • Experience using DAX Studio for model and query performance tuning.
  • Experience with ALM Toolkit for model comparison and deployment.
  • Strong understanding of Power BI Service/Web Experience.
  • Knowledge of Power Query (M Language).
  • Experience with Row-Level Security (RLS) and data governance.
  • Understanding of data warehousing and ETL concepts.


Read more
Cloud Sara Technologies
Jayasri Kolla
Posted by Jayasri Kolla
Remote only
5 - 8 yrs
₹6L - ₹7L / yr
GCP & BigQuery
Google Cloud Platform (GCP)
ETL/ELT and data pipeline development
Data integration
Data warehouse architecture
+1 more

Data Engineer

Experience - 5+ years

6-7 LPA

Remote

Duration: 1 month contract (We can take as a tentative, It can be extended)


Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.

Key Skills:

Strong hands-on experience with GCP & BigQuery

Data warehouse architecture, design and implementation

Data ingestion/integration across multiple source systems

ETL/ELT and data pipeline development

Data modelling for reporting and analytics

Experience integrating BigQuery with Power BI or similar reporting tools

Read more
Improving
Leena Lahari
Posted by Leena Lahari
Remote only
4 - 8 yrs
₹10L - ₹35L / yr
skill iconPython
SQL
databricks
CI/CD
skill iconGit
+5 more

Data Engineer - Remote

Nearshore engineer on a team converting SAS code to Python and SQL on Databricks using generative AI. You will work with the existing accelerators, own deliverables end to end, and communicate directly with client and partner stakeholders.


Required for both:

4+ years of professional data or software engineering experience

Strong Python and SQL

Hands-on Databricks (Unity Catalog, Workflows, Databricks Asset Bundles)

GitLab CI/CD: pipelines, merge request workflows, automated testing

Git branching and code review discipline

Clear written and spoken English with client-facing partners

Demonstrated ownership: scoping, delivering, and flagging risk without prompting


Focus: Pipeline reliability, validation, and delivery of converted code.


Responsibilities:

Build and run the pipelines that process SAS inventories and converted outputs

Validate converted code for parity against SAS outputs (row counts, checksums, schema, data types)

Own deployment through DABs and GitLab CI/CD

Manage Unity Catalog objects, permissions, and environment promotion

Troubleshoot job failures and performance issues


Required:

Spark and Delta Lake performance tuning

Data validation and reconciliation experience

Infrastructure as code or DAB-based deployment experience


Nice to have:

SAS reading ability, healthcare data exposure, Azure.

Read more
Incubyte
at Incubyte
4 recruiters
Sarika Shitole
Posted by Sarika Shitole
Remote only
2 - 6 yrs
Best in industry
Data engineering
skill iconPython
SQL
SQL Azure
Data Warehouse (DWH)

About Us


We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 


Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 


Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 


Job Description


This is a remote position.


Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.


Role Overview


If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.


What You'll Do


  • Design, build, and maintain data pipelines and infrastructure using SQL and Python
  • Work within Snowflake to build and optimize data models supporting business use cases
  • Parse and process structured and semi-structured data (JSON, XML) from varied sources
  • Diagnose issues across raw, intermediate, and summary tables
  • Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
  • Investigate and resolve data quality issues, including time-sensitive or urgent ones
  • Identify opportunities to consolidate models and maintain a single source of truth (SSOT)


Requirements


What We're Looking For


  • 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
  • 2+ years of experience with Python for data engineering tasks (required)
  • Experience with Snowflake or an equivalent cloud data warehouse (required)
  • Experience working with Snowflake Coco or any other AI tools(required) 
  • Experience parsing JSON and XML data (a plus)
  • A strong eye for data quality and attention to detail
  • Knowledge of Git (required)
  • Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
  • Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
  • Experience with BI tools like Power BI(a plus, not core to this role)
  • Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
  • Knowledge of SSIS packages (a plus)
  • Familiarity with CI/CD methodologies



Benefits


Life at Incubyte  


We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 


Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 


Perks


  • Dedicated learning & development budget. 
  • Sponsorship for conference talks. 
  • Comprehensive medical & term insurance.
  • Employee-friendly leave policies. 
  • Home Office fund 
  • Medical Insurance



Read more
Wissen Technology
at Wissen Technology
4 recruiters
Bharanidharan K
Posted by Bharanidharan K
Bengaluru (Bangalore), Mumbai
6 - 12 yrs
Best in industry
databricks
PySpark
skill iconPython
SQL

Company: Wissen Technology

Position: Databricks Engineer

Experience: 6-10 Years

Location: Bengaluru/Mumbai

Employment Type: Full-time


About Wissen Technology

Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.

With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.

At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.

Key Responsibilities

  • Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
  • Develop and optimize data pipelines and workflows on Databricks.
  • Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
  • Ensure data integrity, quality, performance, and reliability across data processing pipelines.
  • Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
  • Perform data analysis and implement appropriate data validation and quality checks.
  • Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
  • Work with relational databases and develop efficient SQL queries for data extraction and transformation.
  • Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
  • Use Git/version control and follow established software development and deployment practices.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
  • Proven experience as a Databricks Developer, Data Engineer, or similar role.
  • Strong hands-on expertise in Apache Spark and PySpark.
  • Strong programming skills in Python; experience with Scala is an advantage.
  • Strong proficiency in SQL and hands-on experience with relational databases.
  • Practical experience developing and optimizing data pipelines and data processing applications.
  • Familiarity with Git and version control systems.
  • Strong understanding of data engineering concepts, data transformation, and data validation.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos