Cutshort logo
For Employers
AI-powered cloud-based SaaS solution logo
Data Engineer
AI-powered cloud-based SaaS solution
Data Engineer

Data Engineer at AI-powered cloud-based SaaS solution · Bengaluru (Bangalore) · 2 - 10 years · ₹15L - ₹50L / yr · Posted 24 Mar 2022

wrackle's logo

Data Engineer

at AI-powered cloud-based SaaS solution

Agency job
2 - 10 yrs
₹15L - ₹50L / yr
Bengaluru (Bangalore)
Skills
Data engineering
Big Data
Data Engineer
Big Data Engineer
Hibernate (Java)
Data Structures
Agile/Scrum
SaaS
Cassandra
Spark
skill iconPython
NOSQL Databases
Hadoop
HDFS
MapReduce
AWS CloudFormation
EMR
Amazon S3
Apache Kafka
Apache ZooKeeper
Systems Development Life Cycle (SDLC)
skill iconJava
YARN
Responsibilities

● Able contribute to the gathering of functional requirements, developing technical
specifications, and project & test planning
● Demonstrating technical expertise, and solving challenging programming and design
problems
● Roughly 80% hands-on coding
● Generate technical documentation and PowerPoint presentations to communicate
architectural and design options, and educate development teams and business users
● Resolve defects/bugs during QA testing, pre-production, production, and post-release
patches
● Work cross-functionally with various bidgely teams including: product management,
QA/QE, various product lines, and/or business units to drive forward results

Requirements
● BS/MS in computer science or equivalent work experience
● 2-4 years’ experience designing and developing applications in Data Engineering
● Hands-on experience with Big data Eco Systems.
● Hadoop,Hdfs,Map Reduce,YARN,AWS Cloud, EMR, S3, Spark, Cassandra, Kafka,
Zookeeper
● Expertise with any of the following Object-Oriented Languages (OOD): Java/J2EE,Scala,
Python
● Strong leadership experience: Leading meetings, presenting if required
● Excellent communication skills: Demonstrated ability to explain complex technical
issues to both technical and non-technical audiences
● Expertise in the Software design/architecture process
● Expertise with unit testing & Test-Driven Development (TDD)
● Experience on Cloud or AWS is preferable
● Have a good understanding and ability to develop software, prototypes, or proofs of
concepts (POC's) for various Data Engineering requirements.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Planview
at Planview
3 candid answers
3 recruiters
Srikanth Bajgur
Posted by Srikanth Bajgur
Bengaluru (Bangalore)
6 - 12 yrs
Best in industry
skill iconJava
Spark
skill iconSpring Boot
RESTful APIs
skill iconReact.js

Join our product development team at Planview as a Senior Software Engineer I and become a pivotal force on the Viz Core Team. This role offers the unique opportunity to shape and lead the development of data-processing pipelines and APIs that are at the heart of our software solutions. These solutions are designed to streamline and enhance the efficiency of software delivery, resonating deeply with software engineers who strive to build better and faster.



At Planview Viz, which is powered by the innovative “Flow Framework,” you will tackle complex data challenges and develop scalable solutions within an AWS cloud environment. Your efforts will be crucial in revolutionizing how businesses harness and interpret vast amounts of workflow data, transforming it into actionable insights that propel organizational efficiency and effectiveness.



Responsibilities (What you'll do)


  • Create and refine powerful data-processing architectures that integrate seamlessly with a diverse array of external tools, enhancing the way software is delivered across industries.
  • Drive operational excellence by critically analyzing problems, defining requirements, and devising robust solutions that push the boundaries of technology.
  • Lead and inspire a team of talented engineers, promoting a culture of ownership, meticulous attention to quality, and proactive problem-solving.
  • Stay at the cutting edge of technology by updating and expanding your team’s knowledge of cloud architectures, data processing, and advanced analytics, ensuring that you and your team remain leaders in technological innovation.
  • Make a direct impact on the efficiency and effectiveness of software delivery worldwide through innovation and leadership.


Qualifications (What you'll bring)


Who We’re Looking For

The ideal candidate is a seasoned professional in cloud software development with a strong foundation in data processing and scalable software systems. You thrive in collaborative environments and are passionate about advancing cloud technology and data architecture to new heights. You are a leader who enjoys mentoring, guiding, and inspiring others.


Preferred Qualifications


Skills, Knowledge, and Expertise


  • A degree in Computer Science, Engineering, or a related field.
  • 6+ years of experience with a modern programming language, with a focus on back-end systems and cloud-based technologies.
  • Strong capability in architecting and designing robust, scalable software systems.
  • Proficiency in AWS or another popular cloud platform.


Additional Qualifications


  • Experience with big-data technologies such as Spark and Apache Kafka.
  • Experience with Java (version 17), Scala, or other JVM programming languages.
  • Experience with tools such as Amazon Redshift and MongoDB.
  • Experience with continuous integration and continuous deployment tools such as GitHub, Jenkins, Travis CI, or similar platforms.
  • Proficiency in test-driven development.
  • Experience with containers and orchestration tools such as Kubernetes.
  • Experience working on remote or distributed teams and projects.

 

Read more
MNC
Actively reviewing applications
MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by Akilandeswari Panneerselvam
Bengaluru (Bangalore)
4 - 12 yrs
₹6L - ₹20L / yr
skill iconJava
SCA
skill iconPython
Data engineering
databricks
+2 more


We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.


Experience: 4–10 Years


Must-Have Skills:


Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).


We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.


Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.

Read more
VY SYSTEMS PRIVATE LIMITED
Actively reviewing applications
Dharshini A
Posted by Dharshini A
Bengaluru (Bangalore)
6 - 12 yrs
₹5L - ₹20L / yr
Amazon EMR
skill iconPython
skill iconScala

We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.

Job Description

Role: Data Engineer

Location: Bangalore

Experience: 6+ Years

Key Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
  • Develop data engineering solutions using Python and Scala.
  • Process and transform large volumes of structured and unstructured data.
  • Build and optimize distributed data processing workflows for performance and scalability.
  • Work with big data technologies and cloud-based data processing environments.
  • Perform data integration, validation, transformation, and quality checks.
  • Troubleshoot data pipeline issues and optimize processing performance.
  • Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.

Required Skills:

  • Strong hands-on experience with Amazon EMR.
  • Proficiency in Python and Scala.
  • Experience in big data processing and data pipeline development.
  • Good understanding of distributed computing and data transformation techniques.
  • Experience in performance tuning and troubleshooting data processing jobs.
  • Strong analytical, problem-solving, and communication skills.


Read more
MNC
Actively reviewing applications
MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by Akilandeswari Panneerselvam
Bengaluru (Bangalore)
4 - 10 yrs
₹5L - ₹25L / yr
skill iconJava
skill iconSpring Boot
Microservices
skill iconScala
SQL

Hiring: Data Engineer – Java / Scala

Experience: 4–10 Years

Location: Bangalore

Mandatory Skills: Java, Scala, Spring Boot, Microservices, REST API, SQL, Git, Testing.

Job Description:

Looking for an experienced Data Engineer with strong Java/Scala development skills and experience in building scalable backend applications and data platforms.

Candidates should have hands-on experience with Spring Boot, Microservices, REST APIs, SQL, Git and Testing. Knowledge of data engineering, data architecture, Databricks, Snowflake and cloud platforms (AWS/Azure/GCP) is preferred.


Read more
VY SYSTEMS PRIVATE LIMITED
Actively reviewing applications
Pavithra E
Posted by Pavithra E
Bengaluru (Bangalore)
6 - 13 yrs
₹5L - ₹30L / yr
Amazon EMR
skill iconPython
skill iconScala

🚨 HIRING | Data Engineer – Amazon EMR 🔥


We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.


📌 JOB DETAILS:


💼 Experience: 6+ Years

💰 CTC: Up to 30 LPA

📍 Location: Bangalore


🔑 MANDATORY SKILLS:


• Amazon EMR

• Python

• Scala

• Data Engineering


📋 KEY REQUIREMENTS:


• 6+ years of relevant experience in Data Engineering.

• Strong hands-on experience with Amazon EMR.

• Strong programming skills in Python and Scala.

• Experience with large-scale data processing and data engineering solutions.

• Strong problem-solving and communication skills.


📩 Interested candidates can share their updated resumes:

📧 pavithra.e @vysystems. com

📞 8 9 2 5 8 0 2 4 5 7


🔄 Know someone who would be a good fit? Tag them or share this post!


#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow

Read more
A leading data & analytics intelligence technology solutions
Actively reviewing applications
A leading data & analytics intelligence technology solutions
Agency job
via HyrHub by Neha Koshy
Bengaluru (Bangalore), Mangalore
10 - 15 yrs
₹25L - ₹35L / yr
Data engineering
Artificial Intelligence (AI)
Generative AI
skill iconPython
Systems design

Key Skills:

Python & System Design: Strong expertise in Python and system design, with proven experience architecting scalable, production-grade systems.

LLM & Agentic AI: Proven experience building LLM-based and agentic systems from the ground up and evaluating them based on reproducibility, calibration, and cost.

Cloud & Data Architecture: Deep understanding of data and cloud architecture across AWS and Azure, including multi-store data design, distributed systems, streaming, security, and cost optimization.

Azure Databricks: Hands-on production experience with Azure Databricks architecture, including Unity Catalog, Delta Lake, cluster policy design, job orchestration, and Terraform provisioning.

Supply Chain & Inventory Management: Strong domain knowledge of supply chain and inventory operations, including demand planning, MRP logic, inventory parameters, and translating business planning decisions into data requirements.

System Architecture & Technical Decision-Making: Ability to make sound architectural decisions based on first principles, evaluate technical trade-offs, and avoid unnecessary complexity and abstraction.

LLM & Agentic AI: Proven experience building LLM-based and agentic systems from the ground up and evaluating them based on reproducibility, calibration, and cost.

Technical Leadership: Ability to influence teams without direct authority, establish technical standards, prepare technical specifications and documentation, and mentor team members.

Experience in pharmaceutical or regulated industries is highly valued.

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Gurugram
7 - 12 yrs
₹12L - ₹18L / yr
skill iconAmazon Web Services (AWS)
Amazon S3
Amazon EMR
athena
Amazon Redshift
+17 more

Job Title : Tech Lead – Data Lake Platform

Number of Positions : 2

Experience : 7+ Years

Role Type : Technical Lead / Data Platform Lead

Domain : Data Engineering / Data Platform / AWS


About the Role :

We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.

The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.

As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.


Core Tech Stack :

AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka


Key Responsibilities :

  • Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
  • Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
  • Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
  • Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
  • Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
  • Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
  • Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
  • Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
  • Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
  • Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
  • Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
  • Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.


Must-Have Skills :

  • 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
  • Strong hands-on experience with AWS Data Services, including:
  • Amazon S3
  • AWS EMR
  • AWS Glue
  • Amazon Athena
  • Amazon Redshift
  • AWS DMS
  • AWS Lambda
  • Amazon RDS
  • AWS IAM
  • Strong production experience with Apache Airflow.
  • Strong hands-on experience with Apache Spark / PySpark.
  • Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
  • Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
  • Strong understanding of data lake architecture and enterprise data platforms.
  • Proven experience leading engineers and driving technical decisions.
  • Hands-on experience with production support, troubleshooting, incident management, and RCA.
  • Strong understanding of data platform performance, scalability, reliability, and SLA management.


Good-to-Have Skills :

  • Experience with DBT and modern data transformation practices.
  • Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
  • Strong knowledge of Amazon Redshift workload optimization, including :
  • Distribution keys
  • Sort keys
  • Spectrum
  • External tables
  • Experience with Kafka or other streaming/data ingestion technologies.
  • Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
  • Experience with Lambda and API Gateway for API-based data serving.
  • Experience with enterprise data governance, data quality, security, and compliance.
  • Experience in BFSI / Banking / Financial Services / Insurance domain.


Ideal Candidate :

The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Divya Sharma
Posted by Divya Sharma
Pune
5 - 10 yrs
₹17L - ₹28L / yr
skill iconJava
Apache Kafka
Apache Spark
Backend Development
SQL
+1 more

SDE3 – Data Platform Engineer


Experience: 5–10 Years

Employment Type: Contract-to-Hire (3 Months)

Location: Remote initially | Pune after conversion

About the Role

We are looking for an experienced SDE3 – Data Platform Engineer with strong backend development and data engineering expertise.

The ideal candidate should have excellent programming skills in Java (preferred), Golang, or Python, along with hands-on experience building scalable data platforms, distributed systems, and data pipelines.

Key Responsibilities

  • Design and develop scalable backend and data platform solutions.
  • Build and optimize ETL/ELT pipelines and data ingestion systems.
  • Develop APIs and backend services for data infrastructure.
  • Work with Kafka, Spark, Airflow, BigQuery, and Redshift.
  • Handle large-scale data processing and distributed systems.
  • Optimize application performance, scalability, and reliability.
  • Collaborate with engineering teams to deliver production-grade solutions.

Required Skills

  • Strong programming in Java, Golang, or Python (Java preferred).
  • Backend development and API development.
  • Data pipelines, ETL/ELT, and data ingestion.
  • Strong SQL and data modeling.
  • Kafka, Spark, Airflow, BigQuery, or Redshift.
  • Distributed systems and system design.
  • Docker, Kubernetes, and CI/CD fundamentals.

Ideal Candidate

  • Strong Backend + Data Engineering background.
  • Experience building scalable data platforms.
  • Excellent coding and problem-solving skills.
  • Experience handling high-volume data processing.

Note: Pure Data Engineers, BI/Analytics professionals, and candidates with only SQL reporting or basic ETL experience are not suitable.


Work Arrangement

  • Initial 3-month contractual period – Remote.
  • Conversion based on performance.
  • Post-conversion – 5 days WFO from Pune.


Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
Data engineering
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos