Cutshort logo
For Employers
Data Team logo
Senior Data Engineer
Data Team
Senior Data Engineer
Oceanworld's logo

Senior Data Engineer

at Data Team

Agency job
8 - 12 yrs
₹10L - ₹20L / yr (ESOP available)
Remote only
Skills
Big Data
Data engineering
Hadoop
data engineer
Apache Hive
Apache Kafka
Senior Data Engineer (SDE)

(Hadoop, HDFS, Kafka, Spark, Hive)

Overall Experience - 8 to 12 years

Relevant exp on Big data - 3+ years in above

Salary: Max up-to 20LPA 

Job location - Chennai / Bangalore / 

Notice Period - Immediate joiner / 15-to-20-day Max 

The Responsibilities of The Senior Data Engineer Are:

- Requirements gathering and assessment

- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach

- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic

- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.

- Mentoring juniors in a dynamic team setting

- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values

A Candidate Must Have the Following Skills:

- Strong problem-solving ability

- Excellent software design and implementation ability

- Exposure and commitment to agile methodologies

- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance

- Minimum 8 years of experience

- Should have experience in full life-cycle of one big data application

- Strong understanding of various storage formats (ORC/Parquet/Avro)

- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)

- Experience in at least one cloud environment (GCP/AWS/Azure)

- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)

- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills

Additional skills (Good to have):

- Experience in Containerization (docker/Heroku)

- Exposure to microservices

- Exposure to DevOps practices - Experience in Performance tuning of big data applications
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

TestMu AI (Formely LambdaTest)
Himanshi Tomer
Posted by Himanshi Tomer
Noida
1 - 5 yrs
₹6L - ₹25L / yr
DevOps
skill iconKubernetes
skill iconDocker
skill iconAmazon Web Services (AWS)
Windows Azure
+9 more

DevOps Engineer (Cloud & Infrastructure)

📍 Noida | 🕐 Full-Time | 🧭 Experience: 2–4 years

About TestMu AI

TestMu AI (formerly LambdaTest) is an AI-native platform designed to move software testing beyond simple automation into the era of agentic intelligence. It provides end-to-end AI agents that manage the entire Quality Engineering lifecycle.

  • Full-Stack AI Agents: Autonomously plan, author, execute, and analyze tests across the SDLC.
  • Comprehensive Coverage: Supports web, mobile, and enterprise applications.
  • Real-World Testing: Scale execution across real devices, browsers, and custom environments.

About the Role

This isn't a role for someone who just wants to "maintain" systems. As a DevOps Engineer at TestMu AI, you are the architect of the automated highways that power our AI agents. You will step into a fast-paced environment where you bridge the gap between cloud-native automation and core infrastructure.

You will manage complex CI/CD pipelines, troubleshoot deep-seated Linux issues, and ensure our hybrid-cloud environment (AWS/Azure) is as resilient as the code it runs.

Key Responsibilities: The Pillars of Growth

A. DevOps & Automation (50% Focus)

  • Platform Orchestration: Lead the migration to modular, self-healing Terraform and Helm templates.
  • Agentic CI/CD: Architect GitHub Actions workflows that treat AI agents as first-class citizens, automating environment promotion and risk scoring.
  • Kubernetes Mastery: Advanced management of Docker and K8s clusters to support scalable production workloads.
  • Predictive Observability: Use Prometheus, Grafana, and ELK to move from reactive alerts to autonomous anomaly detection.

B. Networking & Data Center Mastery (30% Focus)

  • Hybrid Networking: Design and troubleshoot VPCs and subnets in Azure/AWS/GCP, paired with physical VLANs and switches in our data centers.
  • Bare-Metal Lifecycle: Automate hardware provisioning, RAID setup, and firmware updates for our real-device cloud.
  • Remote Admin: Master out-of-band management (iDRAC, iLO, IPMI) to ensure 100% remote operational capability.
  • Core Protocols: Own the lifecycle of DNS, DHCP, Load Balancing, and IPAM across distributed environments.

C. Development & Scripting (20% Focus)

  • Backend Integration: Debug and optimize Python or Go code; understanding how logic interacts with system-level resources.
  • Advanced Scripting: Write idempotent Bash/Python scripts to automate complex, multi-server operational tasks.
  • Agentic Tooling: Support the integration of LLM-based developer tools into DevOps workflows to eliminate "toil".

The Interview Journey

We value your ability to solve problems under pressure more than your ability to memorize documentation.

  1. Technical Round 1 (DevOps Leads): A live session focused on real-world debugging scenarios and Linux fundamentals.
  2. Technical Round 2 (Hiring Manager / Pod Lead): An assessment of your architectural thinking, automation strategy, and team alignment.
  3. Technical Round 3 (SVP Engineering / VP DevOps): Strategic discussion on scalability, infrastructure vision, and technical leadership.
  4. Final Round (CEO): Mission alignment, cultural fit, and the "big picture" at TestMu AI.

Growth Timeline

This is a high-visibility role. You will receive direct mentorship from our senior engineering leadership. As you master our production environment, you will have a clear path to move into Senior DevOps Engineer or Infrastructure Architect roles as our pods scale.

Perks That Matter

Health Cover: Comprehensive insurance for you and your family.

Fresh Meals: Daily catered meals at the office.

Transport: Safe cab facilities for eligible shifts.

Pod Budgets: Dedicated engagement budgets for team building and offsites.


Read more
The Blue Owls Solutions
at The Blue Owls Solutions
2 candid answers
Apoorvo Chakraborty
Posted by Apoorvo Chakraborty
Remote, Pune
4 - 8 yrs
₹20L - ₹25L / yr
Microsoft Fabric
Fabric
Data engineering
skill iconData Analytics
databricks
+1 more

Role Summary

We’re seeking a seasoned Azure Data Engineer / Consultant to lead design, build, and operationalize cloud-native data solutions. You’ll partner with external clients—from discovery through Go-Live—to ingest, model, transform, and serve high-volume data using Synapse, Fabric, PySpark, and SQL. You’ll also establish best practices around CI/CD, security, and data quality within a medallion architecture.



Required Skills (at least 4+ years of relevant experience - this is a senior-level role)

  • Ability to talk to the customer
  • Manage the delivery of an End-To-End Enterprise project
  • Fabric (or Synapse/ADF/Databricks) Data Engineering background
  • Data Warehousing experience
  • Basic understanding of Agentic AI


Preferred Skills & Certifications:

  • DP-600, DP-700 or equivalent certification.
  • Experience with Azure Purview, Data Catalogs, or metadata management tools.
  • Familiarity with orchestration frameworks (ADF, Synapse Pipelines), Spark optimization (broadcast joins, partition pruning), and data-quality frameworks (Great Expectations, custom).
  • Prior consulting or client-facing engagements in enterprise environments.
  • Knowledge of BI tools (Power BI).


What We Offer:

  • Opportunity to own and shape cutting-edge data solutions for diverse industries.
  • Collaborative, outcome-driven culture with career growth and skill-building opportunities.
  • Competitive compensation and benefits package.
Read more
Cyber Toddler
Remote only
0 - 2 yrs
₹10000 - ₹15000 / mo
Cyber Security
Information security

About the Role


Cyber Toddler is offering a Cybersecurity Research Internship designed for students and aspiring cybersecurity professionals interested in digital threats, cyber awareness, and security research.


This internship provides structured exposure to cybersecurity concepts, industry trends, and practical research activities.


Key Responsibilities


  • Research cybersecurity topics and digital threats
  • Assist with cyber awareness initiatives
  • Support cybersecurity content and learning resources
  • Monitor emerging cyber trends and incidents
  • Contribute to internal knowledge and research activities


Requirements


  • Interest in cybersecurity and digital safety
  • Basic understanding of cybersecurity concepts
  • Research and analytical thinking skills
  • Willingness to learn and grow
  • Good communication skills
Read more
Variyas Labs Pvt. Ltd.
Gurugram, Noida
5 - 8 yrs
₹4L - ₹10L / yr
Palo Alto
Firewall
Firewall administration

PCCSE (Prisma certified cloud security engineer) with 5 years of experience.

On site engineers with ability to work in 24-7 support environments.

Read more
coMakeIT
at coMakeIT
4 recruiters
Aparna Reddy
Posted by Aparna Reddy
Hyderabad
4 - 7 yrs
₹6L - ₹12L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconjQuery
AJAX
CoMakeIT: coMakeIT Software Pvt Limited, is a Product Software Development company with operations in Hyderabad, India which is almost 10 Years old company in Hyderabad. coMakeIT S/w Pvt Ltd. is a Dutch Offshore Software Development Company with its headquarters based out of Harderwijk in The Netherlands. We provide R & D for our Customers and our clientele is throughout the European market, we also focus globally with respect to ERP. coMakeIT makes growth easy for product software companies. We do this out of our unique concept of dedicated, carefully selected teams, supported by our expertise in software development and management. The teams operate from our facility in Hyderabad, India. Visit our website at :- www.comakeit.com
Read more
Mumbai
0 - 4 yrs
₹10L - ₹20L / yr
Quantitative analyst
Analytical Skills
Probability
Statistical Analysis
Time series
+1 more

Dolat Capital is a multi-strategy trading firm, dedicated to producing superior returns by adhering to mathematical and statistical techniques. We trade actively in all Asset classes: equities, futures, options, commodities, currencies and fixed income taking advantage of our ultra-low latency infrastructure. Our low latency infrastructure is in C++, one of the most competitive in terms of latency.

 

The Quantitative Research team at Dolat Capital focuses on quantitative trading, specifically fully automated trading systems. We develop proprietary algorithms by using mathematical techniques and statistical analysis to identify patterns and behavior of markets.

 

The incumbent will be responsible to design, develop and implement computational algorithms/strategies that succeed in generating sizable profits consistently, in real life market for a high-frequency trading environment

Read more
Mobile Programming India Pvt Ltd
at Mobile Programming India Pvt Ltd
1 video
17 recruiters
Pawan Tiwari
Posted by Pawan Tiwari
Remote, Bengaluru (Bangalore), Gurugram, Chennai, Pune, Mohali, Dehradun
4 - 8 yrs
₹6L - ₹11L / yr
Oracle NoSQL Database
Oracle Database
Data engineering
Big Data
Oracle
+1 more

Looking Data Enginner for our Own organization-

Notice Period- 15-30 days
CTC- upto 15 lpa

 

Preferred Technical Expertise 

  1. Expertise in Python programming.
  2. Proficient in Pandas/Numpy Libraries. 
  3. Experience with Django framework and API Development.
  4. Proficient in writing complex queries using SQL
  5. Hands on experience with Apache Airflow.
  6. Experience with source code versioning tools such as GIT, Bitbucket etc.

 Good to have Skills:

  1. Create and maintain Optimal Data Pipeline Architecture
  2. Experienced in handling large structured data.
  3. Demonstrated ability in solutions covering data ingestion, data cleansing, ETL, Data mart creation and exposing data for consumers.
  4. Experience with any cloud platform (GCP is a plus)
  5. Experience with JQuery, HTML, Javascript, CSS is a plus.
If Intersted , Kindly share Your CV
Read more
Unifytech
at Unifytech
20 recruiters
Sunil Bolisetty
Posted by Sunil Bolisetty
Mumbai, Bengaluru (Bangalore)
4 - 10 yrs
₹8L - ₹30L / yr
skill iconJava
Multithreading
RESTful APIs
Angular
skill iconHTML/CSS
+4 more

Role 1 : Core Java

Experience  - 5 – 10 years

Location – Mumbai ( NKP) / Weworks

Primary Skills / Must have:

  • Knows Java Programming Language (Java 7, 8) with Object-Oriented Design and Spring Framework. Understanding of RESTFul Services development.
  • Has a good understanding of asynchronous requests, multithreading and related issues and ways to resolve them.
  • Has a good understanding of web and web programming principles, cookies, sessions etc.
  • Familiar with tomcat, servlet model and their limitations.
  • Has a good understanding of basic algorithms and data structures.
  • Good analytical skills, problem-solving skills and willingness to learn.
  • Good communication and collaboration skills. Willing to ask questions.
  • Team player.

 Secondary Skills / Desired skills

  • Modern web development tools including JavaScript frameworks such as Angular JS and CSS frameworks such as Bootstrap.
  • Familiarity with Git and Linux/Unix commands.

 

Role 2 – JAVA + Linux + SQL Server combination of skills - Bangalore

Experience  – 4 – 9 years

Location – Bangalore  ( RMZ Ecoworld)

Required Technical Skills:

  • Strong Java experience.
  • Experienced in Agile development lifecycle.
  • Hands-on experience with Programming language: Python, and SQL
  • Experience in database platforms : DB2/Sybase/MSSQL server.
  • Working knowledge of Linux/Unix.
  • Working knowledge of Java spring framework,Angular 7/8,GIT.

Desired Technical Skills:

  • Working experience on Actimize RCM solution.
  • Knowledge of testing automation tools like selenium.
  • Good knowledge of Actimize AIS solution
  • CI/CD

 

Required Aptitudes

  • Ability to take on challenges and open to learning new technologies.
  • Ability to work on multiple projects at the same time.
  • Passion for innovation and find creative solutions to complex business problems.
  • Team player.

Educational qualification and experience:

  • Bachelor degree in engineering/computer science or MCA from recognized institution
  • Minimum 3 years of development experience in required technical skills.

 

Role 3 – Java+ Spring + Azure  ( Mandatory)

Location – Bangalore

Experience – 4 – 7 years

 

Role 4 – Java Fullstack

Experience  - 5 – 9 years

 

Location – Mumbai ( NKP)

 

No of open role – 4

 

Mandatory Skills – Core Java , Full stack and Unix

 

Responsibilities Include:

Ø  Work closely with Business Analysts to understand User and Functional Requirements

Ø  Conduct Technical Design, create Design Prototype and Design Specifications. Be able to understand business needs and translate into technology solutions

Ø  Implement the requirements using the latest firm wide technologies and approved global solutions

Ø  Perform Unit Testing and, wherever applicable, collaborate with QA Engineer on System / Integration / QA / Regression / Performance / Capacity Testing, and create testing documentation

Ø  Coordinate with users on User Acceptance Testing and provide testing support

 

Required technical skills:

Ø  Minimum 3-4 years of hands-on experience in software development

Ø  Good programming skills using Java

Ø  Excellent relational database skills on Sybase / DB2 & Unix Shell Scripting

Ø  Good knowledge and solid experience in Agile software development

Ø  Good knowledge, skills and abilities to perform high quality software testing

Ø  Experience on Axiom / XML / SOAP / Informatica is preferred but not essential

 

Required professional skills:

Ø  Enthusiasm for and interest in learning and applying new technologies to solve real world business problems

Ø  Pursuit for perfect delivery quality in a zero-error-tolerance environment

Ø  Strong analytical and problem solving skills

Ø  Good communication skills including ability to explain technical issues to non-technical people

Ø  Highly organized, self-motivated, result-oriented, and proactive with capability to work with minimal supervision

Ø  A strong can-do attitude

Ø  Creative and flexible while observing policies, rules and standards

Demonstrate highly proficient written and verbal communication skills in the English language

 

Role 5 – Core Java / Java backend hands on developer

Location – Mumbai and Banglare

Experience  - 5  – 10 years /

 

Read more
Param Business Solutions
at Param Business Solutions
2 recruiters
Sumeet Bandewar
Posted by Sumeet Bandewar
Pune
1 - 2 yrs
₹2L - ₹4L / yr
skill iconJavascript
skill iconJava
Data Structures
Algorithms
skill iconC++
+4 more
Looking for smart candidates with good communications skills and tech skills
Read more
Financial Hospital
at Financial Hospital
2 recruiters
Manish Hingar
Posted by Manish Hingar
Mumbai
1 - 3 yrs
₹1L - ₹3L / yr
Game Testing (QA)
Test Automation (QA)
Develops and documents test plans and test cases for newly developed features Develops test tools and automation for in user testing and directs a test team during test execution, and reports results to development engineers and leaders
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos