Cutshort logo
Data Team logo
Senior Data Engineer
Data Team
Senior Data Engineer
Oceanworld's logo

Senior Data Engineer

at Data Team

Agency job
8 - 12 yrs
₹10L - ₹20L / yr (ESOP available)
Remote only
Skills
Big Data
Data engineering
Hadoop
data engineer
Apache Hive
Apache Kafka
Senior Data Engineer (SDE)

(Hadoop, HDFS, Kafka, Spark, Hive)

Overall Experience - 8 to 12 years

Relevant exp on Big data - 3+ years in above

Salary: Max up-to 20LPA 

Job location - Chennai / Bangalore / 

Notice Period - Immediate joiner / 15-to-20-day Max 

The Responsibilities of The Senior Data Engineer Are:

- Requirements gathering and assessment

- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach

- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic

- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.

- Mentoring juniors in a dynamic team setting

- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values

A Candidate Must Have the Following Skills:

- Strong problem-solving ability

- Excellent software design and implementation ability

- Exposure and commitment to agile methodologies

- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance

- Minimum 8 years of experience

- Should have experience in full life-cycle of one big data application

- Strong understanding of various storage formats (ORC/Parquet/Avro)

- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)

- Experience in at least one cloud environment (GCP/AWS/Azure)

- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)

- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills

Additional skills (Good to have):

- Experience in Containerization (docker/Heroku)

- Exposure to microservices

- Exposure to DevOps practices - Experience in Performance tuning of big data applications
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Convosight
at Convosight
1 recruiter
Agency job
Remote only
4 - 8 yrs
₹15L - ₹25L / yr
Selenium Web driver
skill iconJava
skill iconPostman
Database performance tuning
Anthropic Claude

AI Product QA Engineer

This is not the QA you know. We're not hiring someone to find bugs. We're hiring someone to guard the user's experience — with AI as the foundation.


Read this before you read anything else

Forget everything traditional QA taught you.

I don't want "I tested it, here are the 14 defects." I don't want a gatekeeper at the end of the line ticking checkboxes against a technical feature list. That QA is dead here, and honestly, AI already does it better.

I want business-product QA. Product taste as a discipline. User empathy as a test case. Your foundation is AI — everything runs through Claude Code / Codex — and on top of that foundation you apply QA from a business, user-empathy, onboarding, and go-to-market lens. You're not asking "does the button work?" You're asking "is this the sharpest user journey this product could possibly have?"

We're extreme about four things and nothing else: extreme hard work, extreme respect, extreme shipping, extreme innovation. Not hours . There's no boss — there's a product, a user, and you. You're rewarded on one thing: your hunger.


The 90 / 10

Same philosophy that runs this whole company. 90% of the work, AI does. Claude Code writes the test cases, automates the suites, drives the API calls, spins up the harness — faster than any QA team I've ever run . That 90% is the floor now.

The 10% is you — the human who decides what's actually worth testing and why:

  • the user empathy — feeling the friction a real brand manager feels at 9pm
  • the judgment — is this the sharpest journey, or just a working one?
  • the taste — the design standard, the elegance, the delight
  • the business sense — does this survive a real client's Tuesday, their onboarding, their objection?
  • the critical eye — reading an AI trace and knowing instantly when the product is confidently wrong

AI didn't shrink QA. It concentrated it. The 10% is smaller and heavier than the 100% ever was. That's the 10% I'm hiring.

How you actually work

Everything you do runs through Claude Code. You write the cases in it. You automate the cases in it. You do business testing in it. You interrogate user empathy in it — "how will the user react to this, and is this the sharpest journey of the product?"

But make no mistake: this is technical QA. You write scripts. You hit and test APIs directly. You read the traces, the payloads, the failure modes. You don't wait for a UI to click — you go straight at the system. The difference from old-school QA isn't less technical; it's technical in service of the user and the business, not the feature checklist.


The stack & the surface

We're a web application in Python, Rust, and everything in between — and you'll be QA-ing across four products: ARIA, the Persona product, the video-decoding product, and the rest of the family. Real APIs, real pipelines, real agents watching millions of social videos in Hindi, Tamil, Bahasa, Thai for the world's biggest consumer brands . You need to be comfortable writing a script to probe any of them and reading exactly what came back.


Your first 48 hours

Day one, morning: you get access to a live product and its real client questions in the queue. Not a sandbox. Not a tutorial.

Day one, afternoon: you pick one user journey and, in Claude Code, you build the case, automate it, and pressure-test it against the actual experience a client would have.

Day two: you tell me not "here are the defects" but "here's where the journey breaks the user, and here's the sharper one." And you've already got the automated eval that guards it going forward.

If that scares you, this isn't your room. If it makes you grin — keep reading.


The loop

We are always on. A technique drops on Twitter Tuesday morning; by Thursday it's in a product; by Friday a brand team on the other side of the world is using it — and someone has to make sure that journey is delightful, not just functional. That someone is you. See it. Test it against the user. Sharpen it. Ship it. The loop never stops. If your learning lives in "read later" folders , this will break you.


What you own

The user's experience across every product. Not the defect list — the journey. Find a problem and you don't just log the instance; you build the automated eval in Claude Code that kills the whole class of bad experience forever. Your evals become the product's conscience. Your standard becomes the bar the whole team ships to.

The bar is craft, not years. 23 or 43 — I don't care. I care whether you can feel what a user feels and write the script that proves it.


Who this is actually for

This is a close-to-100% self-starter environment.

You do not want to be here if you want to be handed a test plan. You want to be here if you believe you're the only one who can guard this product's soul — the king or queen of the user journey — with absolute hunger burning in you to do it. Here, will is bigger than skill. And AI isn't a tool you use; it's the foundation you think on.


Fair warning ⚠

The pace is relentless and there's no playbook for AI-product QA — you're partly inventing the discipline as you go. If you want a stable checklist and a comfortable gate at the end of the pipeline, you'll be miserable here, and I'd rather you know now. But if you want to define what QA even means in the age of agents — what you learn here in one year, you won't learn anywhere else in five.


How this goes

Don't send a resume. Send the 10%.

An eval harness you're proud of. A test suite you built in Claude Code that caught something a checklist never would. A teardown of a product's user journey where your taste and your technical chops were unmistakably yours.

Work Location: Remote

Read more
Pune
5 - 9 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconFlask

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.


Required Skills:

  • Python: Advanced proficiency with extensive experience in building data pipelines.
  • AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
  • Spark: Proficient in using Apache Spark for large-scale data processing.
  • Scala: Working knowledge of Scala for Spark programming.
  • Strong understanding of data warehousing concepts and ETL processes.
  • Experience with SQL and relational databases.
  • Familiarity with data governance and security best practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


Read more
improveFX
at improveFX
2 candid answers
Roshan Kumar Jha
Posted by Roshan Kumar Jha
Remote only
1 - 5 yrs
₹2L - ₹3L / yr
Business Development
Digital Marketing
Search Engine Optimization (SEO)
Search Engine Marketing (SEM)
Social Media Marketing (SMM)

We are seeking a dynamic and results-driven Business Development Specialist with experience in the digital marketing industry to help drive growth and expand our client base. The ideal candidate will have a deep understanding of digital marketing services, including SEO, PPC, content marketing, and social media, combined with a proven ability to generate leads, close deals, and build strong client relationships.

Key Responsibilities:

  • Identify and pursue new business opportunities within the digital marketing industry.
  • Develop and execute strategies to expand the company’s market presence and drive revenue growth.
  • Build and maintain long-term relationships with clients and stakeholders.
  • Conduct market research to identify emerging trends, client needs, and potential partnerships.
  • Collaborate with internal teams (SEO, PPC, content, and social media) to ensure seamless integration of marketing solutions for clients.
  • Prepare and deliver compelling sales presentations, proposals, and pitches tailored to client needs.
  • Manage and track the sales pipeline, from lead generation to contract negotiation and closing.
  • Meet or exceed sales and revenue targets by converting prospects into clients.
  • Attend industry events, networking opportunities, and conferences to build brand presence and client relationships.

Qualifications:

  • Proven experience in business development, sales, or account management within the digital marketing industry.
  • Strong understanding of digital marketing services, including SEO, PPC, content marketing, social media, and web development.
  • Excellent communication, negotiation, and presentation skills.
  • Ability to work independently and manage multiple client relationships simultaneously.
  • Strong analytical skills and the ability to understand client needs and translate them into effective marketing solutions.
  • Proficiency with CRM software and digital marketing tools (e.g., HubSpot, Google Analytics, SEMrush) is a plus.
  • Bachelor's degree in marketing, business, or a related field is preferred.

Why Join Us:

  • Opportunity to work in a fast-paced, growing digital marketing agency.
  • Collaborative team environment with opportunities for career growth and professional development.
  • Competitive salary and performance-based incentives.


Read more
A CMML5  IT MNC from USA
Remote, Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)
5 - 14 yrs
₹12L - ₹33L / yr
Performance engineering
Software Testing (QA)
JMeter
Apache JMeter
GATLING
Lead / Manager : QA Performance Testing

Must to have skills :
1. Load testing tools- Jmeter or Gatling
2. Containerization: Docker or kubernetes
3. Created CI/CD pipelines using Jenkins and, integarted them with Jmeter
4. APM tools- Appdynamics/Dynatrace
5. Head dump/thread dump analysis



Primary Responsibilities:
 Define performance test strategies for medium to complexity integrated / n-tier application
architecture defined for medium to complexity business functionality applications
 You play a key role in the planning, design, scripting, execution, and analysis of various
performance tests of software applications. Design workload based on NFRs
 Apply functional knowledge and technical expertise to deliver performance testing projects,
implementation of configuration changes for client applications, and other maintenance of
software applications to meet business process requirements.
 The ability to think beyond just what is on the monitor to the servers and architecture of the entire system.

Load Tools: Performance Center, LoadRunner, StormRunner, JMeter, BlazeMeter, Soasta,
OpenSTA, SoapUI.
 Frontend Testing : Web Page Test, Google Page Speed, Google Lighthouse
 Monitoring Tools : Appdynamics, DynaTrace, New Relic, Nagios/Ops View, Cacti, Wily
Introscope and SiteScope
Read more
A leading top most 3PL logistics solution provider company
A leading top most 3PL logistics solution provider company
Agency job
via Tridat Technologies Pvt. Ltd. by Shraddha Kamble
Mumbai, Navi Mumbai
2 - 10 yrs
₹4L - ₹11L / yr
ASP.NET
MVC Framework
Object Oriented Programming (OOPs)
skill iconC#
SQL
+5 more

Hello,

 

Greetings for the day !!!

 

Tridat Technologies is hiring for "Full Stack Developer" for one of the top most 3PL solution provider company based @ Mumbai, Goregaon !!!

 

Desired Candidate Profile :

- Engineering / MCA / Graduate

- Good communication skill.

- Immediate joining preferable, Max 15 days

 

Job Description:

- Hands-on experience in .Net technology (Mainly C#, WCF, ASP.NET, AngularJS, Node.js, JQuery)

- Strong knowledge of OOP Concept

- Database experience with TSQL (MySQL, SQL Server)

- Experience in developing web applications and web APIs

- Experience in developing mobile projects or Power BI (Good to have)

- Experience with third party web controls

- Experience working with Source Code Management solutions like GIT and Continuous build

integration tools like Jenkins

- Experience in developing client-server, distributed, real-time applications using C#, Web API, Rest API, .NET, .NET Core

- Experience of working in Agile teams, Agile Methodology like Scrum

- Experience in testing software methodologies such as Unit testing, Integration Testing,

performance testing

- Good knowledge and experience in front end technologies like HTML5/CSS3,AJAX, JavaScript

- Self-motivated and deadline focused.

 

Must Require Skills:

C#, OOPS concept, MVC, Sql, Asp.net, Angularjs

 

Experience: 2+ yrs

 

Qualification: Graduate

 

Working days: Monday to Friday

 

Employment Type: Contract to hire role for full time basis & permanent opportunity

 

Location: Goregaon - Mumbai

 

**NOTE: CANDIDATES FROM PAN INDIA LOCATION HAS TO RELOCATE TO MUMBAI ONCE THE SITUATION GETS SETTLED DOWN

Read more
Disruptive Fintech Startup
Disruptive Fintech Startup
Agency job
via Unnati by Sarika Tamhane
Bengaluru (Bangalore)
3 - 7 yrs
₹8L - ₹12L / yr
Operations
Client Management
Investment banking
Financial services
Reconciliation
+2 more
If you are interested in joining a purpose-driven community that is dedicated to creating ambitious and inclusive workplaces, then be a part of a high growth startup with a world-class team, building a revolutionary product!
 
Our client is a vertical fintech play focused on solving industry-specific financing gaps in the food sector through the application of data. The platform provides skin-in-the-game growth capital to much-loved F&B brands. Founded in 2019, they’re VC funded and based out of Singapore and India-Bangalore.
 
Founders are the alumnus of IIT-D, IIM-B and Wharton. They’ve 12+ years of experience as Venture capital and corporate entrepreneurship at DFJ, Vertex, InMobi and VP at Snyder UAE, investment banking at Unitus Capital - leading the financial services practice, and institutional equities at Kotak. They’ve a team of high-quality professionals coming together for this mission to disrupt the convention.
 
As Manager Operations, you will be responsible transaction operations management

What you will do:

  • Processing and reviewing investor capital transaction requests and ensuring that these comply with the relevant legislation, agreements, and policies
  • Ensuring transactions are processed observing the guidelines outlined in the agreements, with attention to proper procedures and deadlines
  • Upholding our KYC & Compliance framework in place working closely with the Risk & Data team to ensure monitoring & portfolio performance.
  • Processing wire payments and account transfer transactions through multiple banking platforms to settle payouts
  • Daily reconciliations of our accounts
  • Updating investor wire details, upon request, to ensure flow to available automated payment systems
  • Reporting and Client Management
  • Ensuring client and investor-related queries are handled
  • Preparing and releasing monthly reporting.
  • Preparing periodic fund activity reports for submission to relevant clients or their regulatory bodies.
  • Coordinating client-specific needs between teams within the department and within the company
  • Participating in project-based work
  • Overseeing client deliverables and escalations, when needed

 


Candidate Profile:

What you need to have:

 
  • Experienced Investment / Lending Operations in the investment/hedge fund industry are favorable. 
  • Experience in completing & closing transactions.
  • Experienced in serving demanding clients within an evolving industry, focused on adherence to global financial regulations and compliance procedures would be considered an asset.
  • Willingness to work the hours necessary to meet client deliverables    

 

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Surya Prabha
Posted by Surya Prabha
Gurugram, Bengaluru (Bangalore), Pune, Mohali
4 - 8 yrs
₹10L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconReact.js
- Bachelor’s Degree or higher in Engineering, Computer Science, or a related degree - Minimum 5+ years of software development experience
- Minimum 3+ years of ReactJS Web Application development experience
- Minimum 3+ years of Node.js server-side rendered development experience
- Experience developing and supporting enterprise-grade applications
- Experience working with Docker or kubernetes
- Strong ability to troubleshoot / debug issues
- Experience integrating REST APIs, ability to quickly pick up new APIs/SDKs
- Capable of working in a fast-paced agile environment
- Strong discipline in documenting engineering processes and best practices
- Disciplined in writing unit tests, test code coverage 
Read more
Wenger and Watson Inc
at Wenger and Watson Inc
24 recruiters
Ashwini Ranganath
Posted by Ashwini Ranganath
Remote, Bengaluru (Bangalore)
5 - 8 yrs
₹25L - ₹50L / yr
skill iconJava
Software Development
Microservices
Distributed Systems
Scalability
+2 more

Responsibilities: 

  • Develop backend systems for our first product
  • Build reliable, secure and performant backend systems
  • Drive test coverage and continuous delivery automation within the team
  • Mentor and provide feedback to teammates

 

Requirements:

  • 5+ years of software development experience
  • Strong computer science fundamentals
  • Deep and wide knowledge of Java ecosystem
  • Can write code that is readable, maintainable, secure and performant
  • Know the importance of tests and how to approach writing different types of tests
  • Good intuition for REST API design
  • Deep understanding of relational databases, transactions, entity-relationship modeling
  • Comfortable writing highly concurrent systems
  • Experienced in using profilers, tuning garbage collection, optimizing SQL queries

 

Bonus:

  • Understanding of domain-driven design concepts like ubiquitous language, bounded contexts, aggregates and domain events
  • Know how to use test driven development as a design tool
  • Good intuition for the principles underlying object-orientation, particularly encapsulation
  • Understand the importance of immutability and of reducing the state-space of objects
  • Know how to refactor large codebases safely
  • Seek to identify key underlying ideas and use those as building blocks before reaching for shiny new tools
Read more
Numantra Technologies
at Numantra Technologies
2 recruiters
nisha mattas
Posted by nisha mattas
Remote, Mumbai, powai
2 - 12 yrs
₹8L - ₹18L / yr
ADF
PySpark
Jupyter Notebook
Big Data
Windows Azure
+3 more
      • Data pre-processing, data transformation, data analysis, and feature engineering
      • Performance optimization of scripts (code) and Productionizing of code (SQL, Pandas, Python or PySpark, etc.)
    • Required skills:
      • Bachelors in - in Computer Science, Data Science, Computer Engineering, IT or equivalent
      • Fluency in Python (Pandas), PySpark, SQL, or similar
      • Azure data factory experience (min 12 months)
      • Able to write efficient code using traditional, OO concepts, modular programming following the SDLC process.
      • Experience in production optimization and end-to-end performance tracing (technical root cause analysis)
      • Ability to work independently with demonstrated experience in project or program management
      • Azure experience ability to translate data scientist code in Python and make it efficient (production) for cloud deployment
 
Read more
Tavisca Solutions Pvt. Ltd.
shruti Samaiya
Posted by shruti Samaiya
Pune
5 - 10 yrs
₹8L - ₹16L / yr
skill iconJava
J2EE
skill iconAmazon Web Services (AWS)
skill iconKubernetes
JUnit
+1 more
Developer
Who are we looking for?
A passionate developer who has a strong working knowledge of OOPS and functional programming principles. Standard Definitions and abbreviations don't entice us that much.
Key skills
· Strong Java and J2EE, programming background.
· Strong working experience in Multi-Threading, Exception Management and Use of Collections.
· Sound knowledge of working with application aspects i.e. Caching, Asynchronous APIs, Logging etc.
· Experience with web application frameworks like Spring Boot.
· Unit Testing is an everyday affair and hence demands very good unit testing skills using tools like Junit & TestNG.
· Understanding of relational databases, RESTful services and build tools like Maven & Gradle
· Knows what and when to mock and have used frameworks like Mockito/Power mock.
· Understanding of message queue such as ActiveMQ, Kafka, RabbitMQ.
· Knowledge of software best practices like Refactoring, Clean Code, Domain Driven Design, Encapsulation etc.
· Fundamental understanding of Design Patterns and Design Principles and decision making ability to use those appropriately.
· Must have an art to translate business requirement or product features into high level and low level design.
· Expert knowledge of Domain Modeling (UML) and ability to communicate it to developers and throughout organization
· Knowledge of SQL solutions and technologies, ‘cloud’ solution
· Exposure and understanding of Micro Services is mandatory.
· Version Control is treated as important as programming skills. Fluent with version control tools like Git and Bitbucket.
· Exposure to Agile/Scrum, TDD not in theory but in practice.
· Experience with Continuous Integration, Continuous Deployment, Static Code Analysis, Jenkins and SonarQube.
· Willingness to take ownership of technical solution and ensure technical expectations of deliverables are met.
· Strong communication skills along with the ability to articulate technical designs and concepts.
· Exposure to cloud and containerization would be a plus.
· Hands-on experience in application development in an enterprise setup.
· Have good Understanding of Distributed Application Architecture.
Developers at Tavisca:
· Believe in writing clean and maintainable code.
· Work with cutting edge technologies like Akka, Docker, Reactive Programming, Functional programming languages and NoSQL databases.
· Are key technical influence in software architecture decisions.
· Are responsible for technical design and entire lifecycle of product development.
· Guide, mentor teams and others.
· Are a part of an open office culture which fosters knowledge sharing sessions.
· Work in a collaborative team environment; engage in discussions and team-wide communication such as daily Standups, tech rally, and pair programming, refactoring, code review.
· Love participating as a speaker, contributing to open source projects, writing blogs or articles.
What you will get?
· Awesome opportunity to work with Micro Services architecture getting shipped on Cloud.
· Experience in working with automated  build deploy powered by Code Analysis, Automated Tests, Functional and Nonfunctional analysis, Blue Green deployment and much more.
· Agile, Lean product development, Collaborative Development, TDD, BDD, SOLID, CI/CD would not be mere words but true experience for you.
· First-hand experience on broader enterprise application concerns like Message Bus, Queues, Caches, Concurrency and Parallelization.
· Be a part of our product development team.
· Lead a team to develop our next generation products from ground up.
· Develop your skills in cloud computing, truly scalable applications and travel domain.
· Be a part of our strategy in US and India market; bring large online travel business to life.
· Stay on leading edge of technology and excellence.
· Be part of an environment of excellent people, products, technology and innovation
· Be part of a flat organization which is open and rich in culture.
· Fall in love with travel, tea and football.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos