Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Codemonk
at Codemonk
4 candid answers
2 recruiters
TA Codemonk
Posted by TA Codemonk
Bengaluru (Bangalore)
6 - 8 yrs
₹10L - ₹15L / yr
Business Analysis
Presales
FRD
BRD

About Codemonk

Codemonk is a product engineering and AI-focused technology company helping enterprises and startups build scalable digital solutions. We work at the intersection of design, engineering, cloud, and AI to solve complex business problems.

As Codemonk scales, we are strengthening our pre-sales and requirement discovery function to ensure clarity, feasibility, and delivery success from day one.

Role Overview

We are looking for a Senior Business Analyst to play a key role in Codemonk’s pre-sales and early solutioning efforts. This role will work closely with Sales, Engineering, and Design teams to convert opportunities into well-defined problem statements, requirements, and solution approaches.

This is a hands-on senior individual contributor role with clear growth potential into a BA Lead position as the team and organization scale.

Key Responsibilities

A) Pre-Sales & Requirement Discovery

  • Partner with the Sales team on qualified opportunities to:
  • Conduct requirement discovery discussions
  • Understand client goals, constraints, and success metrics
  • Translate loosely defined problems into:
  • Business and functional requirements
  • Scope boundaries, assumptions, and risks
  • Collaborate with Engineering and Design teams to:
  • Define solution approaches
  • Validate feasibility and complexity
  • Support effort estimation and proposal preparation
  • Contribute to:
  • Client presentations
  • Solution decks
  • PoCs / demos where required

B) Solution Clarity & Documentation

  • Create clear and structured artifacts such as:
  • Requirement documents
  • User stories / use cases
  • High-level solution summaries
  • Help prevent scope creep by setting clear expectations early
  • Support smooth handover from pre-sales to delivery teams

C) Team Collaboration & Mentorship

  • Guide and support:
  • Business Analysts
  • Associate Business Analysts / interns
  • Review junior team members’ work and provide feedback
  • Gradually take ownership of BA quality across opportunities

D) Continuous Improvement

  • Contribute to improving BA processes, templates, and best practices
  • Bring a consulting mindset to problem-solving and client interactions
  • Grow into greater ownership of the BA function over time

Required Skills & Experience

  • 6+ years of experience in Business Analysis, Solution Consulting, or Pre-Sales
  • Experience working in IT services, product engineering, or digital solutions
  • Strong requirement elicitation and documentation skills
  • Good understanding of:
  • SDLC / Agile methodologies
  • Web, mobile, and cloud-based solutions (conceptual understanding)
  • Comfortable interacting with clients, sales teams, and engineers
  • Strong communication and problem-structuring skills.

Nice to Have

  • Exposure to AI/ML, data platforms, or enterprise systems
  • Prior experience mentoring junior BAs
  • Experience supporting RFPs or client pitches.

Growth Path

  • Increased ownership of pre-sales opportunities
  • Formal leadership of junior BAs
  • Potential transition into BA Lead / Pre-Sales Lead role as the organisation scales.


Read more
We are hiring for a new-age business school based in Gurgaon
We are hiring for a new-age business school based in Gurgaon
Agency job
via PinnacleU HR by Tanuj Kataria
Gurugram
1 - 7 yrs
₹3L - ₹7L / yr
Sales
Inside Sales
Client Servicing
Communication Skills
Negotiation
+1 more

Job description

We are looking for an Academic Counsellor to join our administrative staff. The successful candidate will divide his or her time equally between administrative tasks and providing students with guidance and support. They should be able to take responsibility for nurturing,

acquiring, growing, and strengthening higher education customers across the world. Most importantly to believe in their consultative approach, identifying the needs of the customers and being able to marry off with the product offering/s.


Job Responsibility:

● Build a relationship with the learners who contact Masters’ Union, and be their guiding hand and familiarise them with the product, our vision, and the big picture.

● Understand learners' career needs and guide them with relevant information.

● Handle inbound calls and make outbound calls for follow-ups. Handle learner interactions and queries. Fix appointments and demo sessions on a daily basis.

● Provide timely and accurate responses to learners/parents.

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Bengaluru (Bangalore), Pune
5 - 10 yrs
₹35L - ₹45L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

Very strong core Java/Spring developer

• Decent experience in implementing observability (monitoring/alerts) for Java apps

• Working experience in using CI/CD pipelines.

• Capable of working with scripting languages.

• Knowledge of Tibco BW is optional and we can upskill him in case he has other desired skills.

Read more
Rawdata Technologies Pvt Ltd
Megha Panicker
Posted by Megha Panicker
Kochi (Cochin)
3 - 5 yrs
₹3.5L - ₹5.5L / yr
skill iconAngular (2+)
skill iconAngularJS (1.x)

Responsibilities

  • Writing clean, high-quality, high-performance, maintainable code
  • Develop and support software including applications, database integration, interfaces, and new functionality enhancements
  • Responsible for the product development and maintenance
  • Analyze and resolve performance bottlenecks

Requirements

  • 3+ Years of experience in Web Application Development
  • Should excel in working with large-scale applications and frameworks
  • Expert in Programming using Angular 8/10/11, Web API
  • Should have knowledge in Relational and Non-Relational databases (NO SQL).
  • Strong knowledge of SDLC methodologies – Agile/Scrum
  • Very good development skills in front end technologies/javascript.
  • Good understanding of Object-Oriented Programming, Design Concepts & Unit Testing
  • Good understanding of Web Security Concepts

 

Read more
Renewable energy company
Renewable energy company
Agency job
via Reed & Willow Talent Advisory Group by Tanush Dholepatil
Manila
8 - 10 yrs
₹12L - ₹13L / yr
Finance
Accounting
Month-end tasks
• Prepare Balance Sheet Reconciliations
• Reconcile intercompany activity
• Perform Trial Balance Variance analysis
• Perform Accounts Payable Journal Review- (GL Account, Cost Center,
VAT & Withholding)
• Provide support of local Audits
• Prepare monthly FP&A reports
• Manage Local compliance including VAT, Withholding, Quarterly
Income Tax Return, Audited Financial Statements
• Ad-hoc tasks as necessary
• Aid in project development
Read more
Leading Gaming Company
Leading Gaming Company
Agency job
via Unnati by Seemi Ejaz
NCR (Delhi | Gurgaon | Noida)
2 - 4 yrs
₹3L - ₹5L / yr
Customer Support
Customer Service
Customer Retention
Customer Success
Customer Relationship Management (CRM)
+4 more
Our client is a 5 year old online gaming company with market leading games in three segments - Poker, Rummy and Cricket. Their online games are ensured to be safe, trusted and secure for their customers. They have a registered base of over a million users and are working towards the growth of online gaming in the country.

 

 
The founders are MIT alumni who bring with them immense tech and business knowledge to provide global level gaming services.
 
As  Sr Executive - Customer Support, you will be responsible to deliver extraordinary customer services by responding to customer concerns regarding customer accounts.

What you will do:
  • Processing customer request in a timely and comprehensive manner to ensure customer satisfaction with Inbound and Outbound calls/emails/chat
  • Highlighting issues through feedback and recommending changes in workflows, procedures and service levels to meet customer needs and ensuring quality service always
  • Growing and nurturing customer relationships on every interaction that results in measurable Customer value
  • Documenting necessary account information and offering custom solutions that benefit the customer
  • Delivering extraordinary results measured by customer satisfaction, effectiveness, efficiency and quality
  • Balancing customer interests with the interests of company
  • Resolving all customer queries and following established problem ticket recording procedures as appropriate
  • Gathering relevant information from customers as required and updating it accurately to facilitate the decision process

 


Candidate Profile:

What you need to have:

  • Any graduate with demonstrable experience of 2-4 years
 Professional attributes :
  • Needs proactiveness and anticipation to understand customers problems
  • Adaptability to customer's need and requirement
  • Should be a problem solver
Personal attributes:
  • Should be a go-getter, with high drive and ownership
  • Should have good communication and listening skills    
  • Should have sound English language skills (written and verbal) with good typing speed    
Read more
Remote only
2 - 5 yrs
₹8L - ₹10L / yr
skill iconAndroid Development
skill iconFlutter
skill iconJava
skill iconKotlin
Model-View-View-Model (MVVM)
+2 more
Duties & Responsibilities:
• Support the entire application lifecycle (concept, design, test, release and support)
• Produce fully functional mobile applications writing clean code.
• Gather specific requirements and suggest solutions.
• Write unit and UI tests to identify malfunctions.
• Troubleshoot and debug to optimize performance.
• Design interfaces to improve user experience.
• Liaise with Product development team to plan new features.
• Ensure new and legacy applications meet quality standards.
• Research and suggest new mobile products, applications and protocols.
• Stay up to date with new technology trends.

Required:
- Work experience as Android developer with 3 to 4 years of experience on developing iOS applications.
- Mandate skills (Flutter Or Kotlin), and Native Android
- Must have direct interaction with client exp and has to work on atleast 4 to 5 projects
- Demonstrable portfolio of released applications on the Android Markets.
- Experience with third-party libraries and APIs
- Familiarity with OOP design principles
- Educational degree is not a criterion.
- Good verbal and written English communication skills.
- Preferred location – Pune. Candidates from other cities are welcome who are willing to relocate later.
Read more
Pratham Sim LLp
Gayatri Lashkar
Posted by Gayatri Lashkar
Thane
0 - 2 yrs
₹2L - ₹4L / yr
Recruitment management
Recruitment
Recruitment/Talent Acquisition
Interpersonal Skills
Team Management
+2 more

IT Recruiter job description 

  • Communicate with clients to get a clear view of their hiring needs and organizational goals
  • Research into clients' company
  • Research into competitors and the marketplace
  • Define job description and document specifications
  • Identify prospective candidates using a variety of channels
  • Create a candidate persona for each open position
  • Conduct confidential interviews
  • Follow-up references and check credits
  • Present shortlisted candidates
  • Present detailed candidate profile summaries
  • Build long-term client relationships
  • Research and develop recruiting leads
  • Develop a sustainable candidate-lead strategy
  • Advise clients on best-recruiting practices.
Read more
Nexopay
at Nexopay
2 recruiters
Meenal Sharma
Posted by Meenal Sharma
Bengaluru (Bangalore)
4 - 7 yrs
₹6L - ₹15L / yr
Agile/Scrum
Software Testing (QA)
Test Automation (QA)
Appium
Selenium

Responsibilities:

  • Lead QA engineers into developing performance & functional test plans and test scenarios using requirements and product documentation while specifying testing overview, approach, strategy, scope, architecture, environment, roles and responsibilities
  • Scope projects and estimate testing needs
  • Design and implement testing methods for both end to end, and individual service layers of the application stack
  • Identify bottlenecks in functionality and performance, and provide actionable information and suggestions based on analysis of testing results
  • Communicate technical information clearly with both technical and non-technical teams
  • Work closely with development engineers and management in a fast-paced technical environment

Requirements:

  • 4-7 years experience in Quality Assurance of IT products
  • Hands on experience in Test Automation using Selenium
  • Experience Leading Testing Teams in both Manual and Automation Testing.
  • Strong work ethic and accountability on Quality Assurance
  • Experience in building SCRUM/Agile skills within the Testing Team
  • Exercise independent thought and judgement and adapt to new tasks
  • Experience in Performance Testing is mandatory.
  • Experience in Security Testing is a plus, but not mandatory
Read more
Starcom Information Technology Limited
Suganthi Rajkumar
Posted by Suganthi Rajkumar
Bengaluru (Bangalore)
1 - 3 yrs
₹2.4L - ₹3L / yr
Sales
Field Sales
Telesales
Presales
Lead Generation
+2 more
Dear Candidate,
We have an opening for the following position.
Position: Executive - Sales & Marketing
Qualification: BE in ECE/EIE/EEE with an MBA(Desirable)
Skills/Requirement:
Job Description:
 Responsible for Marketing and Sales of Embedded and Analog tools based on Texas Instruments Semiconductors to Educational Market
 Achieve assigned revenue target by conducting end-to-end Sales & Marketing activities from Assigned Region
 Responsible for Lead Generation through
o Cold Calling
o Email Campaign
o Direct Customer Visit
 Responsible for organizing technical seminars/workshops to boost sales pipeline in coordination with the Technical Support Team.
 Responsible to provide Pre-Sales guidance to customers
 Responsible to conduct Product introductory sessions during Exhibits, seminars other promotional Events
 Responsible to prepare competitive business proposals by evaluating offering from competitors, Identify opportunities and convert them into Sales
 Responsible to Manage Existing accounts and Develop new accounts
 Coordinate with Support Team for Training, Installation and Payments/Collections
Salary Package: Commensurate with Demonstrated Experience & Skills
Company Name: Starcom Information Technology Limited Starcom Information Technology Limited (BSE: 531616) is a public listed company, aspiring to be a knowledge-based technology-driven company. We have a diverse product portfolio of products (i.e. Systat, Sigma plot, NISA, Star – BI / DQ, and Embedded development kits based on DSP and ARM) and eminent global IP driven solution provider in the Data Quality, Business Intelligence, and Data Analytics space.
Website: http://www.starcomacademic.com
Location: Bangalore
Note: This job involves Travelling. Candidate must be ready to travel.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos