Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Appiness Interactive
Bengaluru (Bangalore)
6 - 11 yrs
₹15L - ₹18L / yr
skill iconJava
skill iconNodeJS (Node.js)
skill iconAngular (2+)
skill iconMongoDB
Generative AI

Responsibilities:

 Leads technical design and development.

 Ensure high-quality, scalable, and testable application architecture through

rigorous design leadership and best practices.

 Owning complex features, writing quality code and tests, mentoring engineers,

and championing quality standards within a CI/CD environment.

Experience and Expertise Requirement :

 8+ years related software development experience.

 Proficiency in Java, SQL, Mongo and Angular, JavaScript, TypeScript, NodeJS.

 Working experience in Angular 6+


JOB DESCRIPTION


 Expertise in Gen AI frameworks, Lang Chain ecosystem, Hugging Face,

LLM capabilities, AI cost optimization

 Very strong programming skills and should be able to write optimized,

modular code.

 Should have good communication, and interpersonal skills.

 Ability to work in faced-paced agile environment and cope with the speed of

scrum process.

 Strong problem-solving skills and attention to detail.

 Traits to take ownership of the components and deliver work that including

development, unit testing, and bug-fixing.

 Deep understanding of design principles

 Strong architecture knowledge with experience in HLD + LLD

 Very strong debugging & problem-solving skill

 Ownership mindset and ability to lead design

 Ability to mentor other engineers

 Strong coding excellence (clean code, SOLID, modular design)

 Hands-on across Java, Node, Angular, SQL, Mongo

 GenAI stack proficiency & integration patterns

 Debugging proficiency is required across:

 Distributed services

 API integrations

 UI state management

 Query performance issues

 AI pipeline debugging (Lang Chain, LLM cost optimization, prompt

chains)


JOB DESCRIPTION


1.Supervisory Responsibility

This position may have supervisory responsibilities.


Educational Qualification


 Bachelor’s degree in computers or software engineering or

 Master’s degree in computer science, Computer Applications

Read more
Dev Technosys
at Dev Technosys
2 recruiters
apoorva sharma
Posted by apoorva sharma
Jaipur
0 - 3 yrs
₹1L - ₹4L / yr
Document review
BRD
FRD
Sales
BRS
+1 more
Publishing documentation in the format required for project delivery.
•    Communication between the Client and the Technical teams.
•    Writing case studies and blogs for the projects and websites developed.
•    Generating Revenue & projects and closing deals with International Clients.
•    Assists in enforcement of project deadlines and schedules.
•    Quickly understands the business issues and data challenges of client’s organization and industry.
•    Creating documents like BRS /SRS and project Cost Estimation
•    Identifies client organizations strengths and weaknesses and suggests areas of improvement.
•    Reviewing documents for language, punctuation, and style or formatting errors with proficiency.
•    Technical Recommendation and Testing.
Read more
Agami Tech
at Agami Tech
3 recruiters
Digish Shah
Posted by Digish Shah
Mumbai, Surat, Gurugram
0 - 3 yrs
Best in industry
skill iconPHP
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+5 more

Big Picture (The Opportunity) : 

Do you take pride in your web development ability? Would you like to use your skills in an energetic atmosphere? Are you dedicated to the craft, write code that they are proud of and can hit the ground running , you’re in the right place.

What do we want from you ? (Our Expectations) : 

  • To manage our back-end services and ensure a seamless interchange of data.
  • You will be responsible for developing and coding all server-side logic and also to maintain the central database and respond to requests from front-end developers. 

What are you required to do ? (Your Responsibilities) 

  • Writing back-end code and building efficient modules.
  • Produce detailed specifications
  • Developing back-end portals with an optimized database.
  • Integrating data storage solutions.
  • Responding to integration requests from front-end developers.
  • Updating and altering application features to enhance performance.
  • Troubleshoot, test and maintain the core product software and databases to ensure strong optimization and functionality
  • Contribute in all phases of the development lifecycle
  • Develop and deploy new features to facilitate related procedures and tools if necessary
  • Work closely with the IT team in completing projects
  • Troubleshoot and fix any issues relating to PHP programs
  • Create scripts to facilitate client systems to meet performance and objectives
  • Test and develop software for client applications
  • Create documentation for software created
  • Utilize source debuggers and write or modify client software
  • Produce results effectively and within the deadlines set 
Read more
Product base
Product base
Agency job
via CIEL HR Services by Swati M
Bengaluru (Bangalore)
1 - 2 yrs
₹2L - ₹4.2L / yr
IT Recruitment
Technical Recruitment
Recruitment/Talent Acquisition
skill iconJava
Software Testing (QA)

Total Experience:6months to 1 Year

Notice: Immediate Joiners


  • Good experience of 1-2 years in sourcing from different channels
  • Solid knowledge of sourcing techniques (e.g. social media recruiting and LinkedIn) 
  • Should have basic technical knowledge of technologies used in IT & eCommerce (Java, SAP, Springboot, Scrum, product management, Digital marketing etc) 
  • Strong communication and influencing skills  
  • Source, screen, and conduct initial technical interviews with qualified candidates for all the positions along with the business leaders, and schedule follow-up interviews.
  • Interaction with the relevant candidates, briefing them about the requirement
  • Evaluate the technical skills of candidates and organize next interview rounds with leaders. 
  • Initiate search for lateral recruitment by executing a complete search of the database as per the requirements to find relevant candidates
  • Build talent pipeline for today and tomorrow with passive sourcing ability 
  • Execute a complete search of the database as per the requirements to find relevant candidates
  • Maintaining and updating the database of the candidates
  • Understanding of business teams & their requirements
  • Strong data analysis skills, ability to perform data analysis and make data-driven decisions 
  • You are a technology enthusiast, you care about how things work and you can successfully collaborate with technical experts & leaders
  • Ability to understand the organizational fit for the needs of the company 
  • Experience recruiting for IT, eCommerce, Data Engineering talent
  • Experience working with recruiting tools and systems, including resume databases, internet sourcing tools, and spreadsheets 
  • Familiarity with Applicant Tracking Systems and resume databases 
Read more
Qultured Media Private Limited
Bengaluru (Bangalore)
1 - 5 yrs
₹10L - ₹12L / yr
skill iconData Science
Artificial Intelligence (AI)
Large Language Models (LLM)
Product Management
Product design
+2 more

AI Product Manager


About Us:


At Formi, we’re not just riding the wave of innovation—we’re the ones creating it. Our AI-powered solutions are revolutionizing how businesses operate, pushing boundaries, and opening up new realms of possibility. We’re building the future of intelligent operations, and whether you join us or not, we’re going to change the game. But with you on board? We’ll do it faster.


About the Role:


We’re looking for a Product Manager who’s not afraid to take risks, who questions everything, and who can transform bold, crazy ideas into products that reshape entire industries. You won’t just manage; you’ll build, you’ll innovate, and you’ll lead. The best ideas? They come from people who think differently. If that’s you, let’s get started.


Your Mission (If You’re Ready for It):


We’re not hiring you for the usual. This is not a role for anyone looking to play it safe. We need someone who’s ready to challenge the status quo and make radical changes. You’ll be building the future with us, so expect to be pushed—and to push back. We’re not here to settle for less.


Key Responsibilities:


  • Vision and Strategy: Forget business as usual. Your job is to craft strategies that disrupt markets and create competitive advantages that others can only dream of.
  • Cross-Functional Leadership: You’ll lead from the front, working closely with engineering, sales, and marketing to turn ideas into reality. From concept to launch, you’re the one guiding the ship.
  • Customer-Centric Innovation: Don’t just listen to customers—understand them at a deeper level. Then use that understanding to create products that make people say, “Why didn’t anyone think of this sooner?”
  • End-to-End Ownership: You own it all. From the first spark of an idea to delivering a product that changes the game.
  • Data-Driven Decision Making: We don’t guess here. Use data, trends, and insights to make decisions that propel our products forward. Let the numbers tell the story.
  • Stakeholder Communication: Communicate like a visionary. Show the people around you the path forward and how it all ties together.
  • Continuous Innovation: Complacency is the enemy. Keep pushing the envelope, iterating, and improving so we stay miles ahead of the competition.



Who Should Apply?


  • You’re not just a thinker, you’re a doer. You thrive in fast-paced, innovative environments where the status quo is meant to be broken.
  • You’ve got at least 2+ years of experience in product management, preferably in tech or SaaS, and you’ve led teams to deliver products that actually make an impact.
  • You’re data-obsessed. Your decisions are backed by analytics, and you know how to measure success.
  • You’re not just a communicator; you’re an inspirer. You can articulate a vision so clearly, people can’t help but rally behind it.


This Role is NOT for You If:


  • You’re just looking for another job.
  • You think “good enough” is, well, good enough.
  • You’d rather play it safe than take bold, calculated risks.


Why Join Us?


  • Impact: You’ll be part of a company that’s literally changing how businesses operate. Your work will have a direct impact on the future of creating a surplus economy.
  • Growth: We’re scaling fast, and with that comes insane opportunities for personal and professional development.
  • Culture: We move fast, we break things (intelligently), and we value big ideas. We’re building something massive, and you’ll be a key part of it.


Are you ready to disrupt entire industries and make a dent in the universe?

Apply now and let’s build the future together.



Read more
Tecknotrove Systems (i) Pvt Ltd
Mumbai
1 - 5 yrs
₹2L - ₹5L / yr
Unity 3D
Virtual reality (VR)
Augmented reality
Gaming
skill iconC#
+2 more
Job Description:
· Developing simulation must have experiences in VR/AR/MR . Experience with 3D platform.
· Familiar with Unity/ Unreal editor and its features and developing solutions using Unity/Unreal Engine.
· Coding and testing for VR devices.
· Can work on Window/ Web based and l ow-notch design.
· Experience with Version Controller - SVN .
· Experience with Game Implementation.
· Understanding of OOP concepts and knowledge of C #, .Net framework.
Read more
Trimble
Subashini Bakthavatchalam
Posted by Subashini Bakthavatchalam
Chennai
1 - 5 yrs
₹1L - ₹5L / yr
Voice processing
Inbound Marketing
Outbound marketing

Job Responsibility: 

  • Interacts with customers, company sales and/or service representatives via telephone, email, text, chat or through other social media platforms, to handle a variety of pre-sales or post-sales service functions. Analyzes requests, provide solutions or ascertains who best can provide the information, and routes the request to the appropriate department/individual 

  • Resolves level 1 product or service problems by clarifying the customer's complaint; determining the cause of the problem; selecting and explaining the best solution to solve the problem; expediting correction or adjustment; following up to ensure resolution.

  • Receives customer requests and prepares documents/trouble tickets related to processing returns (RMA), servicing and exchanges.

  • Contributes to team effort by accomplishing team metrics and SLA   

  • Provides all billing-related information to customers – helps in resolving any billing issues 

  • Receives, processes and verifies the accuracy of requests from customers utilizing the company’s internal tools and systems 

  • Ensures and provides quality service to both internal and external customers. 

  • Receives inquiries and contacts the organization’s other departments to resolve a variety of account-related issues 

  • Participates and provides expertise as a member of the Customer Care group 

  • Attends regular meetings and feedback sessions 

Read more
Tax & Expense Mgmt Fintech
Tax & Expense Mgmt Fintech
Agency job
via Unnati by shishira srinivasan
Bengaluru (Bangalore)
2 - 5 yrs
₹4L - ₹8L / yr
Motion graphics
Graphic Designing
Branding
As a Graphic Designer ( Branding & Motion Graphics) you will be responsible for understanding creative briefs and generating unique ideas for
building a great consumer brand.

What you will do:

Conceptualizing visuals based on requirements

A keen eye for aesthetics and details.

Collaborating with marketing, copywriters, product team to ensure consistency of designs across various social media platforms

Positive and committed with a can-do attitude and a flexible approach to complex problems

Ability to work effectively under timeline, proactive and manage multiple projects simultaneously

Understanding and maintaining consistency & brand values across all communication channels/ social media platforms

A thorough understanding of creative design trends in tech, branding, advertising and related fields

What you need to have:
2+ years of proven graphic/brand designing experience

Advanced graphic design, illustrations, video creating and editing skills

Advanced software skills of Adobe creative suite (mainly photoshop, illustrator, premiere pro & After Effects) or other relevant software

Strong sense of typography, imagery, colours, composition and visual layouts

Experience working with other teams such as marketing, product, etc.

Must be receptive to constructive feedback and create multiple iterations of the designs

A great portfolio that demonstrates your skills

Must have a degree in Design, Fine Arts or related fields

Animation & Motion Graphics skills are a great plus
Read more
LeanAgri
at LeanAgri
6 recruiters
Siddharth Dialani
Posted by Siddharth Dialani
Pune
0 - 3 yrs
₹1L - ₹2L / yr
Operations
Customer Success
agronomy
Job Summary- We are looking for an enthusiastic and energetic individual to join as a Farm Associate. You’ll regularly meet farmers and visit their farms. You’ll also work with agronomy-technical-officers to develop advanced package of practices for crops. Responsibilities and Duties- Meeting farmers and visiting farms Interact with farmers through multiple media and solve problems Recording data about crop growth and suggesting agronomy practices Continually advance your agronomy knowledge Collaborate with senior agronomy-technical-officers to develop package of practices for crops Required Experience, Skills and Qualifications- Graduate degree in Agriculture Ability to interact with farmers in Marathi language Familiarity with modern agronomy practices especially – integrated nutrient and pest management Willingness to go through online or executive courses Benefits- National and international (online) courses in relevant field Allowance would be provided for all company related travel Opportunity to work with qualified agronomists
Read more
xemotive
at xemotive
1 video
1 recruiter
The Electric
Posted by The Electric
Ahmedabad
3 - 7 yrs
₹5L - ₹7L / yr
Firefox
skill iconC
OS X
Linux/Unix
skill iconC++
+1 more
Selected intern's day-to-day responsibilities include:

1. Engage in Firefox OS development and Boot 2 Geko development
2. Develop apps for Firefox web OS
3. Develop an app store for Firefox OS
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos