Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Remote, Hyderabad
0 - 1 yrs
₹1.5L - ₹2.5L / yr
Blender
Adobe After Effects
Adobe Premiere Pro
DaVinci
Script Writing
+4 more

About the Role

We are seeking a fast, creative, and technically skilled 3D Explainer Video Producer to transform daily incident briefs into short, high-impact explainers within hours. You will work across a blend of real-time 3D pipelines and AI-powered tools to deliver cinematic-quality videos that help the world understand fast-moving events — all while staying aligned to our visual brand.


Key Responsibilities

Translate incident briefs into concise visual storylines and scene concepts


  • Create or AI-generate 3D assets using Blender, Maya, or 3ds Max

  • Animate scenes using real-time engines like Unreal Engine or Unity

  • Composite titles, graphics, and voiceovers using After Effects and Premiere (or Resolve)

  • Integrate AI tools like Runway, Pika, and ElevenLabs to accelerate production

  • Maintain a reusable library of templates, transitions, rigs, and sound design elements

  • Ensure brand consistency across color, fonts, resolution, aspect ratios, and platform-specific specs

  • Collaborate with writers, analysts, and social media teams to refine edits under tight timelines


Required Skills

1+ years of 3D/motion-graphics production experience


Proficiency in Blender, Maya, or 3ds Max


Experience with Unreal Engine or Unity for cinematic rendering


Advanced use of After Effects and Premiere Pro (or DaVinci Resolve)


Strong storyboard literacy and ability to convert briefs into visual sequences


Familiarity with AI tools for asset creation, animation, or TTS


Fast, efficient, and organized with excellent communication skills


Bonus Skills

Journalism, news, or media production experience


Python, C#, or scripting for pipeline automation


Experience with short-form video platforms (YouTube Shorts, Reels, LinkedIn)


Color grading expertise using DaVinci Resolve



Read more
A leading software company
A leading software company
Agency job
via BOS consultants by Manka Joshi
Gurugram
8 - 10 yrs
₹15L - ₹20L / yr
skill iconReact.js
skill iconJavascript
TypeScript
skill iconHTML/CSS
vite
+2 more


Design, develop, and maintain scalable web applications using React.js.

Build and optimize Progressive Web Applications (PWAs) with offline capabilities, push notifications, and responsive design.

Implement mobile-first features and ensure cross-device compatibility.

Handle app packaging and distribution for various platforms (e.g., Android, iOS via PWA standards).

Collaborate with UI/UX designers and backend developers to deliver high-quality user experiences.

Design, build, and maintain a scalable component library to promote UI consistency and reusability across projects

Ensure cross-platform optimization and responsiveness of applications.

Optimize application performance and loading times.

Integrate APIs and manage state using modern tools (e.g., Redux, Context API).

Implement and manage push notifications and background sync features.

Advocate for and implement best practices in UI architecture, including modularity, theming, and performance optimization.

Stay up to date with the latest trends in Web development and PWA capabilities.

Hospitality services domain experience is a plus.

Strong problem-solving skills, with the ability to work independently and in a team.

Proficiency in Agile methodologies and software development best practices.

Experience with version control systems, particularly Git.

 

Read more
HappyFox
at HappyFox
1 video
6 products
Lindsey A
Posted by Lindsey A
Chennai, Bengaluru (Bangalore)
2 - 4 yrs
₹5L - ₹10L / yr
Selenium
Appium
Test Automation (QA)
Software Testing (QA)
skill iconPython
+4 more

About us:

HappyFox is a software-as-a-service (SaaS) support platform. We offer an enterprise-grade help desk ticketing system and intuitively designed live chat software.

 

We serve over 12,000 companies in 70+ countries. HappyFox is used by companies that span across education, media, e-commerce, retail, information technology, manufacturing, non-profit, government and many other verticals that have an internal or external support function.

 

To know more, Visit! - https://www.happyfox.com/

 

We are looking for an Automation Test Engineer with a natural flair for solving complex problems and making life easier for others. You'd be a part of our dynamic QA team responsible for maintaining and enhancing the quality of our products.

 

Responsibilities:

  • Owning the quality of any deliverables including new features and enhancements
  • Working closely with the product team in understanding the requirements and user workflow
  • Writing highly efficient manual test cases and performing functional, ad-hoc and regression testing
  • Designing, developing and executing automation test scripts
  • Raising defects/bugs and tracking them till closure

 

Requirements:

  • Bachelor's degree in engineering/IT/computer science or related field
  • 2-4 years of relevant work experience in software testing
  • Professional automation QA experience, using Selenium Webdriver with Python and/or Java 
  • Experience in using a defect tracking system to report, track and resolve defects
  • Good understanding of the Agile software development methodology (Kanban or Scrum) 
  • Passion for software quality assurance, problem detection and analysis
  • Experience working in SaaS based product company (optional)
  • Worked for a bootstrapped high-growth startup (optional)

 

Read more
Kredit Foundation
soumen laha
Posted by soumen laha
Pune, Nagpur, Mumbai, Nashik, Rajkot, Ahmedabad, Surat, Vadodara, Dhanbad, Ranchi, Bhubaneswar, Rourkela, Cuttack
5 - 10 yrs
₹3L - ₹4.8L / yr
BFSI
Financial services
Financial management
Financial analysis
Banking
+3 more

STATE IN CHARGE

Education

Any Bachelor Degree

Job Description

Establishing good relationships with Bank's LHO, RBO, DSH & Link Branches.

- Appointment of Kiosk operators in allocated URBAN locations.

- Responsible for ensuring completion & submission of documents at the Bank's office for opening CSPs.

- Ensuring proper selection of CSP location & Kiosk Operator with vision of business sustainability.

- Working towards increasing business performance of CSP's

- Controlling & monitoring of CSP's to avoid Frauds.

- Manages all state level activities and coordination .

- Representation at regional level offices as well as district level offices.

- Any other work; as and when required pertaining Financial Inclusion business

Requirement of Candidate:

1. Graduate

2. Min Exp. of 5 years

3. financial inclusion (BFSI) sector

4. Should have handled a team .

5. Computer Skills - Mails, MS Excel, MS Word.

6. Good Communication skills (English and local Language) - Written & Oral

Provide guidance, mentorship and effective knowledge management within the team to ensure profitability

#business

- Identify, assess and manage risks arising out of operational plan, design or delivery

- Manage multiple stakeholders and work closely with them.

- Ensure a balance with sometimes, competing needs and priorities

- Develop guidelines for effective reflection, learning, and change

- Work on the results from learning and reflection exercise to create best practices and introduce process improvements

Employment terms: Full time

Preferred Date of joining: Latest possible

Travel expenses & Mobile reimbursement: As per the team budget and requirement of the role.

Read more
A fast-growing SaaS commerce company permanent WFH & Office
A fast-growing SaaS commerce company permanent WFH & Office
Agency job
via Jobdost by Mamatha A
Bengaluru (Bangalore)
8 - 12 yrs
₹35L - ₹50L / yr
Databases
MySQL
skill iconMongoDB
API
kofka
+1 more

What is the role?

You will be responsible for building and maintaining highly scalable data infrastructure for our cloud-hosted SAAS product. You will work closely with the Product Managers and Technical team to define and implement data pipelines for customer-facing and internal reports.

Key Responsibilities

  • Design and develop resilient data pipelines.
  • Write efficient queries to fetch data from the report database.
  • Work closely with application backend engineers on data requirements for their stories.
  • Designing and developing report APIs for the front end to consume.
  • Focus on building highly available, fault-tolerant report systems.
  • Constantly improve the architecture of the application by clearing the technical backlog. 
  • Adopt a culture of learning and development to constantly keep pace with and adopt new technolgies.

What are we looking for?

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

  • Education - BE/MCA or equivalent
  • Overall 8+ years of experience
  • Expert level understanding of database concepts and BI.
  • Well verse in databases such as MySQL, MongoDB and hands on experience in creating data models. 
  • Must have designed and implemented low latency data warehouse systems.
  • Must have strong understanding of Kafka and related systems.
  • Experience in clickhouse database preferred.
  • Must have good knowledge of APIs and should be able to build interfaces for frontend engineers.
  • Should be innovative and communicative in approach
  • Will be responsible for functional/technical track of a project

Whom will you work with?

You will work with a top-notch tech team, working closely with the CTO and product team.  

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality on content, interact and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits.
We are

A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF, Dubai, Singapore and Dublin. We have three products in our portfolio: Plum, Empuls and Compass.  Works with over 1000 global clients. We help our clients in engaging and motivating their employees, sales teams, channel partners or consumers for better business results.

Read more
Comprehensive Ayurvedic Platform
Comprehensive Ayurvedic Platform
Agency job
via Unnati by Gayatri Joshi
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹5L - ₹8L / yr
design
Adobe Premiere Pro
Adobe Creative Suite
Animation
Digital Marketing
+3 more
Here is a great opportunity with one of the largest Ayurvedic sites in the USA, Australia, Canada and Europe where Venture Capitalists and other investors have invested > INR 44 crores in the firm!
 
Our client is a Delhi based healthcare platform that is dedicated to Ayurveda and provides wellness solutions to its customers that is tailored and fine-tuned to their requirements. They have created a unique balance of Ayurvedic herbs and western medicine to come up with courses and medical advice which will not only rid their patients of the illness but also helps them bring the body back into balance.

Their services are available across the globe, with over 65% of their client base being from US, UK, and Canada. The company's primary focus is on Ayurveda and taking the ancient knowledge to anyone who wishes to bring back balance to their health and apply the tools in their everyday life.
 
As a Creative Designer, you will report to the Brand Manager and required to work directly with the Platform Manager or the Head of Content and Brand Development.
 
What you will do:
  • Creating beautiful art and yet make ads and other creative collaterals that have high CTR / sharability/ virality
  • Creating Sales Pages, images for multiple purposes, animations, GIFS, Infographics, packaging, branding creatives etc.
  • Becoming a critical part of a very unique and different movement, building a distinctive brand that stands-out amidst a crowd of beauty and wellness products across the globe
  • Working for an international market and thereby, staying ahead of the global curve of trends
  • Using the creative arts and a productively imaginative mind in context of health, beauty and wellness!

 

 

What you need to have:

  • Any Graduation
  • Complete command over all the design software such as Adobe Suite, Coreldraw and more will be a must
  • Ability to work on Adobe Premier Pro will be an added advantage
  • Creative artists, digital painters, illustration specialists, painters etc. are more than welcome!

 

Read more
YASH Technologies
YASH Technologies
Agency job
via StagInnovations Pvt Ltd by Rajasekhar Gupta
Hyderabad
10 - 10 yrs
₹16L - ₹18L / yr
SAP ABAP
SAP HR
HR ABAP

Role : SAP ABAP Lead Consultant

Experience : 10+Years

Location : Hyderabad

Project Duration : 2+Years

Secondary Skills : SAP ABAP-HR, FIORI, WEBdynpro

Read more
Hubilo Softech Private Limited
Sowmya Rani
Posted by Sowmya Rani
Remote only
3 - 5 yrs
₹5L - ₹12L / yr
Ethical Hacking
Ethical Hacker
Routing & Switching
skill iconJavascript
skill iconPython

Certified Ethical Hacker Requirements:

  • Bachelor’s degree in Information Technology or Computer Science.
  • CEH Certification.
  • Proven work experience of at least 2-5 years as a Certified Ethical Hacker.
  • Effective Programming Skills required but not limited to HTML, JavaScript, Python, PHP, SQL etc.
  • Advanced knowledge of networking systems and security software.
  • In-depth knowledge of parameter manipulation, session hijacking, and cross-site scripting.
  • Technical knowledge of routers, firewalls, and server systems.
  • Good written and verbal communication skills.
  • Good troubleshooting skills.
  • Ability to see big-picture system flaws.

  • B.Tech/B.E.(IT/Computers), B.Sc( Computers), MSc (IT), BCA (Computer) or any equivalent graduation or post-graduation
Read more
Casey Foods
at Casey Foods
7 recruiters
HR Coordinator
Posted by HR Coordinator
Remote, Rourkela
4 - 7 yrs
₹2L - ₹3L / yr
Sales
Team leadership
Problem solving
  • Manage sales operations in assigned district to achieve revenue goals.
  • Supervise sales team members; the BSMs, on daily basis and provide guidance whenever needed.
  • Identify skill gaps and conduct trainings to sales team.
  • Work with team to implement new sales techniques to obtain profits.
  • Assist in employee recruitment, promotion, retention and termination activities.
  • Conduct employee performance evaluation and provide feedback for improvements.
  • Contact potential customers and identify new business opportunities.
  • Stay abreast with customer needs, market trends and competitors.
  • Maintain clear and complete sales reports for management review.
  • Build strong relationships with customers for business growth.
  • Analyze sales performances and recommend improvements.
  • Ensure that sales team follows company policies and procedures at all times.
  • Develop promotional programs to increase sales and revenue.
  • Plan and coordinate sales activities for assigned projects.
Provide outstanding services and ensure customer satisfaction.
Read more
Epic.one
at Epic.one
1 recruiter
shalini prakash
Posted by shalini prakash
Bengaluru (Bangalore)
3 - 7 yrs
₹10L - ₹20L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Position: iOS developer Exp: 3 to 6 yrs Location: Lavelle, Bangalore - 3+ years mobile app development experience. - Good Knowledge of Cocoa, Objective-C, and Swift. - Strong interaction and design sense. - Worked on bug fixing, version controlling and improving application performance. - Experience with iOS frameworks such as Core Data, Core Animation, Core Graphics, and Auto Layouts. - Solid understanding of the full mobile development life cycle.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos