Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Spacetil
Senthamarai  Kannan
Posted by Senthamarai Kannan
Bengaluru (Bangalore)
3 - 8 yrs
₹20L - ₹50L / yr
skill iconJava
skill iconPython

Skills

  • Strong analytical thinking and problem-solving abilities.
  • Solid understanding of system design, data structures, and algorithms.
  • Proven experience in designing and implementing scalable architectures and robust design patterns.
  • Ability to deliver end-to-end features and enhancements with minimal supervision.
  • Proficient in debugging and resolving complex production issues and identifying root causes quickly.
  • Ability to quickly learn and integrate new systems into existing platforms.


Programming Languages

  • Strong expertise in Java or Python.


Database Skills

  • Proficiency in SQL, with hands-on experience in PostgreSQL and MySQL.


Experience with NoSQL technologies, including MongoDB and Redis.

Read more
Codezen Tech Solutions
at Codezen Tech Solutions
1 recruiter
Noorun Rehmani
Posted by Noorun Rehmani
Mumbai, Navi Mumbai, Raipur
2 - 3 yrs
₹8L - ₹12L / yr
Artificial Intelligence (AI)
yolov7
Large Language Models (LLM)
Graphics Processing Unit (GPU)
Linux/Unix


We’re looking for an experienced AI Developer to join our team and drive the design, development, and deployment of advanced computer-vision and LLM-based solutions. You’ll build real-time object detection & tracking pipelines (LLM, YOLOv8/11), develop face-recognition models on video feeds with LLM support, and manage GPU-powered server infrastructure end-to-end.

Key Responsibilities

  • Model Development & Optimization
  • Design, train, and fine-tune LLMs, YOLOv8/11 models for multi-class object detection.
  • Implement face-recognition pipelines leveraging state-of-the-art LLMs and embedding techniques.
  • Optimize inference speed and accuracy for real-time video processing on GPUs.
  • Video Analytics & Tracking
  • Develop multi-camera object-tracking algorithms across disparate video sources.
  • Integrate OpenCV, DeepSORT (or similar), and custom tracking logic for robust performance.
  • Infrastructure & Deployment
  • Provision and maintain Linux servers with SSH, Docker, and GPU drivers (NVIDIA CUDA/cuDNN).
  • Automate CI/CD pipelines for model training, evaluation, and deployment.
  • Monitor GPU utilization, troubleshoot performance bottlenecks, and ensure high availability.
  • Collaboration & Documentation
  • Work closely with product managers, data engineers, and front-end teams to integrate AI services via REST/gRPC APIs.
  • Write clear technical documentation, API specs, and best-practice guides.

Required Qualifications

  • Bachelor’s or Master’s in Computer Science, Electrical Engineering, or related field.
  • 2-3+ years hands-on experience with:
  • YOLOv8 or YOLOv11 (training, inference, transfer learning)
  • Face recognition frameworks (InsightFace, FaceNet, ArcFace) and LLM embeddings (e.g., Hugging Face Transformers)
  • Python ecosystem: PyTorch/TensorFlow, OpenCV, NumPy, scikit-learn
  • Strong Linux skills: server provisioning, SSH, shell scripting.
  • Proficiency in managing GPU servers (NVIDIA CUDA, Docker GPU containers)
  • Experience deploying models in production (AWS/GCP/Azure or on-prem clusters).

Preferred Qualifications

  • Familiarity with video-streaming protocols (RTSP/WebRTC).
  • Knowledge of microservices architecture and API gateways.
  • Exposure to MLOps platforms (MLflow, Kubeflow).
  • Strong debugging, profiling, and performance-tuning abilities.


Read more
Kafqa Academy
at Kafqa Academy
1 recruiter
Namrata Maidur
Posted by Namrata Maidur
Bengaluru (Bangalore)
6 - 8 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconFlask

About KAFQA

At Kafqa, we are building the next generation performing arts platform. Our mission is to transform how India learns, performs & watches performing arts. Our launch services consist of technology-enabled dance classes in our proprietary studios, production facilities, and social media broadcasting & competitions.

Founder & Team

The founder is Shariq Plasticwala. He is a graduate of IIT Bombay & Stanford GSB. He was part of the founding team of Amazon India where he played a key role for over 8 years. Among his roles at Amazon, he was the CEO of Amazon’s first joint venture in India and a Board Member of Amazon’s payments business. The other members of the founding team consisted of senior executives from Shiamak Davar & Byju’s.

Background

  •   At least 6+ years experience in back-end development in a fast-paced environment, working in Python & Django Framework
  • Should Have experience leading a team.
  •   Deep understanding of technologies used in web products, including Rest APIs
  •   Sound understanding of SQL/NoSQL databases such as PostgreSQL and MongoDB.
  •   Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps.
  •   Understanding of databases, and related tools, paradigms.

 

Opportunity

Here are some of the things you might have to do on any given day:

  •   Developing APIs and endpoints for deployments of our product.
  •   Infrastructure Development such as building databases, creating and maintaining automated jobs.
  •   Build out the back-end to deploy and scale our product.
·  Document your code, write test cases, etc.
Read more
Mobile Programming India Pvt Ltd
at Mobile Programming India Pvt Ltd
1 video
17 recruiters
shital patwal
Posted by shital patwal
Gurugram, Chennai, Mohali, Bengaluru (Bangalore), Pune
5 - 10 yrs
₹4L - ₹11L / yr
skill icon.NET
skill iconC#
ASP.NET
Web API
skill iconAngularJS (1.x)

4 - 6years of experience in web and API development

4+ years experience with http://asp.net/MVC/C" target="_blank">ASP.NET/MVC/C#.

4+ years working with SQL Server (2012+).
Good Knowledge of scripting libraries like jQuery, Knockout, Angular JS

Read more
Kindlifein
at Kindlifein
1 recruiter
Iti Shrivastava
Posted by Iti Shrivastava
Gurugram
4 - 8 yrs
₹10L - ₹18L / yr
KINDNESS IS OUR SUPERPOWER - and our goal is to build and bring all kind of brands onto a single platform. kindlife is built to bridge the gap between customers' values & brands' values.

kindlife is the world's first well-being ecosystem that enables conscientious consumers with the largest community of well-being experts, brands, and content creators. kindlife platform houses more than 150+ kinder brands in beauty, nutrition, and home care and has a thriving community of well-being experts and enthusiasts. We believe it is essential to be kind and in that pursuit, we bring together all products that are kind to you, kind to those around you, and kind to the environment. For us, any move; big or small; on the well-being spectrum is a kindmove and must be celebrated.

About the role:

- Responsible for writing creative content for beauty brands and improving the quality of content on the website
- Writing blog posts and marketing copy to promote our products and service
- Update our website and social media pages with new content
- Proofread, re-structure, and edit articles by content writers
- Generate new ideas around industry-related topics
- Monitor web traffic and user engagement
- Hands-on experience with Content Management Systems
- Manage the editorial calendar and ensure timely publication
- Improve illustration in collaboration with marketing and design teams
- Proven work experience as a Content Editor, Web Editor, or similar role
- Excellent writing and editing skills in English
- Familiarity with SEO and keyword research

What We're Looking For:

- 2-4 years of significant knowledge across content, beauty, and lifestyle
- Critical thinking and the ability to quickly assess opportunities and challenges
- Ability to set long-term strategy, clear goals, and KPIs
- Excellent organization and communication skills
- Experience being a team player collaborating across departments
- Ability to manage multiple projects simultaneously and prioritize demands
- Strong people skills and ability to effectively manage a direct report
- Self-direction and an ability to manage ambiguity
- Experience managing and nurturing junior team members

What It's Like To Work Here:

kindlife is at its best when every member of our crew feels respected, included, and heard-when everyone can show up as themselves and do their best work every day.

We are a purpose-driven company and work towards empowering the crew to reach their full potential. We live up to our purpose by employing the following behaviors.

- We collaborate: Being a part of the kind crew means being part of one team with shared values and common goals.
- We innovate: At kindlife we always aim to find new and better ways to create innovative products and experiences. No matter where you work in the organization, you can always make a difference and have a real impact. We welcome new ideas and value new initiatives that challenge conventional thinking.
- We execute: We strive for excellence and are focused on pursuing best-in-class outcomes. We believe in accountability and ownership and know that our people are at their best when they are empowered to create and deliver results.

Visit us at: https://kindlife.in/ or join the conversation here :

- Instagram: https://www.instagram.com/kindlife.in/
- YouTube: https://www.youtube.com/channel/UCB2jIIGdFEhHKeoddqfP-Gg

Do a reference check with a crew member. We'll keep it anonymous, we promise!

Apply now!
Read more
CES Information Technologies
Yash Rathod
Posted by Yash Rathod
Remote only
7 - 14 yrs
₹7L - ₹15L / yr
Project Management
Certified Scrum Master (CSM)
PMP
skill iconProgramming
People Management
Managing multiple development projects concurrently.
 Must have good hands on experience as a developer in any prog language.
Experience in any of our service offerings such as BI/AI/ML/QA/Microsoft Tech/Devops/UI/UX etc
Must have worked in US/Europe/ Australia etc
 CSM/PSM Certification is mandatory
 Developing and managing end-to-end project plans.
 Ensure on-time delivery of projects.
 Providing hands-on project management during analysis, design, development, testing, implementation and post implementation phases.
 Assist with resource forecasting, delivery and change management of projects.
 Assists with internal process improvements.
 Interfacing with Business development for project requirements and scope.
 Conduct project management duties in accordance with Agile/ Scrum methods; waterfall, hybrid and best practices.
 Provide day-to-day interaction with clients and quality assurance for projects.
 Ensure milestones are achieved on-time, on-budget and in scope.
 Developing and monitoring risk and contingency plans.
 Additional duties as assigned.
 Must have excellent interpersonal skills in communications, client relations, people management and negotiation.
Read more
LikeMinds
at LikeMinds
6 recruiters
Natesh Rehlan
Posted by Natesh Rehlan
Gurugram
3 - 6 yrs
₹20L - ₹24L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Responsibilities:
• Designing and building Likeminds iOS application.
• Collaborating with the design team to define app features and building a high quality
application
• Ensuring quality and performance of application to specifications.
• Identifying potential problems and resolving application bottlenecks.
• Fixing application bugs before final release
• Publishing application on App Store
• Maintaining the code and atomization of the application
• Designing and implementing application updates

Skills Required
• Proven experience as an app developer.
• Proficient in Objective-C, Swift, Xcode and Cocoa Touch
• Extensive experience with iOS Frameworks and strong understand of development lifecycle
• Knowledge of iOS back-end services.
• Knowledge of Apple’s design principles and application interface guidelines.
• Proficient in code versioning tools including Mercurial, Git, and SVN.
• Familiarity with push notifications, APIs and cloud messaging.
• Experience with continuous integration

Prior experience working in a startup is a plus.
Read more
A leading German manufacturing MNC
A leading German manufacturing MNC
Agency job
via Unleash Talent LLP by Shafi Rehman
Bengaluru (Bangalore)
8 - 15 yrs
₹17L - ₹20L / yr
Human Resources (HR)
Industrial relations
Recruitment
Training and Development
Payroll Management
+1 more

Key Purpose

Responsible for direction, strategy, planning & execution for the company's human resources management and administration while also managing the industrial relations in a unionized environment which requires special attention.

Key Responsibilities :

1. Prepare the annual human resources budget based on strategic aims and specific business objectives of the company. Review and roll out action plans during quarterly, monthly forecasts to achieve the targets set.

2. Direct and coordinate human resources management operations which include recruitment, training & development, Industrial Relations, and personnel administration. This covers custody and maintenance of all human resource records and documentation and meeting all compliance requirements set by governmental authorities.

3. Develop, update, implement and maintain policies and processes for all human resource operations and ensure that they are clearly understood and followed.

4. Monitor and ensure the timely completion of the annual review of the performance management system in place. Continually revise and update the business objectives and key result areas in consultation with the functional heads to improve the contribution of individuals and teams to business performance thereby aligning with the company- s strategic aims and business objectives.

5. The management of recruitment processes to secure the right person and competencies to satisfy the organization's development/job needs.

6. The development and implementation of organizational group and individual learning processes that achieve the skills and knowledge development to fulfil current and future business success.

7. Managing the relationship with the union as a representative of the management to liaison between the management and the union. To investigate and resolve any complex or critical industrial relations issues in a timely and effective manner. Handling complaints, managing grievance procedures, and facilitating counseling in conjunction with the management.

8. Facility management will ensure a clean, hygienic, secure facility in good repair, running efficiently with processes/frequencies / performance measures in place. Printing and stationery stocking & issue and incoming mail distribution will be part of facility management.

Additional Responsibilities :

Travel Management - Ordering flight tickets based on approved travel requisitions, themost economic rates and efficient travel, turnaround times. The domestic & international travel policy ground rules will apply.

Profile :

- Right Organisation - Small or Midsized engineering company in a professional, process-driven manufacturing environment.

- Right Qualification - Graduate/Engineer, Masters in Human Resource Management Right Experience - +12 years experience, 5 years minimum relevant experience,

- Competence - Excellent verbal and written business communication skills including the Capabilities ability to communicate with all levels of management and workmen in the organization.

- Strategic analytical capability, attention to detail and presentation skills

- Empathy and ability to understand the development needs of all employees

- Managing administrative work with a high degree of perfection

- Proficient with computers particularly with MS office and ability to utilize various software applications

- ERP functional knowledge, strong business, and quality management process understanding.

- Using considerable independent judgment and initiative to make recommendations to the management on all human resource related matters.

 

Read more
Styllox
at Styllox
1 recruiter
Styllox India
Posted by Styllox India
Remote, Mumbai
1 - 4 yrs
₹8L - ₹16L / yr
Digital Marketing
skill iconGoogle Analytics
Google Adwords
Web Analytics
Facebook Marketing
+1 more

1 to 3 years of experience in digital marketing - Highly conversant with Google Analytics and other similar tools - Basic programming ability(preferably R or Python)

Read more
Casey Foods
at Casey Foods
7 recruiters
HR Coordinator
Posted by HR Coordinator
Remote, Bargarh, Balangir, Deogarh, Jharsuguda, Nuapada, Sundargarh, Rourkela
4 - 7 yrs
₹2L - ₹3L / yr
Sales
Problem solving
Team leadership
  • Manage sales operations in assigned district to achieve revenue goals.
  • Supervise sales team members; the BSMs, on daily basis and provide guidance whenever needed.
  • Identify skill gaps and conduct trainings to sales team.
  • Work with team to implement new sales techniques to obtain profits.
  • Assist in employee recruitment, promotion, retention and termination activities.
  • Conduct employee performance evaluation and provide feedback for improvements.
  • Contact potential customers and identify new business opportunities.
  • Stay abreast with customer needs, market trends and competitors.
  • Maintain clear and complete sales reports for management review.
  • Build strong relationships with customers for business growth.
  • Analyze sales performances and recommend improvements.
  • Ensure that sales team follows company policies and procedures at all times.
  • Develop promotional programs to increase sales and revenue.
  • Plan and coordinate sales activities for assigned projects.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos