Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

HeyCoach
DeepanRaj R
Posted by DeepanRaj R
Bengaluru (Bangalore)
0 - 1 yrs
₹1.3 - ₹1.5 / mo
skill iconData Science
skill iconPython
Excel VBA
EDA
Jupyter Notebook
+10 more

Job Title: Data Science Intern

Location: 6th Sector HSR Layout, Bangalore - Work from Office 5.5 Days

Duration: 3 Months | Stipend: Upto ₹12,000 per month 

Post-Internship Offer (PPO): Available based on performance


🧑‍💻 About the Role

We are looking for a passionate and proactive Data Science Assistant Intern who is equally excited about mentoring learners and gaining hands-on experience with real-world data operations.

This is a 50% technical + 50% mentorship role that blends classroom support with practical data work. Ideal for those looking to build a career in EdTech and Applied Data Science.


🚀 What You'll Do

  • Technical Responsibilities (50%)Create and manage dashboards using Python or BI tools like Power BI/Tableau
  • Write and optimize SQL queries to extract and analyze backend data
  • Support in data gathering, cleaning, and basic analysis
  • Contribute to building data pipelines to assist internal decision-making and analytics

🚀Mentorship & Support (50%)

  • Assist instructors during live Data Science sessions
  • Solve doubts related to Python, Machine Learning, and Statistics
  • Create and review quizzes, assignments, and other content
  • Provide one-on-one academic support and mentoring
  • Foster a positive and interactive learning environment


✅ Requirements

  • Bachelor’s degree in Data Science, Computer Science, Statistics, or a related field
  • Strong knowledge of:
  • Python (Data Structures, Functions, OOP, Debugging)
  • Pandas, NumPy, Matplotlib
  • Machine Learning algorithms (scikit-learn)
  • SQL and basic data wrangling
  • APIs, Web Scraping, and Time-Series basics
  • Advanced Excel: Lookup & reference (VLOOKUP, INDEX+MATCH, XLOOKUP), Logical functions (IF, AND, OR), Statistical & Aggregate Functions: (COUNTIFS, STDEV, PERCENTILE), Text cleanup (TRIM, SUBSTITUTE), Time functions (DATEDIF, NETWORKDAYS), Pivot Tables, Power Query, Conditional Formatting, Data Validation, What-If Analysis, and dynamic dashboards using charts & slicers.
  • Excellent communication and interpersonal skills
  • Prior mentoring, teaching, or tutoring experience is a big plus
  • Passion for helping others learn and grow
Read more
Assettrust Services Pvt Ltd
Hyderabad, Bengaluru (Bangalore)
0.6 - 1.5 yrs
₹2.5L - ₹4L / yr
Real Estate
Sales
Lead Generation
Client Management

Company Name: Asset Trust Services Pvt Ltd



Company Website

 https://assettrustservices.com/


Industry

Real-Estate


Company Description

Asset Trust Services is one of the leading real estate services company in Bangalore serving various Tyre-1 brands. 

We are built upon ethics ,trust and Integrity as core principles. 

Our growing business teams consist of various real estate expertise with humongous domain experience . 


 Job Description :

We are looking for dynamic " *Sales Executive* " having passion for sales, growth and earning.

1. Meeting the sales target every quarter through given paid leads & data calling.

2. Pitching the prospective property seeker's relevant property options.

3. Assisting Site visit for the buyer along with team members.

4. Post visit provide all support to ensure a smooth closure of the deal on paper as per Team managers guidance

5. Everyday follow-up, track all assigned leads

6. Managing good customer relationships & be a great team player



 Mandatory :

Excellent communication

Negotiation skills

Customer handling skills

Decision-making skills.

Languages - English, Hindi, Telugu good to go

Should be flexible for the day shift and a Work Timings: 10 AM - 7:30 PM


 Note :

Remuneration best in industry

Read more
I Design My Life
at I Design My Life
1 recruiter
Rashmi Nair
Posted by Rashmi Nair
Remote only
2 - 5 yrs
₹3L - ₹7L / yr
skill iconPython
skill iconJavascript

Job description

“I DESIGN MY LIFE” is an Online Business Consulting/ Coaching Company headed by renowned Business Coach – Sumit Agarwal. We provide online consulting and trainings to Business Owners of SMEs, MSMEs across India.

You can find more about us here: https://idesignmylife.net/careers/

This is a hands-on position. The role will have the following aspects:

POSITION: Software Developer

LOCATION: Full time(permanent) work from home opportunity

LANGUAGES: JavaScript, MySQL, Python, Erp Next, HTML, CSS, and Bootstrap

ROLE : We are looking for people who can

  • Code well
  • Have written complex software
  • Self-starters - Can read the docs and don't need hand-holding
  • Experience in Python/Javascript/jQuery/Vue/MySQL will be a plus
  • Functional knowledge of ERP will be a plus

Basic Qualifications

  • BE / B.Tech - IT/ CS
  • 1 / 2+ years of professional experience
  • Strong C# and SQL skills
  • Strong skills in React and TypeScript
  • Familiarity with AWS services or experience working in other cloud computing environments.
  • Experience with SQL Server and PostgreSQL.
  • Experience with automated unit testing frameworks.
  • Experience in designing and implementing REST APIs & micro services-based solutions.

Job Types: Full-time, Permanent

Pay: ₹336,354.85 - ₹691,451.90 per year

Schedule:

  • Day shift
  • Weekend availability

Education:

  • Bachelor's (Required)

Experience:

  • JavaScript: 1 year (Required)
  • MySQL: 1 year (Required)

Work Location: Remote

Expected Start Date: 01/03/2025


Read more
AmplifAI
Vijay Chavan
Posted by Vijay Chavan
Hyderabad
8 - 12 yrs
₹15L - ₹25L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+9 more

Job Description

Technical lead who will be responsible for development, managing team(s), monitoring the tasks / sprint. They will also work with BA Persons to gather the new requirements and change request. They will help solve application issues and helping developers when they are stuck.

Responsibilities

·       Design and develop application based on the architecture provided by the solution architects.

·       Help team members and co developers to achieve their tasks.

·       Maintain / monitor the new work items and support issues and have to assign it to the respective developers.

·       Communicate with BA persons and Solution architects for the new requirements and change requests.

·       Resolve any support tickets with the help of your team within service timelines.

·       Manage sprint to achieve the targets.

Technical Skills

·       Microsoft .NET MVC

·       .NET Core 3.1 or greater

·       C#

·       Web API

·       Async Programming, Threading, and tasks

·       Test Driven Development 

·       Strong expert in SQL (Table Design, Programing, Optimization)

·       Azure Functions

·       Azure Storage

·       MongoDB, NoSQL

Qualifications/Skills Desired:

·       Any Bachelor’s degree relevant to Computer Science. MBA or equivalent is a plus

·       Minimum of 8-10 years IT experience and managing a team(s) out of which 4-5 years should be as a technical/team lead.

·       Strong verbal and written communication skills with the ability to adapt to many different personalities and conflict resolution skills required

·       Must have excellent organizational and time management skills with strong attention to detail

·       Confidentiality with privacy-sensitive customer and employee documents

·       Strong work ethic - demonstrate good attitude and judgment, discretion, and maintain high level of confidentiality

·       Previous experience of customer interactions

Read more
Witness the fitness
at Witness the fitness
1 recruiter
Anita Nigam
Posted by Anita Nigam
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
1 - 2 yrs
₹3.5L - ₹5L / yr
skill iconFlutter

Responsibilities -

  1. Work as part of cross-functional, passionate agile project teams to ensure quality is driven into the heart of the development process from requirements definition to delivery
  2. Architecting, designing, developing and deploying new features for mobile applications.
  3. Ensure the best possible performance, quality, and responsiveness of the application
  4. Diagnose and fix bugs and performance bottlenecks for great performance
  5. Maintain code and write automated tests to ensure the product is of the highest quality

Basic Requirements -

  1. You have at least 1y ears of full-time mobile development experience (iOS, Android) with at 1 year experience with Flutter & Dart
  2. Familiarity with RESTful APIs to connect applications to back-end services
  3. Experience developing integrations with common APIs (e.g., Firebase, Twitter, Facebook, Instagram, Stripe, Vimeo, Google etc.)
  4. Proficient understanding of code versioning tools, such as Git
  5. Strong knowledge of design principles, patterns, and best practices
  6. Experience with offline storage, threading, and performance tuning
  7. Ability to understand and translate business requirements into technical requirements
Read more
EnKash
at EnKash
1 recruiter
Manju M
Posted by Manju M
Pune
4 - 8 yrs
₹7L - ₹12L / yr
Functional testing
Regression Testing
API QA
Responsibilities:
Providing software application support under the supervision of the Senior Engineer.
Performing analyses on software application functionality and suggesting improvements.
Ensuring effective front-end and back-end functionality of applications.
Consulting with the software development team, internal users, and clients to improve application performance.
Establishing the root causes of application errors, and escalating serious concerns to the Senior Engineer.
Keeping a record of configuration changes and scheduling application updates.
Documenting processes and monitoring application performance metrics.
Providing front-end support to clients and colleagues in other departments.

Requirements:
A bachelor's degree in software engineering, computer science, information technology, information systems, computer engineering, or similar.
Exceptional communication skills (written & verbal)
Demonstrable experience as an application support engineer in a related field.
Advanced knowledge of integration and system testing
Ability to manage code migration, document configuration changes, and monitor performance.
Exceptional ability to provide front-end support to internal departments and web-based clients.
Advanced proficiency in determining the causes of application errors and repairing them.
 
 
Read more
Natalie Consultants
at Natalie Consultants
2 recruiters
Swati Bansal
Posted by Swati Bansal
Gurugram
5 - 9 yrs
₹10L - ₹20L / yr
skill iconRuby on Rails (ROR)
skill iconRuby

Ruby on Rails Developer Responsibilities:
• Designing and developing new web applications.
• Maintaining and troubleshooting existing web applications.
• Writing and maintaining reliable Ruby code.
• Integrating data storage solutions.
• Creating back-end components.
• Identifying and fixing bottlenecks and bugs.
• Integrating user-facing elements designed by the front-end team.
• Connecting applications with additional web servers.
• Maintaining APIs.
Ruby on Rails Developer Requirements:
• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• Experience working with Ruby on Rails as well as libraries like Resque and RSpec.
• Ability to write clean Ruby code.
• Proficiency with code versioning tools including Git, Github, SVN, and Mercurial.
• Experience with AngularJS or BackboneJS.
• Familiarity with MVC, Mocking, RESTful, and ORM.
• Good understanding of front-end technologies including HTML5, JavaScript, and CSS3.
• Knowledge of server-side templating languages including Slim and Liquid.

  • Databases- MongoDb, Postgres. 
Read more
Fact track MNC
Fact track MNC
Agency job
via Kavayah People Consulting by Kavita Singh
Pune, Bengaluru (Bangalore)
3 - 8 yrs
₹15L - ₹45L / yr
skill iconGo Programming (Golang)
skill iconPython
skill iconJava
skill iconC++
skill iconC
Arista Networks builds the infrastructure software that is the foundation block for Data Centers, Cloud, Web
and the entire internet. Our switches and routers are the backbone of large data centers that host Microsoft
Azure, Google Cloud, Facebook etc. High Frequency Traders rely on Arista to provide ultra-low latency network.
In India Arista powers the Flipkart’s Big Billion Day Sale event which has over billion transactions happening in
real time. Besides, we also provide the last mile connectivity for campus wide networking (both wired and
wireless) through our Cognitive Cloud Networking solutions. Arista disrupted the traditional infrastructure
technology by pioneering the move from hardware to Software Defined Networks, Cloud and now to greater
network visibility through telemetry and data analytics solutions. All this is possible because of the strong
product engineering innovation that is the core of Arista’s DNA. At Arista we take pride in our engineering
prowess. We hire the best engineers and give them the most complex infrastructure problems to solve. We
push for quality and not quantity. As our CTO/EVP(Engineering) Ken Duda puts it "It’s in our culture, quality is
the most important thing. Getting it right is more important than feature velocity, ship dates and new
platforms".
With over 400+ engineers in Bangalore and Pune are a big part of Arista’s technology leadership. With new
products in the offering, we are planning to strengthen the India team. If you are looking for an authentic
software engineering job where you can make a fundamental impact at the core infrastructure level, you
should be talking to us - we are looking for aptitude and attitude ; you need not have worked in wireless or
networking domains to work at Arista.
What will you get to do as a Software Engineer at Arista?
At Arista software engineers are the real deal - they do a lot more than simply writing code. You will work on
the whole development process, including:
• Suggesting and deciding what features to build
• Driving the design and architecture
• Pushing, testing, documenting the feature
• Working alongside customers in the field if needed
You will get to work with the best in your field and learn how to write amazingly reliable software - At
Arista everyone is hands-on including our managers, directors, VP’s and of course our CTO!
Are you right for this role?
Do you like coding? Does your adrenaline go up when you have difficult problems to solve? For success at
Arista all you need is:
• Strong engineering and Computer Science fundamentals
• Extensive background in algorithms and strong software architecture skills
• Fluency in one or more of these programming languages: C, C++, Python, Go, Java, JavaScript
• Hands-on experience with design and implementation in a strong product-engineering environment
• Self-driven and self-motivated - At Arista we empower engineers to work on their own with very little
supervision and management.
Why Arista?
As a great software engineer we know that you have multiple options to choose from. So why Arista? It is
because:

• Learning - A hands-on job like Arista’s is the best learning experience you can hope to get especially
when you work with peers who are equally good or better.
• Flexibility - Our engineers enjoy the utmost flexibility as we believe in judging by the output and not
by the hours worked. Our performance review process is designed to reflect this - we believe that
our best engineers know how to work and do not need to be told what to do.
• Truly global work - What we do in India is exactly the same as what we do in San Jose, Nashua,
Vancouver, Dublin, and other worldwide locations. You don’t have to move out of India to do
cutting edge software - at Arista you can do it right here.
• Large company with a start-up mind-set - We work like a start-up - less management, cost
conscious, innovating and disrupting our own products and we can go on. A mind-set that is hard to
get in $15b+ market cap public company.
Read more
Mail250
at Mail250
1 recruiter
Imran Shaikh
Posted by Imran Shaikh
Mumbai
0 - 2 yrs
₹1L - ₹1L / yr
Digital Marketing
Google Adwords
Web Analytics
skill iconGoogle Analytics
Search Engine Optimization (SEO)
+3 more
Selected intern's day-to-day responsibilities include: 1. Answer questions on Quora 2. Blogging / guest posts 3. Work on Google Adwords - remarketing management 4. Handle Facebook group posting 5. Reply to queries on Facebook page/group and Twitter 6. Post on related forums about offers 7. Facebook campaign management
Read more
Simplilearn Solutions
at Simplilearn Solutions
1 video
36 recruiters
Sankalp Sharma
Posted by Sankalp Sharma
Remote, HSR Layout, Bangalore, Bengaluru (Bangalore)
0 - 7 yrs
₹4L - ₹6L / yr
Sales
International sales
Telesales
International Business
Customer Relationship Management (CRM)
+3 more
Are you a salesperson who wants to earn Uncapped Sales Income and Looking for an Amazing Insides Sales Opportunity in World's No.8 Edutech Company, Here is an immediate Joining Opportunity for you. Job Timings :- 3 Fixed Timings Shifts (No Rotational Shfts) Job Description :- No Cold calling, No Lead Generation, No Field work just connect over call with the prospects created by our skilled Pre Sales team and use your selling skills to pitch our offerings. Regards, Sankalp.Sharma @ SImplilearn .net Sr. HR Simplilearn
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos