Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

NeoGenCode Technologies Pvt Ltd
Remote only
3 - 6 yrs
₹2L - ₹15L / yr
Hardware development
Large Language Models (LLM)
Verilog
SystemVerilog
VHDL
+6 more

Job Title : Hardware Design Developer – Verilog

Employment Type : Full-Time Contract (8 hours/day)

Location : Remote

Experience : 3+ Years (Mandatory)

Notice Period : Immediate


Job Overview :

We are looking for an experienced Hardware Design Developer to leverage hardware design platforms for generating training data to enhance enterprise LLMs' capabilities. This role offers a unique opportunity to directly impact AI advancements by optimizing hardware designs for training and benchmarking large language models.


Key Responsibilities :

  • Develop, configure, and customize hardware design platforms to generate training data for enterprise LLMs.
  • Work closely with research teams to translate requirements into actionable insights.
  • Ensure high-quality coding, debugging, and documentation to optimize hardware design solutions.
  • Collaborate with cross-functional teams to improve LLM performance and automation capabilities.

Required Skills & Experience:

  • BS/MS in Electrical Engineering or related field.
  • 3 to 5 Years of hardware design development experience.
  • Expertise in HDLs (Verilog, SystemVerilog, VHDL, SystemC).
  • Strong background in scripting, front-end workflows, and verification processes.
  • Familiarity with Synopsys, Cadence, or open-source toolchains.
  • Excellent problem-solving and collaboration skills.


Preferred Qualifications :

  • Expertise in UVM environments, Formal Verification, and Lint refinement.
  • Experience with Computer Architecture, Assembly Debugging, and Assertion Coding (SVA).
  • Familiarity with Machine Learning and AI systems.

Mandatory Technical Skills :

  • Min 2 Years of relevant experience in Hardware Design and/or Verification.
  • Experience with at least one of the following:
  • ASIC, VLSI, FPGA, SoC development.
  • SystemVerilog, Verilog, Testbench development, and Verification.
  • Strong understanding of IP Development and Verification.


Note: This role focuses on LLM training using hardware design, not traditional project development.

Read more
Springboard
at Springboard
1 video
Kakali Sharma
Posted by Kakali Sharma
Remote only
2 - 6 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconReact.js
skill iconVue.js
skill iconAngularJS (1.x)
skill iconPostgreSQL
+5 more

Job Description

The Opportunity

The Springboard engineering team is looking for software engineers with strong backend & frontend technical expertise. In this role, you would be responsible for building exciting features aimed at improving our student experience and expanding our student base, using the latest technologies like GenAI, as relevant. You would also contribute to making our platform more robust, flexible and scalable. This is a great opportunity to create a meaningful impact as well as grow in your career.

We are looking for engineers with different levels of experience and expertise. Depending on your proficiency levels, you will join our team as a Software Engineer II, Senior Software Engineer or Lead Software Engineer.

Responsibilities

  • Design and develop features for the Springboard platform, which enriches the learning experience of thousands through human guided learning at scale
  • Own quality and reliability of the product by getting hands on with code and design reviews, debugging complex issues and so on
  • Contribute to the platform architecture through redesign of complex features based on evolving business needs
  • Influence and establish best engineering practices through solid design decisions, processes and tools
  • Provide technical mentoring to team members

You

  • You have experience with web application development, on both, backend and frontend.
  • You have a solid understanding of software design principles and best practices.
  • You have hands-on experience in,
  • Coding and debugging complex systems, with frontend integration.
  • Code review, responsible for production deployments.
  • Building scalable and fault-tolerant applications.
  • Re-architecting / re-designing complex systems / features (i.e. managing technical debt).
  • Defining and following best practices for frontend and backend systems.
  • You have excellent problem solving skills and are comfortable handling ambiguity.
  • You are able to analyze various alternatives and reach optimal decisions. 
  • You are willing to challenge the status quo, express your opinion and drive change.
  • You are able to plan reasonably complex pieces of work and can handle changing priorities, unknowns and challenges with support. You want to contribute to the platform roadmap, aligning with the organization priorities and goals.
  • You enjoy mentoring others and helping them solve challenging problems.
  • You have excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner. You are able to communicate with various stakeholders to understand their requirements.
  • You are a proponent of quality - building best practices, introducing new processes and improvements to make the team more efficient.

Non-negotiables

Must have

  • Expertise in Backend development (Python & Django experience preferred)
  • Expertise in Frontend development (AngularJS / ReactJS / VueJS experience preferred)
  • Experience working with SQL databases
  • Experience building multiple significant features for web applications

Good to have

  • Experience with Google Cloud Platform (or any cloud platform)
  • Experience working with any Learning Management System (LMS), such as Canvas
  • Experience working with GenAI ecosystem, including usage of AI tools such as code completion
  • Experience with CI/CD pipelines and applications deployed on Kubernetes
  • Experience with refactoring (redesigning complex systems / features, breaking monolith into services)
  • Experience working with NoSQL databases
  • Experience with Web performance optimization, SEO, Gatsby and FE Analytics
  • Delivery skills, specifically planning open ended projects
  • Mentoring skills

Expectations

  • Able to work with open ended problems and come up with efficient solutions
  • Able to communicate effectively with business stakeholders to clarify requirements for small to medium tasks and own end to end delivery
  • Able to communicate estimations, plan deviations and blockers in an efficient and timely manner to all project stakeholders
Read more
Krish Software Services
Bengaluru (Bangalore)
3 - 7 yrs
₹5L - ₹10L / yr
ccsa
ccse
checkpoint
  • Experience: Minimum 3 years
  • Key Skills:
  • Experience with Check Point policy creation, updating, and management.
  • Ability to analyze logs and troubleshoot issues.
  • Expertise in health checks and system optimization.
  • Responsibilities:
  • Define and push Check Point firewall policies.
  • Perform regular health checks and log reviews.
  • Ensure compliance with security best practices.
  • Location: Bangalore
  • Shift: General


 

Read more
KVR WEBTECH PVT LTD
at KVR WEBTECH PVT LTD
1 recruiter
Disha SinghSharma
Posted by Disha SinghSharma
Panchkula, Chandigarh, Ambala, Mohali, Kharar, Banur
1 - 3 yrs
₹1.5L - ₹3.5L / yr
PPC
Search Engine Optimization (SEO)
Link building
Keyword Research
Google Adwords
+1 more
  • Experience managing SEO and affiliate programs.
  • Strong understanding of current online marketing concepts, strategies and best practices.
  • Experience in SEO, Email marketing and social media. Knowledge of SEM Rush tool
  • Experience in a similar digital marketing role.
  • Highly creative with experience in identifying the target audience and devising digital campaigns that engage, inform and motivate.
  • Strong communication skills.
Read more
Market Pulse
at Market Pulse
1 recruiter
Amit Dhakad
Posted by Amit Dhakad
Mumbai
7 - 13 yrs
₹18L - ₹30L / yr
skill iconiOS App Development
skill iconAndroid Development
Mobile App Development
Build apps that challenge your skills & change the way millions invest in stock markets Summary You will be coding, architecting and solving hard problems on android. If you like extreme scale, complexity & speed, then you will love it here. Tech Facts We support over 25000 concurrent users every second and over 1.5 Lac users per day We process over 10000 API calls per minute, in less than 30 ms We transmit over 20 Million messages per minute over Websockets We are a 6-member tech team. Yes! this is all done by this incredible lean team. Who are we We are on a mission to help retail traders prosper in the stock market. In just 3 years, we have the 3rd most popular app for the stock markets in India. And we are aiming to be the de-facto trading app in the next 2 years. We are a young, lean team of ordinary people that is building exceptional products that solve real problems. We love to innovate, thrill customers and work with brilliant & humble humans. Vision, DNA & Future: http://bit.ly/marketpulse-intro Website: http://www.market-pulse.in App Link: https://play.google.com/store/apps/details?id=in.marketpulse Key Objectives for You Build & enhance our core android app Spearhead & build the #1 stock charts on android Architect & code medium to large features on your own Actively participate & contribute to analysis, testing & research Big Challenges for Us and You Everything we do from here is innovation. And that means building, learning & improvising at a rapid pace. Modularising the app into products Enabling faster deployment cycles with automation Building heavily personalised experiences (this one is the toughest mountain to climb) Possible Growth Paths for You Be a Technical Owner for individual products Be a Performance & Security Expert Be an iOS & Android Developer Become a Backend Developer in Elixir, Golang or Ruby A combination of these could be a logical way forward. Perks Challenges that will push you beyond your limits A democratic place where everyone is heard & aware No hierarchy, politics, bosses, managers or anything like that And most importantly, Happy Vibes! How to Apply? If you think this is a great opportunity for you, here’s what you need to do: Apply directly to this posting It would be great if you could mention in brief about why do you think this is a good opportunity for you. If you are think this job is not for you, but would like to talk to us & explore synergies, drop me a line perhaps, have a friend who would love this opportunity, share this link Thanks!
Read more
Iron Systems
at Iron Systems
1 recruiter
Aryman Tyagi
Posted by Aryman Tyagi
Noida
2 - 20 yrs
₹10L - ₹30L / yr
Salesforce
Microsoft Visio
MS-PowerPoint
SAP CRM
Oracle
+2 more
Required Qualifications:


- Experience in onsite functional or technical roles on at least four full-lifecycle CPQ projects, with strong implementation expertise in at least two of the following technologies: Conga CPQ and CLM, Salesforce CPQ & billing, Vlocity CPQ
- Two+ years consulting and/or Lead to- Cash (CPQ/ CLM) implementation experience. Experience managing at least two large-scale full-life cycle implementations of Lead to Cash (CPQ/ CLM) solutions, including ownership of the technical solution, management of the overall team and ownership and management of project financials.
- Deep Understanding of the Lead-To-Cash business process and supporting technologies
- Experience defining systems strategy, road-map, developing process flow diagrams, developing systems requirements, designing and prototyping, testing, training, defining support procedures, and implementing practical business solutions.
- Experience supporting pursuit teams.
- Desire to learn additional in-demand CPQ/CLM platforms 
- Ability to travel up to 50% on average, based on the work you do and the clients and industries/sectors you serve 
- Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
 

Preferred Qualifications:

- A Bachelor’s degree
- Salesforce or Conga CPQ certified
- Ability to work independently and manage multiple task assignments
- Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint)
- Strong problem solving and troubleshooting skills with the ability to exercise mature judgment 
- An advanced degree in the area of specialization
- Experience implementing other CRM platforms (SAP CRM, Oracle, Salesforce.com, Microsoft Dynamics, etc.) or CPQ/CLM technologies (Oracle, Salesforce, Conga, , etc.)
- Proficient in all phases of the Application Development Lifecycle
- Strong technical project management and/or leadership skills
Read more
one of the leading payments bank
one of the leading payments bank
Agency job
Mumbai
4 - 6 yrs
₹9L - ₹18L / yr
skill iconSwift
skill iconObjective C
skill iconiOS App Development
Xcode
Model-View-View-Model (MVVM)
+1 more

Requirements:

  • Design and develop scalable IONIC applications using open source technologies.
  • Develop a hybrid application with IONIC, cordova.
  • Experience in HTML5 CSS, JQuery and Javascript.
  • Experience in hosting application on Appstore.
  • Work as part of an agile team on leading edge technologies.
  • PHP & Apache stack with JavaScript, JQuery.
  • Responsive Web design with HTML5 CSS3 Bootstrap.
  • Social media APIs and third party widgets integration.
  • Web services Integration - JavaScript and XML (Ajax), Representational state transfer (REST), Javascript Object Notation (JSON).
  • End to End Role - Analyze Design, Develop, Deploy, Monitor, Enhance
  • Experience on database systems.

Job Location: Navi Mumbai.
Read more
A firm which works with US clients. Permanent WFH.
A firm which works with US clients. Permanent WFH.
Agency job
via Jobdost by Riya Roy
Remote only
3 - 8 yrs
₹7L - ₹15L / yr
skill iconReact.js
skill iconHTML/CSS
skill iconRedux/Flux
skill iconJavascript

Key aspects of this role:


• Meeting with the development team to discuss user interface ideas and applications.
• Reviewing application requirements and interface designs.
• Identifying web-based user interactions.
• Developing and implementing highly-responsive user interface components using React
concepts.
• Writing application interface codes using JavaScript following React.js workflows.
• Troubleshooting interface software and debugging application codes.
• Developing and implementing front-end architecture to support user interface concepts.
• Monitoring and improving front-end performance.
• Documenting application changes and developing updates.


To be the right fit, you'll need:
• Minimum 4+ years relevant experience in application development and React JS.
• Knowledge of React hooks such that use Context, use Reducer, use Effect.
• Knowledge of React props and state management (both functional and class component)
• Strong understanding of Error boundary concept of react.
• Work experience with any react based UI library or Redux is preferable
• Experience in building cross-browser layouts with CSS and HTML

Read more
Gazing Technosoft Private Limited
Prerna Maurya
Posted by Prerna Maurya
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
0 - 0 yrs
₹1L - ₹2L / yr
Content Writing
Creative Writing
Blogging
Research industry-related topics (combining online sources, interviews, and studies) -Write clear marketing copy of the promotional brands -Prepare well-structured drafts using Content Management Systems -Proofread and edit blog posts before publication -Submit work to editors for input and approval -Coordinate with marketing and design teams to illustrate articles -Conduct simple keyword research and use SEO guidelines to increase web traffic -Promote content on social media -Identify customers’ needs and gaps in our content and recommend new topics -Ensure all-around consistency (style, fonts, images, and tone) -Update website content as needed
Read more
EmptyCup Innovations Pvt Ltd
Sapna Chauhan
Posted by Sapna Chauhan
Bengaluru (Bangalore)
3 - 6 yrs
₹14L - ₹20L / yr
skill iconPython
skill iconJavascript
skill iconReact.js
  • Experience as a full stack developer or similar role.
  • Knowledge of multiple back-end languages is good to have (e.g. Java, Scala, Python, C#, J2EE, Web Services) and JavaScript frameworks (e.g. Angular, React, Node.js)
  • Experience developing desktop and mobile applications and familiarity with common stacks.
  • Experience with large-scale distributed storage and database systems (SQL or NoSQL, e.g. MongoDB/Cassandra/MySQL).
  • Superb communication and collaboration skills.
  • Ability to translate business use cases into good taxonomy design.
  • Demonstrable skills in understanding importance of data design.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos