Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

mazosol
kirthick murali
Posted by kirthick murali
Chennai
5 - 12 yrs
₹15L - ₹26L / yr
Salesforce
Salesforce.com
Salesforce Lightning
Test Automation (QA)

Job Summary:

We are seeking an experienced and motivated QA Lead with a strong background in testing Salesforce applications. This is a hands-on role requiring 90% manual testing while leading and mentoring a team of Senior QA Engineers. We are specifically looking for candidates who are currently not employed or serving their notice period and can join our team on or before feb 17th.

  • Key Responsibilities:Hands-on Testing (90%)Design, execute, and manage comprehensive manual test cases for Salesforce applications, including Sales Cloud, Service Cloud, Experience Cloud, and Lightning components.
  • Conduct end-to-end testing of Salesforce-specific features, integrations, and customizations.
  • Identify, document, and track defects, ensuring their timely resolution and thorough testing coverage.
  • Team Leadership (10%)Lead, mentor, and inspire a team of Senior QA Engineers.
  • Foster a collaborative and high-performing team environment while encouraging skill development.
  • Provide technical guidance and problem-solving strategies to team members.
  • Quality Assurance StrategyDefine and implement QA strategies tailored to Salesforce applications.
  • Develop and monitor QA metrics to assess quality and performance.
  • Collaborate with development and business teams to align on QA objectives.
  • Optional Automation InitiativesDesign and implement automation frameworks for Salesforce testing using tools like Selenium, Provar, or similar (if applicable).
  • Enhance testing efficiency through the adoption of automation strategies.
  • Process ImprovementIdentify inefficiencies in QA processes and recommend improvements.
  • Advocate for best practices, including regression and performance testing.
  • Collaboration and CommunicationWork closely with cross-functional teams, including development, product management, and stakeholders.
  • Provide clear updates on testing progress, risks, and resolutions.
  • DocumentationMaintain comprehensive documentation, including test plans, test cases, and bug reports.
  • Ensure adherence to QA standards and processes.
  • Qualifications:Education:Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience:7+ years of QA experience, with at least 2 years in a leadership role.
  • Extensive experience testing Salesforce applications (Sales Cloud, Service Cloud, Experience Cloud, etc.).
  • Proven ability to manage QA teams and drive quality strategies.
  • Skills:Strong expertise in manual testing (90% hands-on work required).
  • Familiarity with Salesforce development lifecycle and release management processes.
  • Proficiency in test management tools like Azure DevOps, JIRA, or similar.
  • Excellent problem-solving, analytical, and communication skills.
  • Bonus Skills:Experience with automation frameworks like Selenium or Provar.
  • Salesforce Administrator or QA-related certifications.

Important Note:

We are only considering candidates who are currently not working or serving their notice period and can join immediately, on or before feb 27th.

  • Why Join Us?This is a unique opportunity for a hands-on QA Lead who is passionate about ensuring the quality and reliability of Salesforce solutions. You will play a crucial role in driving the success of our Salesforce-based projects while fostering a high-performance QA team


Read more
Credilio Financial Technologies Pvt. Ltd.
Mumbai
2 - 6 yrs
₹7L - ₹12L / yr
skill iconNodeJS (Node.js)
TypeScript
skill iconPostgreSQL
LoopBack Framework
es6
+3 more

Responsibilities

  • Build reusable code and libraries for future use.
  • Writing reusable, testable, and efficient code
  • Own & build new modules/features end-to-end independently.
  • Collaborate with other team members and stakeholders.
  • Work in an agile environment to rapidly build high-quality and robust features.
  • Participate in DevOps.
  • Implementation of security and data protection.


Required Skills

  • Master in Node.js and frameworks available for it. (Nest.js / Loopback / AdonisJS)
  • Excellent understanding of ES6 and OOP.
  • Good understanding of SQL & No-SQL Databases. (MySQL / PostgreSQL)
  • Understanding the nature of asynchronous programming and its quirks and workarounds.
  • Open Source and DevOps enthusiast.
  • Comfortable with Test Driven Development.
  • Can learn and adapt fast, as well as identify and solve problems.


Bonus Skills

  • Hands-on with TypeScript


Job Perks

  • Get to work with a highly passionate team of engineers.
  • Open and embracing culture towards the latest hot technologies.
  • A high level of freedom & responsibility.


Read more
Someshwara Software
Bengaluru (Bangalore)
2 - 3 yrs
₹4L - ₹7L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+3 more

Position Overview: We are seeking a talented and experienced Cloud Engineer specialized in AWS cloud services to join our dynamic team. The ideal candidate will have a strong background in AWS infrastructure and services, including EC2, Elastic Load Balancing (ELB), Auto Scaling, S3, VPC, RDS, CloudFormation, CloudFront, Route 53, AWS Certificate Manager (ACM), and Terraform for Infrastructure as Code (IaC). Experience with other AWS services is a plus.


Responsibilities:

• Design, deploy, and maintain AWS infrastructure solutions, ensuring scalability, reliability, and security.

• Configure and manage EC2 instances to meet application requirements.

• Implement and manage Elastic Load Balancers (ELB) to distribute incoming traffic across multiple instances.

• Set up and manage AWS Auto Scaling to dynamically adjust resources based on demand.

• Configure and maintain VPCs, including subnets, route tables, and security groups, to control network traffic.

• Deploy and manage AWS CloudFormation and Terraform templates to automate infrastructure provisioning using Infrastructure as Code (IaC) principles.

• Implement and monitor S3 storage solutions for secure and scalable data storage

• Set up and manage CloudFront distributions for content delivery with low latency and high transfer speeds.

• Configure Route 53 for domain management, DNS routing, and failover configurations.

• Manage AWS Certificate Manager (ACM) for provisioning, managing, and deploying SSL/TLS certificates.

• Collaborate with cross-functional teams to understand business requirements and provide effective cloud solutions.

• Stay updated with the latest AWS technologies and best practices to drive continuous improvement.



Qualifications:

• Bachelor's degree in computer science, Information Technology, or a related field.

• Minimum of 2 years of relevant experience in designing, deploying, and managing AWS cloud solutions.

• Strong proficiency in AWS services such as EC2, ELB, Auto Scaling, VPC, S3, RDS, and CloudFormation.

• Experience with other AWS services such as Lambda, ECS, EKS, and DynamoDB is a plus.

• Solid understanding of cloud computing principles, including IaaS, PaaS, and SaaS.

• Excellent problem-solving skills and the ability to troubleshoot complex issues in a cloud environment.

• Strong communication skills with the ability to collaborate effectively with cross-functional teams.

• Relevant AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified DevOps Engineer, etc.) are highly desirable.


Additional Information:

• We value creativity, innovation, and a proactive approach to problem-solving.

• We offer a collaborative and supportive work environment where your ideas and contributions are valued.

• Opportunities for professional growth and development. Someshwara Software Pvt Ltd is an equal opportunity employer.


We celebrate diversity and are dedicated to creating an inclusive environment for all employees.

 

Read more
Futurenet Technologies
Chennai
0 - 4 yrs
₹1.8L - ₹6L / yr
Business Development
New business development
Sales
Field Sales
Communication Skills
+1 more

Role: Sales Executive / Business Development Executive

To sell digital transformation solutions to corporates.

Responsibilities

 To achieve targets

 Identify and expand business to corporates.

 Learn new technologies, understand, and position the same to corporates.

 Account mapping and relationship building

Qualifications / Skills

 Any Management studies

Other Competence

 Selling skills

 Negotiating skills

 Good communication skills

Read more
Clickpost
at Clickpost
2 recruiters
Ridhi  Dhariwal
Posted by Ridhi Dhariwal
Remote only
2 - 5 yrs
₹4L - ₹10L / yr
SaaS
Customer Success
client onboarding
Onboarding
 an onboarding  Manager, you are the link between our customers and the product. You will :- Work with a wide variety of clients across the Ecommerce Industry and analyze/understand customer needs and translate them into the best possible Clickpost solution.- Respect project deadlines and keep track in order to deliver an outstanding customer experience.- Be responsible for your own portfolio of clients and engage with them from the onboarding until the go-live.- Work closely with our sales, product team, and tech team to ensure the best customer journey and aid product design and development.- Help our clients get the most out of Clickpost by providing training, demos, support, and reduce churns. About You :You are a proactive person with both commercial and analytical skills. You also :- Have excellent communication skills, and are comfortable speaking to stakeholders at different levels - from Product managers to CTOs;- Have Project management skills;- Have a Bachelor’s/Master’s degree;- Are flexible & self-structured with the ability to shift gears quickly and efficiently;- Are as excited about technology as we are;- Are able to communicate efficiently with developers and Product Managers;- Having experience in a similar position, in Startups or in Saas Company is a plus
Read more
Dunya Labs
at Dunya Labs
2 recruiters
Muralidhar BS
Posted by Muralidhar BS
Bengaluru (Bangalore)
7 - 10 yrs
₹15L - ₹20L / yr
skill iconC++
Oracle NoSQL Database
Pro*C
- Must have 7+ years of C++ Development experience - For Financial Institutions (Banks) - preferably trading systems - Must have developed C++ applications which talked to Oracle Database - Must have 4+ years of experience in Pro*C code with C++ - Must understand how to Make files work to build applications - Maths marks must be > 85% or 90th Percentile from 12th grade - Must be really intelligent - Must have great English skills and team leader - Must be 100% hands-on and loves coding
Read more
Koo App
at Koo App
2 recruiters
Agency job
via zyoin by RAKESH RANJAN
Bengaluru (Bangalore)
3 - 9 yrs
₹14L - ₹55L / yr
skill iconAndroid Development
skill iconKotlin
skill iconFlutter
1. Work Experience between 3+  years in mobile applications with desire to work in fast paced startups
2. Worked on Android applications from scratch. Exposure to audio video content based applications is
preferred.
3. Up to date on upcoming trends in android and its ecosystem.
4. Sound knowledge about application performance tuning on all parameters like network utilization,
application size and battery usage.
5. Experience with dagger, retrofit, rx-android, android architecture components etc.
6. Hands on experience with test driven development, mock frameworks, modular code design and popular design patterns.
Read more
Brighter Bee Technologies
Pratik Dalvi
Posted by Pratik Dalvi
Nashik
1 - 2 yrs
₹6L - ₹8.5L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
  1. Good experience in react components, hooks and state.
  2. Experiences in the implementation of responsive web layouts
  3. Ability to discuss and explain design options.
  4. Good experience with HTML5 & CSS3, Bootstrap Good understanding of JavaScript.
  5. JavaScript libraries and CSS frameworks are preferred.
Read more
Santbay Technologies
at Santbay Technologies
1 recruiter
Sandhya Vasu
Posted by Sandhya Vasu
Cochin
0 - 2 yrs
₹1L - ₹2L / yr
Business Development
Client Servicing
Sales
Presales
Salesforce

Job Description – Business Development Executive

Roles & Responsibilities:

 

  1. ·       Identifying quality lead and bringing up the projects for the company through different online platforms
  2. ·       Bidding on various portals like PPH/ GURU/ UPWORK / Freelancer and other relevant online platforms
  3. ·       Handle the initial discussions and collect the strategic information about the prospects
  4. ·       Understand complex project requirements and prepare proposal /bid to generate leads
  5. ·       Continue prospect engagement and account management throughout the sales cycle until closure.
  6. ·       Independently collaborate with the technical team for presentation with prospects.
  7. ·       Scout for new bidding platforms and websites to catch out the opportunities.
  8.  
  9. Skill & Experience Required
  10. ·       Excellent verbal and written communication skills, capable of converting the prospect with good linguistic ability.
  11. ·       Must have 1-3 years of experience in Web Development & Mobile Apps project acquisition and closure through the online bidding platforms.
  12. ·       Experience with lead generation and prospect management via various online platforms.
  13. ·       Must have sound technical knowledge of advanced Web and Mobile technologies trending today.
  14. ·       Lead generation through LinkedIn, database, and other social networks.
  15. ·       Ability to handle the sales independently or as part of a team
  16.  
  17. Education: Degree/ any diploma
Read more
Insurance Samadhan
at Insurance Samadhan
1 recruiter
Ravi Mathur
Posted by Ravi Mathur
NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹6L - ₹9L / yr
skill iconNodeJS (Node.js)
Angular
MEAN stack
skill iconAngular (2+)
Building interactive consumer data from multiple systems and RESTfully abstract to the UI through a Node.js backend
Define code architecture decisions to support a high-performance and scalable product with a minimal footprint.
Collaborate well with engineers, researchers, and data implementation specialists to design and create advanced, elegant and efficient systems.
Experience implementing applications using Angular.
Experience creating front end applications using HTML5, Angular
Hands-on experience with JavaScript Development on both client and server-side
Experience with modern frameworks and design patterns

Knowledge of the following will be considered as an advantage:
Consumer Web Development Experience for High-Traffic, Public Facing web applications
Experience with cloud technologies also a plus
Creating secure RESTful-based web services in XML and JSON, Javascript, JQuery
Version control (SVN, Git).
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos