Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Jaipur
5 - 10 yrs
₹10L - ₹15L / yr
Selenium
Selenium Web driver
Automation
QA

We are looking for a seasoned and results-driven Senior QA Engineer with 5 to 7 years of experience in Manual and Automation Testing. The candidate should have deep expertise in QA processes, strong automation skills using Python or equivalent, and the ability to lead quality initiatives for our core product suite. You won't just be finding bugs — you will be building a resilient quality ecosystem that leverages modern tools.


What You’ll Be Doing:

● Understand business requirements and convert them into test scenarios and test cases

● Perform Manual Testing including Functional, Regression, Integration, & System Testing

● Develop, maintain, and execute Automation Scripts using Python

● Identify, report, and track defects using defect management tools

● Work closely with Developers, Product Managers, and QA team members

● Lead requirement analysis, test planning, and test case reviews

● Contribute to improving QA processes and automation coverage

● Participate in sprint planning, retrospectives, and cross-functional reviews

● Identify, report, and track defects using defect management tools; manage triage and resolution with development teams

● Catch edge cases before they become production issues

● Co-ordination is release processes


Automation Skills:

● Maintain, and extend robust Automation Frameworks ( PyTest / Selenium) for UI and

backend services as well as design patterns, and CI/CD integration

● Monitor nightly automation runs, troubleshoot defects

● Ability to design, extend, debug, and maintain test frameworks independently API and Database Testing:

● Perform contract testing and functional validation of REST APIs using Postman or similar tools.

● Write complex SQL queries to validate data pipelines, migrations


Qualifications:

● Strong understanding of Software Testing concepts

● Experience in writing Test Cases and Test Scenarios

● Experience in Defect Tracking tools (JIRA, etc.)

● Experience in CI/CD tools (Jenkins, GitHub Actions, GitLab CI)

● Experience in Agile / Scrum methodology

● Strong analytical and problem-solving skills with a 'break-it' mentality

● Good communication skills — ability to articulate quality risks to non-technical stakeholders

● Self-motivated, quick learner, and proactive in driving quality culture

● Strong team player with empathy to help developers 'fix-it'

● Exposure to Agentic AI testing frameworks


REPORTING: This position will report to Sr. Project Manager or as assigned by Management.

EMPLOYMENT TYPE: Full-Time, Permanent

LOCATION: Jaipur (Work from Office)

SHIFT TIMINGS: 10:00 AM - 07:00 PM IST

Read more
insurance broking firm
insurance broking firm
Agency job
Kolkata, Hyderabad
2 - 14 yrs
₹7L - ₹9L / yr
insurance broking
insurance broker
insurance brokers

Job Description


We are looking for a driven and client-focused professional to manage and grow a portfolio of SME clients. The role involves understanding client insurance needs, building strong long-term relationships, ensuring smooth service delivery, and driving sales through new business development and cross-selling of relevant insurance and financial products. The candidate will work closely with internal teams to provide excellent customer support and improve client satisfaction and retention.


Key Responsibilities


Manage a portfolio of SME clients and their insurance requirements


Build and maintain strong client relationships


Identify new business opportunities in the SME segment


Achieve sales and revenue targets


Cross-sell insurance and related financial products


Provide prompt support and resolve client queries


Coordinate with internal teams for smooth service delivery


Ensure client retention and satisfaction


Key Skills


SME Client Relationship Management


Insurance Sales


Business Development


Client Retention


Cross Selling


Customer Service


Negotiation Skills


Communication Skills


Portfolio Management


Lead Generation


Sales Target Achievement


Insurance Product Knowledge


Qualifications


Bachelor’s Degree


Experience in insurance sales / SME relationship management preferred

Read more
Masters India Private Limited
at Masters India Private Limited
3 candid answers
2 recruiters
Neha Vidhyarthi
Posted by Neha Vidhyarthi
Noida
6 - 12 yrs
₹20L - ₹40L / yr
skill iconPython
skill iconDjango
FastAPI
RabbitMQ
skill iconPostgreSQL

Sr. Staff Engineer Role


We are looking for a customer-obsessed, analytical Sr. Staff Engineer to lead the development

and growth of our Tax Compliance product suite. In this role, you’ll shape innovative digital

solutions that simplify and automate tax filing, reconciliation, and compliance workflows for

businesses of all sizes. You will join a fast-growing company where you’ll work in a dynamic and

competitive market, impacting how businesses meet their statutory obligations with speed,

accuracy, and confidence.

As the Sr. Staff Engineer, You’ll work closely with product, DevOps, and data teams to architect

reliable systems, drive engineering excellence, and ensure high availability across our platform.

We’re looking for a technical leader who’s not just an expert in building scalable systems, but also

passionate about mentoring engineers and shaping the future of fintech.

Responsibilities

● Lead, mentor, and inspire a high-performing engineering team (or operate as a hands-on

technical lead).

● Drive the design and development of scalable backend services using Python/Node.js.

● Experience in Django, FastApi, Task Orchestration Systems.

● Own and evolve our CI/CD pipelines with Jenkins, ensuring fast, safe, and reliable

deployments.

● Architect and manage infrastructure using AWS and Terraform with a DevOps-first mindset.

● Collaborate cross-functionally with product managers, designers, and compliance experts

to deliver features that make tax compliance seamless for our users.

● Set and enforce engineering best practices, code quality standards, and operational

excellence.

● Stay up-to-date with industry trends and advocate for continuous improvement in

engineering processes.

● Experience in fintech, tax, or compliance industries.

● Familiarity with containerization tools like Docker and orchestration with Kubernetes.

● Background in security, observability, or compliance automation.

Requirements

● 8+ years of software engineering experience, with at least 2+ years in a leadership or

principal-level role.

● Deep expertise in Python/Node.js, including API development, performance optimization,

and testing.

● Experience in Event-driven architecture, kafka/rabbitmq like

● Strong experience with AWS services (e.g., ECS, Lambda, S3, RDS, CloudWatch).

● Solid understanding of Terraform for infrastructure as code.

● Proficiency with Jenkins or similar CI/CD tooling.

● Comfortable balancing technical leadership with hands-on coding and problem-solving.

● Strong communication skills and a collaborative mindset.

Read more
Coimbatore
0 - 5 yrs
₹2.5L - ₹7L / yr
skill iconPython
skill iconC++
skill iconHTML/CSS
skill iconJavascript
Big Data
+2 more

A Computer Scientist/Engineer designs, develops, tests, and integrates computer software and hardware systems. This pivotal role blends deep knowledge of computer architecture with advanced software engineering—driving innovation in platforms spanning from embedded systems and networks to AI and cybersecurity

Read more
Greyblue Ventures
Shabina Khan
Posted by Shabina Khan
Gurugram
2 - 5 yrs
₹8L - ₹12L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+3 more

Key Responsibilities: 

  • Develop and Maintain CI/CD Pipelines: Design, implement, and manage CI/CD pipelines using GitOps practices. 
  • Kubernetes Management: Deploy, manage, and troubleshoot Kubernetes clusters to ensure high availability and scalability of applications. 
  • Cloud Infrastructure: Design, deploy, and manage cloud infrastructure on AWS, utilizing services such as EC2, S3, RDS, Lambda, and others. 
  • Infrastructure as Code: Implement and manage infrastructure using IaC tools like Terraform, CloudFormation, or similar. 
  • Monitoring and Logging: Set up and manage monitoring, logging, and alerting systems to ensure the health and performance of the infrastructure. 
  • Automation: Identify and automate repetitive tasks to improve efficiency and reliability. 
  • Security: Implement security best practices and ensure compliance with industry standards. 
  • Collaboration: Work closely with development, QA, and operations teams to ensure seamless integration and delivery of products. 

Required Skills and Qualifications: 

  • Experience: 2-5 years of experience in a DevOps role. 
  • AWS: In-depth knowledge of AWS services and solutions. 
  • CI/CD Tools: Experience with CI/CD tools such as Jenkins, GitLab CI, CircleCI, or similar. 
  • GitOps Expertise: Proficient in GitOps methodologies and tools. 
  • Kubernetes: Strong hands-on experience with Kubernetes and container orchestration. 
  • Scripting and Automation: Proficient in scripting languages such as Bash, Python, or similar. 
  • Infrastructure as Code (IaC): Hands-on experience with IaC tools like Terraform, CloudFormation, or similar. 
  • Monitoring Tools: Familiarity with monitoring and logging tools like Prometheus, Grafana, ELK stack, or similar. 
  • Version Control: Strong understanding of version control systems, primarily Git. 
  • Problem-Solving: Excellent problem-solving and debugging skills. 
  • Collaboration: Ability to work in a fast-paced, collaborative environment. 
  • Education: Bachelor’s or master’s degree in computer science or a related field. 


Read more
Innominds Software
at Innominds Software
4 recruiters
Hidayath Recrutier
Posted by Hidayath Recrutier
Bengaluru (Bangalore), Hyderabad, Pune
3 - 12 yrs
₹4L - ₹19L / yr
skill iconHTML/CSS
skill iconBootstrap
skill iconReact.js
skill iconAngular (2+)

Please find below JD

  • 4 -10 years' experience in Frontend technologies
  • Strong core JavaScript with ES6, ES5, ES7
  • Proficient in React.JS with minimum 2 years of experience
  • Proficient in HTML5, CSS3
  • Proficient in Grunt, Gulp and Webpack, bower, yarn, module loader
  • Hands on experience with multiple library/frameworks - jQuery, Jasmine, Mocha, etc.
  • Unit testing / E2E testing is necessary.
  • Expert level understanding of HTTP protocols (1.0, 1.1, and 2.0) and WebSockets and JS WebSocket
  • Experience with working on SaaS/PaaS based applications.
  • Good analytical and problem-solving skills.
  • Upbeat, highly motivated, and self-starter & Strong communication skills.

 Company profile: https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.innominds.com%2F&;data=04%7C01%7C%7Cbfa37f316b0142ee45e008d91a9266fd%7C4643991463b7464e83279b13737ae8cf%7C1%7C0%7C637570038501362488%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=mX05qphV6hkETXRm1DLlYLCNbkGAuwQ37P3%2BsQFwBpE%3D&reserved=0">www.innominds.com    

Do share below details to proceed further:

CTC:    

ECTC:    

NP:    

Work Location: Bangalore / Hyderabad  / Pune

Relevant experience in JavaScript, React / Angular:   

Read more
Disruptive Digital Healthcare Platform
Disruptive Digital Healthcare Platform
Agency job
via Unnati by Veena Salian
Bengaluru (Bangalore)
3 - 6 yrs
₹12L - ₹15L / yr
skill iconAndroid Development
Android Developer
skill iconJava
skill iconKotlin
Are you a high-performing, collaborative, results oriented and technologically savvy person who is keen on sales in the digital industry? Then this highly visible role is for you!

Our client is the Health-tech initiative of India's largest business house. Started in 2015, it empowers healthcare providers and consumers in India. All healthcare monitoring services are made available through an app that will help connect doctors, hospitals, pharmacies, laboratories and consumers, enabling preventive and predictive healthcare. It helps the care-givers to track the entire patient journey from the initial appointment and maintaining their records, generating lab test reports to providing virtual consultation and home-care solutions. It is expected that this futuristic guide will strengthen doctor-patient relationship and enhance the in-clinic experience.

As an Android Developer, you will be responsible for developing flexible and well-structured mobile products on Android platform.

What you will do:
  • Designing the Mobile Application for our product offering
  • Communicating effectively in a cross-functional product development team and present ideas and designs effectively.
  • Identifying and correcting bottlenecks and fixing bugs
  • Helping maintain code quality, organization, and automatization
Candidate Profile:

What you need to have:

  • Should have proven experience with designing and building advanced
    application features for the Android platform    
  • Should have proficient understanding of Android Concepts
  • Should have proven experience with Kotlin
  • Should have proven experience with RxJava, MVP, MVVM, Dependency Injection and Android Architecture Components    
  • Should have proficient understanding of Android tools like Android Studio
    and Gradle build system    
  • Should have proven experience with Kotlin
  • Should have proven experience with RxJava, MVP, MVVM, Dependency Injection and Android Architecture Components    
  • Should have proficient understanding of Android tools like Android Studio
    and Gradle build system   
  • Should have proven experience with REST API(JSON) endpoints using Retrofit 
  • Should have proficient understanding of code versioning tools, such as Git or
    SVN      
  • Should have excellent problem-solving skills
Desired Attributes
  • Excellent interpersonal skills and the ability to build good working relationships.
  • Must be self-motivated to prioritize and manage workload and meet critical project milestones and deadlines.
  • Able to effectively collaborate with a team as well as take initiative and work independently to solve problems
  • Should have min 65% in B.E./ B.Tech/ M.Tech
Read more
Talentbase 360
at Talentbase 360
1 recruiter
Sindhuja P
Posted by Sindhuja P
Guindy, Chennai
3 - 8 yrs
₹1L - ₹11L / yr
skill icon.NET
ASP.NET
ASP.NET MVC
Windows Communication Foundation (WCF)
Entity Framework
+2 more
Experience : 3 to 8
Role : Software engineer/Senior software engineer
Location : Chennai.

Job Description:
Experience in developing Web Applications using ASP.NET.
Strong experience in C#,MVC,WCF,Entity framework,LINQ.
Experience in working with Microsoft SQL Server.

Regards,
Sindhuja P

Read more
Peachmode
at Peachmode
1 recruiter
Pooja Singh
Posted by Pooja Singh
Mumbai
3 - 7 yrs
₹3L - ₹5L / yr
skill iconAdobe Illustrator
Graphic Designing
Adobe Photoshop
Digital media
Print design
Job Description: Conceptualize visuals based on requirements Prepare rough drafts and present ideas Develop illustrations, logos and other designs using software or by hand Work closely with copywriters and creative director Desired Candidature: Strong portfolio of illustrations/other graphics Familiarity with design software and technologies (such as InDesign, Illustrator, Dreamweaver, Photoshop) Excellent communication skills Ability to work methodically and meet deadlines.
Read more
Dani Investment Serrvices
Himanshu Dani
Posted by Himanshu Dani
Mumbai
0 - 2 yrs
₹3L - ₹6L / yr
Familiar with Stock Market and well versed with excel
MS-Excel
MS-PowerPoint
work closely with a team of finance professionals and have passion for quantitative and finance in stock markets
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos