Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

NeoGenCode Technologies Pvt Ltd
Pune
5 - 8 yrs
₹7L - ₹11L / yr
skill iconPython
Celery
RESTful APIs
Multithreading
Encryption
+6 more

Job Title : Senior Python Developer – Product Engineering

Experience : 5 to 8 Years

Location : Pune, India (Hybrid – 3-4 days WFO, 1-2 days WFH)

Employment Type : Full-time

Commitment : Minimum 3 years (with end-of-term bonus)

Openings : 2 positions

  • Junior : 3 to 5 Years
  • Senior : 5 to 8 Years

Mandatory Skills : Python 3.x, REST APIs, multithreading, Celery, encryption (OpenSSL/cryptography.io), PostgreSQL/Redis, Docker/K8s, secure coding


Nice to Have : Experience with EFSS/DRM/DLP platforms, delta sync, file systems, LDAP/AD/SIEM integrations


🎯 Roles & Responsibilities :

  • Design and develop backend services for DRM enforcement, file synchronization, and endpoint telemetry.
  • Build scalable Python-based APIs interacting with file systems, agents, and enterprise infra.
  • Implement encryption workflows, secure file handling, delta sync, and file versioning.
  • Integrate with 3rd-party platforms: LDAP, AD, DLP, CASB, SIEM.
  • Collaborate with DevOps to ensure high availability and performance of hybrid deployments.
  • Participate in code reviews, architectural discussions, and mentor junior developers.
  • Troubleshoot production issues and continuously optimize performance.

✅ Required Skills :

  • 5 to 8 years of hands-on experience in Python 3.x development.
  • Expertise in REST APIs, Celery, multithreading, and file I/O.
  • Proficient in encryption libraries (OpenSSL, cryptography.io) and secure coding.
  • Experience with PostgreSQL, Redis, SQLite, and Linux internals.
  • Strong command over Docker, Kubernetes, CI/CD, and Git workflows.
  • Ability to write clean, testable, and scalable code in production environments.

➕ Preferred Skills :

  • Background in DRM, EFSS, DLP, or enterprise security platforms.
  • Familiarity with file diffing, watermarking, or agent-based tools.
  • Knowledge of compliance frameworks (GDPR, DPDP, RBI-CSF) is a plus.
Read more
Avalon Solution
Prasanna Rode
Posted by Prasanna Rode
Indore, Madhya Pradesh
1 - 2 yrs
₹2.5L - ₹3.6L / yr
Project coordination
Communication Skills
Shopify

Job Title: PROJECT COORDINATOR

 

Job Type - Full Time

 

Location – Indore

 

Summary/Objective:

The primary objective of hiring a Project Coordinator is to efficiently manage customer data, oversee project development, and ensure the successful deployment of websites. The role involves collaborating with various teams, handling customer feedback, and maintaining high-quality website deliverables.

 

Responsibilities/Duties:

 

1.   Customer Data and Project Management:

 

·        Effectively manage customer data and all the related information.

·        Ensure accurate documentation and organization of work flow details.

·        Collaborate with the Design team for creating mockups and visuals.

·        Communicate design concepts and seek customer approval via email correspondence.

 

2.   Development and Progress Tracking:

 

·        Liaise with the Development team to facilitate smooth task flow.

·        Monitor and track work progress, ensuring adherence to timelines.

·        Verify websites to ensure alignment with customer requirements.

 

3.   Testing and Quality Assurance:

 

·        Coordinate with the Testing Department to assess task status and identify bugs.

·        Collaborate with team members to address and resolve identified issues.

·        Ensure rigorous testing to maintain high-quality website deliverables.

 

4.   Customer Engagement and Feedback:

 

·        Deliver beta versions of websites to customers for review and feedback.

·        Collaborate with team members to implement customer-suggested changes to beta websites.

·        Act as a point of contact for customer feedback and promptly address their concerns.

·        Need to communicate with customers over email for their concerns and changes

 

5.   Website Deployment and Live Process:

 

·        Manage the transition from beta to live website by following customer approvals.

·        Oversee the live website deployment process, ensuring a seamless transition.

·        Implement customer-requested changes post-approval, ensuring a polished final product.

 

6. Product Management:

 

·        Effectively manage and Upload customer and vendor product information.

·        Collaborate with the team to ensure accurate representation of products on the website.

·        Update and maintain product details to provide up-to-date information to customers.

 

7. Website Maintenance and Continuous Improvement:

 

·        Facilitate day-to-day website changes and improvements to enhance user experience.

·        Proactively identify opportunities for website optimization and suggest improvements.

 

Qualifications/Requirements:

 

Education:

·        Graduate/ Post Graduate.

·        Good to have IT background.

 

Experience:

·        2 to 3 years of experience as a Project Coordinator role.

·        Experience in IT sector is must.

 

Skills:

·        Clearly articulate ideas and project requirements.

·        Foster open and transparent communication within the project team.

·        Prioritize tasks and manage time efficiently.

·        Handle multiple tasks simultaneously without compromising quality.

·        Be proactive in identifying potential problems and addressing them promptly.

·        Navigate unforeseen challenges with flexibility and resilience.

·        Ensure accuracy in project documentation and data management.

 

Read more
Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Bengaluru (Bangalore)
2 - 5 yrs
₹8L - ₹10L / yr
Strong Angular Developer Profiles Mandatory (Experience 1) – Must have...
  • Strong Angular Developer Profiles
  • Mandatory (Experience 1) – Must have 2+ years of experience in frontend development using Angular 8 or above.
  • Mandatory (Experience 2) – Must have strong proficiency in JavaScript, TypeScript, HTML5, and CSS3.
  • Mandatory (Experience 3) – Must have experience in UI development with Bootstrap and building responsive pages.

Preferred

  • Preferred (Company) - Product Companies
  • Preferred (Education) – B.E./B.Tech or M.E./M.Tech in Computer Science (or related).
  • Preferred (Experience) – Experience with .NET Core for backend integration


Read more
Indian Based IT Service Organization
Indian Based IT Service Organization
Agency job
via People First Consultants by Aishwarya KA
Chennai, Tirunelveli
5 - 7 yrs
Best in industry
PySpark
Data engineering
Big Data
Hadoop
Spark
+7 more

Greetings!!!!


We are looking for a data engineer for one of our premium clients for their Chennai and Tirunelveli location


Required Education/Experience


● Bachelor’s degree in computer Science or related field

● 5-7 years’ experience in the following:

● Snowflake, Databricks management,

● Python and AWS Lambda

● Scala and/or Java

● Data integration service, SQL and Extract Transform Load (ELT)

● Azure or AWS for development and deployment

● Jira or similar tool during SDLC

● Experience managing codebase using Code repository in Git/GitHub or Bitbucket

● Experience working with a data warehouse.

● Familiarity with structured and semi-structured data formats including JSON, Avro, ORC, Parquet, or XML

● Exposure to working in an agile work environment


Read more
FPL Technologies Pvt Ltd
at FPL Technologies Pvt Ltd
8 recruiters
Darshana Kulkarni
Posted by Darshana Kulkarni
Pune, Mumbai
4 - 6 yrs
Best in industry
Product Management
Product Manager
Product Strategy
Mobile applications

Sr. Product Manager at OneCard 


At Onecard, we're re-imagining the credit card for a new generation of users. Product development is an extremely collaborative effort between engineering, design, and customer-facing teams. You’d be joining a small team of experienced Product Managers who have helped build successful products at companies such as Gaana, Walnut, ICICI Bank among others. 



YOU MAY BE A GOOD FIT IF:

  • You can think in terms of the big picture, but deliver on the details
  • You observe users and talk to them to get insights for building products. 
  • You have a nose for great products, and advocate for new features with qualitative and quantitative reasoning
  • You do whatever it takes to make your product and team successful, whether that means writing a QA plan or hunting down the root cause of a user’s frustration. This is very important as we're rapidly growing. 
  • You can turn incomplete, conflicting, or ambiguous inputs into solid action plans
  • You communicate with empathy and exceptional precision
  • You are technical enough to ask engineers good questions about architecture and product decisions alike
  • Beyond just shipping new products, you obsess about continuous product improvement


REQUIREMENTS

  • You’ve spent at least 3 years in product management, especially working on mobile apps. 
  • You’ve built something with 100k+ users in a consumer facing application. If you've built something on your own - a blog or a website, please send us a link. 
  • You’ve worked with design teams and software like Figma/Zeplin/Balsamiq. 
  • Experience in Fintech and gaming is preferred. Especially working on reward programs. 


You’ve built something with 100k+ users in a consumer facing application. If you've built something on your own - a blog or a website, please send us a link. 



YOU SHOULD INCLUDE THESE IN YOUR APPLICATION:


A few words on...

  • Why you’re interested in being a product manager at OneCard in particular
  • The product you are most proud of shipping, and your role in its development
  • The biggest product mistake you’ve made (we all have them!)
Read more
Signio GlobalTech
Sneha Kurri
Posted by Sneha Kurri
Hyderabad
3 - 7 yrs
₹7L - ₹20L / yr
AUTOSAR
Embedded Systems
Automotive
Diagnostics
CAN
+2 more
1) Strong Programming Experience in Embedded and Embedded C.

2) Experience in protocols like UDS and CAN.

3) Experience in AUTOSAR(COM, DCM and MCAL).

4) Experience in CANoe and CAN analyzer tools.

5) Experience in Compiler and Debugging.

6) Experience in using Configuration Management.

7) Knowledge and experience in Rational Rhapsody would be advantageous.

Additional Skills:

1) Good analytical & communication skills.

2) Willingness to take up responsibility & ownership.

3) Self-learning & Self-motivated with a good learning curve.

4) Adaptive & Flexible to challenging situations.
Read more
Monarch Tractor
Monarch Tractor
Agency job
Remote only
3 - 5 yrs
₹5L - ₹10L / yr
Linux/Unix
skill iconPython
skill iconGit
Algorithms
Robot Framework
+1 more

 

Job Description:

  1. Design, implement and deliver custom solutions using the existing robotics framework.
  2. Debug issues, do root-cause analysis and apply fixes.
  3. Design and implement tools to facilitate application development and testing.
  4. Participate in architectural improvements.
  5. Work with team members in deployment and field testing.

 

Requirements:

  1. Bachelor Degree / Masters in Engineering (ECE or CSE preferred)
  2. Work experience of 3+ years in software programming.
  3. Proficiency in Python programming for Linux based systems.
  4. Full understanding of software engineering.
  5. Basic Knowledge of Robot Operating System(ROS) is a plus.
  6. Good understanding of the algorithms and control loops.
  7. Working knowledge of Git: creating, merging branches, cherry-picking commits, examining the diff between two hashes. Advanced Git usage is a plus.
  8. Knowledge of video streaming from edge devices is a plus.
  9. Thrive in a fast-paced environment and have the ability to own the project’s tasks end-to-end with minimum hand-holding
  10. Learn and adapt new technologies & skills. Work on projects independently with timely delivery & defect free approach.
Read more
Global Banking Client
Global Banking Client
Agency job
Pune
12 - 17 yrs
₹46L - ₹48L / yr
skill iconJava
skill iconSpring Boot
Microservices

The Solution Architect plays a critical role in the architecture design and development of globally consistent Liquidity and Cash Management solutions and is a key contributor to the overall delivery in a fast-paced and challenging environment.

Responsibilities:

  • Develops technology road maps, while keeping up-to-date with emerging technologies, and recommends business directions based on these technologies
  • Provides technical leadership and is responsible for developing components of, or the overall systems design.
  • Translates complex business problems into sound technical solutions.
  • Provides integrated systems planning and recommends innovative technologies that will enhance the current system.
  • Contribute to ongoing architecture governance and reviewing proposed solutions.
  • Lead integration of new and existing components with ICG Platforms.


Qualifications:

  • 10+ years relevant experience
  • Experience as Full-Stack Developer and Experience as Architect Desired
  • Understanding of integration technologies concepts like Webservices, REST API etc
  • Familiar with DevOps tools like Maven, Jenkins, Bitbucket etc
  • Consistently demonstrates clear and concise written and verbal communication
  • Management and prioritization skills
  • Ability to develop working relationships
  • Ability to manage multiple activities and changing priorities
  •  


Education:

  • Bachelor’s/University degree or equivalent experience, potentially Masters degree

 

 

 

Read more
Presidency University
at Presidency University
1 recruiter
Dinesh Dorai
Posted by Dinesh Dorai
Bengaluru (Bangalore)
1 - 5 yrs
₹3.5L - ₹5L / yr
Business Analysis
business analyst
BRD
FRD
SRS

Job Description

We are hiring a Business Analyst to join our project team. You will work alongside other business analysts and report directly to the project manager. Your main tasks will include performing detailed requirements analysis, documenting processes, and performing some user acceptance testing. To succeed in this role, you should have a natural analytical way of thinking and be able to explain difficult concepts to non-technical users.

Business Analyst Responsibilities:

  • Evaluating business processes, anticipating requirements, uncovering areas for improvement, and developing and implementing solutions.
  • Leading ongoing reviews of business processes and developing optimization strategies.
  • Staying up-to-date on the latest process and IT advancements to automate and modernize systems.
  • Conducting meetings and presentations to share ideas and findings.
  • Performing requirements analysis.
  • Documenting and communicating the results of your efforts.
  • Effectively communicating your insights and plans to cross-functional team members and management.
  • Gathering critical information from meetings with various stakeholders and producing useful reports.
  • Working closely with clients, technicians, and managerial staff.
  • Providing leadership, training, coaching, and guidance to junior staff.
  • Allocating resources and maintaining cost efficiency.
  • Ensuring solutions meet business needs and requirements.
  • Performing user acceptance testing.
  • Managing projects, developing project plans, and monitoring performance.
  • Updating, implementing and maintaining procedures.
  • Prioritizing initiatives based on business needs and requirements.
  • Serving as a liaison between stakeholders and users.
  • Managing competing resources and priorities.
  • Monitoring deliverables and ensuring timely completion of projects.

Business Analyst Requirements:

  • A bachelor’s degree in business or related field or an MBA.
  • A minimum of 2 years’ experience in business analysis or a related field.
  • Exceptional analytical and conceptual thinking skills.
  • The ability to influence stakeholders and work closely with them to determine acceptable solutions.
  • Advanced technical skills.
  • Excellent documentation skills.
  • Fundamental analytical and conceptual thinking skills.
  • Experience creating detailed reports and giving presentations.
  • Competency in Microsoft applications including Word, Excel, and Outlook.
  • A track record of following through on commitments.
  • Excellent planning, organizational, and time management skills.
  • Experience leading and developing top performing teams.
  • A history of leading and supporting successful projects.

 

 

Read more
CENITPRO
at CENITPRO
1 recruiter
Rumela Sarkar
Posted by Rumela Sarkar
Kolkata
1 - 2 yrs
₹2L - ₹4L / yr
Communication Skills
Back office
System Administration
We are hiring for Back Office Executive. The candidate should have fundamental learning of computer and help the other employees on their necessary job roles and responsibilities.

Job Description :

Only Female candidates are eligible
Qualification: Graduation
Age: Around 30 years.
Minimum 6 months to 1 year of experience in the related field is essential.
Having good exposure over Ms-Office.
Need administrative and organizational abilities.
Need to have excellent written and oral communication in English.
Intercultural sensitivity and multitasking capacity.
Readiness to take initiative and to solve problems.
Sociable, self-motivated and initiative taker.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos