Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Bengaluru (Bangalore)
3 - 5 yrs
₹20L - ₹30L / yr
Google Cloud Platform (GCP)
Strong Senior Unity Developer Profile Mandatory (Experience 1) - Must...
  • Strong Senior Unity Developer Profile
  • Mandatory (Experience 1) - Must have a minimum 2+ years of experience in game/application development using Unity.
  • Mandatory (Experience 2) - Must have strong experience in backend development using C#
  • Mandatory (Experience 3) - Must have strong experience in multiplayer game development with Unity, preferably using Photon Networking (PUN) or Photon Fusion.
  • Mandatory (Company) - B2C Product Companies

Preferred

  • Preferred (Education) - B.E / B.Tech


Read more
SR UNIVERSE TECH
Salem
0 - 1 yrs
₹1L - ₹1.4L / yr
Communication Skills
Sourcing
Screening
Interviewing
Interpersonal Skills

SR Universe Tech is Hiring for - HR Executive - Talent Acquisition !!!


Job Title: HR Executive - Talent Acquisition (0-3 Years Experience)

Department: Human Resources

Location: Salem

Job Type: Full-time


We are looking for a dynamic HR Executive - Talent Acquisition with 0-3 years of experience to support our recruitment process. The ideal candidate will be responsible for sourcing, screening, interviewing, and onboarding candidates while ensuring a seamless hiring experience. This is a great opportunity for freshers or early-career professionals to grow in HR and talent acquisition.




Key Responsibilities:




1. End-to-End Recruitment:




Assist in job posting on various job portals ( LinkedIn, Indeed, Monster, Job Hai, Many jobs).


Source candidates through databases, social media, referrals, and job portals.


Screen resumes and conduct initial phone to assess candidate fit.


Schedule and coordinate interviews with hiring managers.




2. Candidate Engagement & Interviewing:




Conduct first-level interviews to evaluate skills, experience, and cultural fit.


Provide a positive candidate experience throughout the hiring process.


Maintain regular follow-ups with candidates and hiring teams.




3. Job Portal & Database Management:




Manage and update job postings on multiple platforms.


Maintain an organized candidate database for future hiring needs.


Track recruitment metrics (time-to-fill, source effectiveness).




Skills


Education: Bachelor’s degree in HR, Business Administration, or related field.


Experience: 0-3 years in recruitment/talent acquisition (freshers with relevant internships are welcome).




Technical Skills:




Familiarity with job portals ( LinkedIn, Indeed, Monster, Job Hai, Many jobs).


Basic knowledge of ATS (Applicant Tracking Systems) is a plus.


Proficiency in MS Office (Excel, Word, Outlook).




Soft Skills:




Strong communication and interpersonal skills.


Ability to multitask and work in a fast-paced environment.


Good negotiation and persuasion skills..


Read more
Product-based Company (USA)
Product-based Company (USA)
Agency job
via People First Consultants by Aishwarya KA
Chennai
7 - 15 yrs
Best in industry
Selenium
Appium
Test Automation (QA)
Software Testing (QA)
API testing
+5 more

Greetings from People First!!!


We are hiring for the position of Automation Tester for one of a US Product based company.


Location: Chennai


Skills: Automation Testing, Postman, Cypress, API Testing.



Roles and Responsibilities:



  • Bachelor's Degree or higher in Computer science or related field preferred
  • 5+ years of experience writing and executing detailed test cases, test plans and test design documents
  • 2+ years of hands-on experience implementing an automation framework of front-end, back-end, and REST API services\applications.
  • Experience in leading test automation practices for Agile and DevOps teams across an agile environment.
  • Experience and strong understanding of automation tools such as Selenium Web driver, SoapUI, Client UFT, and JMeter.
  • Hands-on experience in unit test frameworks like NUnit/ MS Test.
  • Experience with tools such as JIRA, Confluence, Test Rails to log bugs and test results.
  • Working knowledge and experience of Agile with Scrum methodology.
  • Excellent communication skills.
  • Ability to explain complex technical issues to both technical and non-technical audiences.
  • Team player as well as a self-starter who needs little supervision. Able to use independent judgment to plan, prioritize and organize a diversified workload.
  • Demonstrated ability to collaborate and foster a team-oriented, results-driven culture.
  • Comfortable working in a fast-paced and dynamic environment.

Knowledge, Skills, and Competencies:

• Ability to create test plans from business requirements and technical specifications.

• Strong Knowledge of Selenium WebDriver, JavaScript, Postman, Web Services, and Rest services.

• Demonstration work experience in API Testing using Postman.

• Strong Knowledge of Zephyr Scale in Jira for UI testing.

• Advanced technical QA experience.

• Knowledge of best practices, procedures and software development lifecycle.

• Solid understanding of the software development life cycle (SDLC) and associated methodologies.

• Solid understanding of SQL/SQL queries and automated testing, preferred.

• Ability to create test plans from business requirements or technical specifications.

• Strong skills that promote and facilitate the performance of project team members.

• Prioritizes and uses time efficiently; develops realistic action plans

• Highly flexible and able to make quick assessments of needs and priorities.

• Initiative to recognize and resolve problems.

• Familiarity with Automation Testing.

• Excellent communication skills and experience communicating with a variety of staff levels.

• Experience communicating plans and reporting status to both team, executive management and pertinent stakeholders.

• Advanced Skills in MS Office applications including Excel, Word, and Outlook.

• Regular attendance is required.




Read more
Tidalwave Solutions
Dubai
2 - 3 yrs
₹4L - ₹5L / yr
Motion graphic design

ROLES & RESPONSIBILITIES

·      Creative Logos

·      Banners for Websites & Social Medias

·      Flex Banners

·      Flyer Design

·      Brochure & Pamphlet Design

·      very good understanding of color theory and usage of colors.

·      Test graphics across various media

·      Schedule projects and define budget constraints for Graphic Designer JD

·      Motion Graphics & Video Editing.

Read more
Passionate about Data processing capability
Passionate about Data processing capability
Agency job
via The Hub by Sridevi Viswanathan
Bengaluru (Bangalore)
4 - 12 yrs
₹8L - ₹15L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
skill iconSpring Boot
JPA
Microservices
+2 more
  1. 5-7 years hands-on working experience in Java / Spring / Spring Cloud / Spring Data JPA / Spring Boot Microservices
  2. Data processing capability
  3. Hands-on working experience with GCP/AWS/Azure
  4. Hands-on working experience with Junit, Git, Jenkins, Maven
  5. Excellent communication skill
  6. Experience on Google cloud data flow would be an added advantage

Java, SpringBoot, Problem Solving skill, Apache Beam, AWS/GCP,

Read more
Planetspark
at Planetspark
2 candid answers
Sneha Agrawal
Posted by Sneha Agrawal
Gurugram
0 - 3 yrs
₹5L - ₹6L / yr
Communication Skills

#hiring "Business Development Trainee" PlanetSpark


PlanetSpark is a global platform committed to nurturing exceptional communication skills across all stages of life— be it children in the K-12 bracket, college students, working professionals, business owners, or homemakers. Our unique approach integrates live and asynchronous learning strategies that cater to individual needs and schedules. Join our vibrant community of 3,000 skilled educators united in our pursuit of effective and eloquent communication. We are looking for talented individuals who are passionate educators or who are eager to be part of a world-changing team.


Role Description

We are looking for a full-time Business Development Trainee to be based on-site in Gurugram. In this role, you will be responsible for developing, supporting, and maintaining new and existing business partnerships. The role requires a tech-savvy individual with excellent communication skills.


Qualifications

-Bachelor’s degree or higher

-Experience in business development, sales, or marketing desirable is a plus

-Excellent communication, negotiation, and interpersonal skills

-Proven ability to take ownership and responsibility, show initiative, and work effectively in a team environment

-Conduct video counselling sessions

-Generate trial classes

-Take counselling sessions and convert them to sales.


Please note :- Must own a Laptop

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Shivani Chaudhary
Posted by Shivani Chaudhary
Panchkula
0 - 1 yrs
₹1.5L - ₹1.8L / yr
Email Marketing
Marketing
Digital Marketing
  • good communication skill
  • good confident
  • Exposure in email marketing
  • Marketing knowledge
  • fresher. profile
Read more
Knowlarity Communication India Pvt Ltd
Indresh Vikram Singh
Posted by Indresh Vikram Singh
Gurugram
2 - 7 yrs
₹10L - ₹19L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Linux/Unix
+1 more
 
About Job Role : 
Experience working on Linux based infrastructure
Understanding of any scripting programming language.
Configuration and managing databases such as MySQL
Working knowledge of various tools, open-source technologies, and cloud services (AWS)
Implementing automation tools(Ansible, Jenkins) for deployment and provisioning  IT infrastructure
Excellent troubleshooting of cloud systems.
Awareness of critical concepts in DevOps principles.
Read more
Our Client company is into Computer Software. (EC1)
Our Client company is into Computer Software. (EC1)
Agency job
via Multi Recruit by Manjunath Multirecruit
Bengaluru (Bangalore)
3 - 5 yrs
₹9L - ₹15L / yr
PIM
  • PIM Repository changes, including adding new fields, enumerations, import/export templates, categories
  • Data Load: Import product data and assets from various ERP, DAM, and other enterprise business-critical applications into the PIM application
  • Data Syndication: Publishing approved Products in Enterworks PIM to consumer application
  • Build PIM solution for Multi-Language data requirements & Publication Catalogs
  • Participate in all testing efforts for the PIM application
  • Creation, validation, and configuring of the Data Quality and Data governance workflows
  • Identifies opportunities to gain efficiencies, automate, and improve data quality
  • Actively engages in continuous process improvement
  • Perform operations, monitoring, and support for PIM application
  • Analyze/Troubleshoot and support any issues related to PIM Solution or Release installations

Basic Qualifications

  • 4+ years of Product Information Management (PIM) Developer experience
  • Strong SQL query writing skills
  • Excellent interpersonal, communication, and team-facilitation skills
  • Strong analytical and problem-solving skills
  • Familiarity with Agile delivery methods (i.e., Scrum, Kanban)

Preferred Qualifications

  • Bachelor's degree in business, supply chain, or related major; MBA a plus - Computer Science classes or degree a plus
  • PIM/MDM experience with other major platforms (Informatica, Riversand). EnterWorks Enable experience is a big plus

 

 

Read more
Cascade Revenue Management
Mariswara  Moorthy D
Posted by Mariswara Moorthy D
Ernakulam
1 - 4 yrs
₹2L - ₹5L / yr
Client Servicing
Customer Relationship Management (CRM)
Healthcare
Revenue Cycle Management
Denials
+1 more
We are in need of AR callers ,

Eligibility :
  • Should have minimum 0ne year experience in US AR Calling .
  • Must have experince in Denials
  • Must have experience in provider end 
  • Candidate should be ready to work in night shift 
  • Ready to relocate to Ernakulam
  • Preferably immediate joiners 
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos