Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Remote, Chennai, Coimbatore
3 - 8 yrs
₹10L - ₹30L / yr
Video codecs
Multimedia
skill iconC++
GStreamer
FFmpeg
+1 more

Job Description:

MulticoreWare Inc develops heterogeneous software for Media and Automotive markets. It develops and licenses world-class video codec libraries, such as the widely used x265 (open-source HEVC encoding library) and supports tier-1 global streaming video services and video encoding solution providers.


As a Senior SW Engineer/Technical Lead, you will join MulticoreWare’s growing team of world-class engineers, and architects in its offices at Chennai, India, to implement, and deliver solutions in video pipelines and products. You will work in a result-oriented team with a culture of transparency and minimal bureaucracy. MulticoreWare provides a collaborative work environment with opportunities to learn, grow and progress in your career path.


Key Responsibilities:

  • Implement, test, and deliver production-quality software, architected for problems in video pipelines of internal and customer IPs
  • Lead the execution and implementation of product features with a small team of engineers and mentor the junior engineers within the team
  • Conduct meticulous code-reviews to ensure bug-free and high-quality deliverables.
  • Contribute towards product release cycles by developing tests deployed in continuous integration frameworks, fixing bugs identified during release, etc.
  • Interface with customers, support customer evaluations of products and debugging of customer issues


Qualifications:

  • Bachelor’s degree in Computer Science, Computer Engineering, or Electrical Engineering with 5 + years’ experience, or a Master’s degree in similar areas with 3+ years’ experience
  • Excellent C/C++ development and debugging experience in creating production-grade software on Windows and Unix-based platforms
  • Hands-on experience in video coding with an in-depth knowledge of HEVC, AVC, VP9, AV1 and VVC 
  • Strong interest in video/imaging technologies, including video/image compression, analytics, and streaming/delivery
  • Demonstrated analytical, problem solving and troubleshooting skills, with a meticulous attention to detail
  • Working knowledge of code management systems such as Git and Bitbucket
  • Good verbal and written communication skills


Preferred Qualifications:

  • Experience with continuous integration frameworks like Jenkins
  • Experience with heterogeneous programming libraries such as OpenCL, CUDA
  • Experience with platform-specific software optimizations like SIMD to enable higher performance software
  • Understanding of Agile / Scrum methodologies
  • Experience in interacting with geographically distributed teams for reviews and meetings




Read more
Avalon Solution
Indore
1 - 3 yrs
₹2.5L - ₹4L / yr
Digital Marketing
Social Media Marketing (SMM)
skill iconGoogle Analytics

Digital Marketing Specialist with Expertise in Google Analytics and Targeted Email Campaigns

Job Type: Full Time

Location: Indore

Position Overview:

 We are seeking a highly motivated and detail-oriented Digital Marketing Specialist to join our team. The ideal candidate will have expertise in using Google Analytics, email marketing tools, and analytics platforms to design and execute targeted email campaigns. This role involves leveraging data-driven insights to optimize marketing strategies, improve customer engagement, and increase ROI.

Key Responsibilities:

Google Analytics Management:

Set up, manage, and analyze Google Analytics accounts to track website traffic, user behavior, and campaign performance.

Generate insightful reports to support data-driven decision-making for marketing strategies.

Identify trends and opportunities through data analysis to improve website conversions and user engagement.

Email Marketing Campaigns:

Create, execute, and optimize targeted email marketing campaigns tailored to customer segments and business goals.

Use analytics tools to track email campaign performance, such as open rates, click-through rates, and conversions.

Develop and maintain customer lists, ensuring proper segmentation for personalized outreach.

Analytics Tools & Platforms:

Utilize advanced analytics tools (e.g., Google Tag Manager, HubSpot, Adobe Analytics) to measure campaign effectiveness.

Conduct A/B testing and multivariate testing to refine marketing strategies.

Provide actionable insights for customer behavior, preferences, and lifecycle.

Strategy & Optimization:

Collaborate with the marketing team to define digital marketing strategies that align with business objectives.

Monitor key performance indicators (KPIs) and adjust tactics to achieve optimal campaign performance.

Stay updated with the latest trends in digital marketing, analytics tools, and email marketing best practices.

Collaboration:

Work closely with the content, design, and sales teams to create cohesive and effective campaigns.

Ensure seamless integration of marketing campaigns across channels, including social media and paid advertising.

Qualifications/Requirements:

Bachelor’s degree in Marketing, Business, Analytics, or a related field.

Experience:

Proven experience (2+ years) in digital marketing with a focus on analytics and email campaigns.

Hands-on experience with Google Analytics, Google Tag Manager, and email marketing tools (e.g., Mailchimp, Klaviyo, or similar).

Proficiency in using CRM tools and platforms like Salesforce or HubSpot is a plus.Skills:

•    Skills:

•    Strong analytical skills with the ability to interpret complex data and deliver actionable insights.

•    Excellent understanding of customer segmentation and targeting strategies.

•    Familiarity with A/B testing and optimization techniques.

•    Exceptional written and verbal communication skills.

•    Preferred Skills:

•    Certifications in Google Analytics or related analytics platforms.

•    Knowledge of SEO and paid advertising platforms (e.g., Google Ads, Facebook Ads).

•    Experience with data visualization tools like Tableau or Power BI.

•    Why Join Us?

•    Opportunity to work in a fast-paced, data-driven environment.

•    Access to the latest marketing tools and platforms.

•    Collaborate with a passionate and creative team.

Read more
Earlyjobs
Vaishali v
Posted by Vaishali v
Bengaluru (Bangalore)
0 - 0 yrs
₹2L - ₹2.5L / yr
Experience in retail/showroom or jewellery industr

Required Skills & Qualifications:

  • Minimum 1 year of experience as a cashier or billing executive.
  • Good communication skills in Kannada, Hindi, English, and Tamil.
  • Basic computer knowledge and billing software experience.
  • High level of honesty and accuracy in handling cash.
  • Customer-friendly attitude and professional behavior.


Read more
Jobdost
at Jobdost
17 recruiters
Saida Pathan
Posted by Saida Pathan
Pune
2 - 7 yrs
₹3L - ₹8L / yr
IT Recruiter
IT Recruitment
Tech Recruiter
Tech Recrutment
Acquisition
+2 more

We are a group of enthusiastic start-up heads who are passionate about growing our business and at the same time be the best and most sought-after recruiting platform that clients and candidates can TRUST! (https://www.jobdost.com)

We have multiple opportunities for an experienced and passionate IT Recruiter!

Experience: 2-7 years in IT Recruitment

Work location: Pune (Kalyani Nagar) 

Work Time: 10 am – 7 pm (Monday to Saturday)

 

Job Profile/ Responsibility:

  • Sourcing candidates of suitable caliber from various job portals. 
  • The recruiter is responsible for assessing and short-listing candidates through a systematic and multi-layered approach to create a pool of eligible candidates for Job Dost Client Organizations.
  • Carrying out the prescribed Assessment for the candidates and identifying profiles as per client expectation as per job roles.
  • Arranging telephone, video, or in-person interviews, online assessments, coding tests for candidates.
  • Maintain database of candidates in JobDost portal and also ensuring all applicants are routed through JobDost platform from interview schedule to offer
  • Performing background and reference checks.

 

Job Requirement:

For the successful execution of the job, a candidate should possess the following:

  • Hands-on experience in hiring positions like SAP consultants, System/Cloud Architect, Front/Backend Developer, React, Java/J2EE Developers, .Net Engineers, ASP.Net, C#.Net, VB.Net, etc.
  • Bachelor’s degree in Human Resources Management or a relevant field. Handling candidates in Information Technology is a plus.
  • Minimum 2 years of prior experience as a Recruiter
  • Experience with resume databases and Applicant Tracking Systems
  • Experience with various sourcing methods
  • Experience with conducting Assessments
  • Strong verbal as well as non-verbal communication skills
  • Exceptional time-management and organizational skills

 

Why Join Us?

You will be working closely with a highly experienced team and the founders of JobDost - surely a great opportunity to learn! As the first few members of an ever-growing team, you will play a key part in the cultures, values, and success story of our company!

We have a budding business with a solid expansion plan ahead of us and we want you to be a part of this game-changing journey!  

Read more
Aplombsoft Private Limited
Ahmedabad
3 - 6 yrs
₹2L - ₹11L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+6 more

Qualification: Bachelor's degree (B.E./B. Tech) in (CE/IT)Or MCA Or MSC IT

Skills:

Must Have:

- Oops

- Asp.Net MVC

- Dot.net Core

- MS SQL Server

- JQuery&Javascript

- RestAPIs

- Entity Framework

- HTML

- CSS

Good to Have:- TypeScript/Angular/React

- Xamarin/MAUI

Soft Skills:

- Good Communication skill.

- Able to create design document from the Requirements

- Can handle individual projects.

- Can manage a team and be a good team player.

- Clear reporting to the Client or manager.

Tools:

- Visual Studio

- VS Code

- Git

- Postman

Experience:

4-5+ years of experience in Web and APIs development in Dot Net C#/Vb.net & SQL Server

Roles & Responsibilities:

1. Participating in design discussions and solving complex business problems.

2. Responsibility for technical projects and see them into production following standard

development and quality processes.

3.Utilization of standard Microsoft stack technologies.

4. Supporting developers by providing technical and task direction.

5. Create technical and operational system documentation.

6. Ensuring compliance with IT Technology Roadmap.

7. Production support and escalation.Provide point of escalation during the day and off-hour.

8. Work closely with the development management team to design and implement use cases.

9. Analyze business requirements then design and code web applications, services, and batch

processes or Rest APIs.

Read more
US based Ed-tech product company
US based Ed-tech product company
Agency job
via Credos Talent by Kaustubh Waingankar
Mumbai, Pune, Bengaluru (Bangalore)
6 - 9 yrs
₹22L - ₹32L / yr
.NET Core
skill iconC#
MySQL
skill icon.NET
ASP.NET
+7 more

Our client is a rapid growth stage Edtech start-up focused on solving the teacher shortage crisis in the US education system using technology by bringing teachers to the classrooms and giving them access to the right tools to teach students in a highly engaging manner.


They have a development center in Mumbai and they are looking to scale up the teams in Pune and Bangalore as well.



What does the role entail:

● Lead User Stories and guide senior/software engineers in the development process

● Understand architecture principles, design patterns and implement them from architectural artifacts.

● Provide effort estimation of assigned work and be able to complete as per the estimations and timelines

● Write clean, maintainable, and efficient code including unit tests and integration tests to ensure software quality

● Collaborate with cross-functional teams to analyze requirements, design solutions, and implement new features

● Participate in design and code reviews

● Ability to resolve performance issues

● Mentor junior software engineers and help them grow their technical skills


Must Have Skills:

● B.E/B.Tech in computer science

● 8-11 years of experience

● Hands-on experience following skills

MS Technologies: NET CORE 5+, C#

Backend : MSSQL /MySQL/Postgres 

● Good understanding of Cloud technologies like Azure/AWS.

● Good understanding of Design Principles, Design patterns and Microservices Architecture.

● Excellent problem-solving, critical thinking, and communication skills

● Worked in an Agile software development environment

Must understand full stack development frameworks including knowledge of building scalable APIs, interfaces, software components, schema design, availability, and latency preferably in a cloud environment.

● Worked in a fast-paced environment preferably in a tech driven startup

● Understanding of different types of architectures.

Read more
Srijan Technologies
at Srijan Technologies
6 recruiters
Srijan Technologies
Posted by Srijan Technologies
Remote only
2 - 6 yrs
₹2L - ₹10L / yr
Drupal
skill iconJavascript
Frontend
Drupal8
Theming

Responsibilities:

  • Providing accurate timing estimates on work.
  • Contributing to documentation (instructional, pitch, and technical specification)
  • Contributing to the company development standards working closely with the Technical lead
  • Discussing technical solutions with clients and providing innovative new ideas to solutions.
  • Maintaining a high awareness of industry issues and trends, particularly in regard to accessibility, usability, and emerging technologies, and keep team members informed as appropriate, with a view to incorporating these in future projects and staying ahead of the market and position yourself and the company as a digital specialist.
  • Constantly seeking to develop yourself by learning new technologies and keeping abreast of your market developments.

 Requirements, Skills, Qualifications :

  • Web application development, Experience using web standards to build valid and semantic HTML5 and CSS3 driven sites.
  • Basic knowledge of JavaScript and anyone JavaScript framework.
  • Experience with CSS Frameworks such as Twitter Bootstrap.
  • Experience in using graphic design tools is required (e.g. Photoshop, Dreamweaver). Should be able to create wireframes.
  • Drupal 8 Theming with Twig and Pattern Lab knowledge
  • Should have knowledge of Javascript frameworks, MVCs. Should have experience with preprocessors, and should be able to theme responsive designs
  • Must be able to ideate creatively.
  • Should be aware of screen media, new media.
  • Experience in responsive design.
  • Experience with user flows and UI elements
  • Must be able to analyze and praise/criticize other’s designs and provide reasons behind it.
  • Good problem solving, analytical skills, and communication skills.
  • Aspiration to work in React/Angular or Drupal backend.
 
Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
keerthi varman
Posted by keerthi varman
Chennai, Bengaluru (Bangalore)
3 - 7 yrs
₹7L - ₹12L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more
Preferred Skills:
  •  Good communication skills in English (Written and Oral)
  •  Strong knowledge of RDBMS concepts
  •  Strong analytical and problem-solving skills
  •  Experience in performance tuning
  •  Experience in interaction with the customer
  • Mandatory technical skills Java 8+, Angular 2+, HTML, CSS, TypeScript
  • Preferred Tools (SVN, GIT, Maven, Jenkins Jira Confluence) 
  •  Ability to explore the application by himself/herself from the training provided
Responsibilities:
  • New feature development or enhancement or change request activities (Requirement analysis, Requirement documentation, Design, Coding, Review, Testing and Release process)
  •  Defect Fixing (Defect analysis, route cause identification, Code change, testing, obtaining user confirmation and release process)
  • Support tasks (Ticket analysis, data uploading, performance tuning, job monitoring, any analysis task, ReportGeneration and etc.,)
  • Level 2 and Level 3 support (Support process adherence)
  • Functional and technical or solution documentation preparation
  • Execution will either be Waterfall or Agile
  • The process needs to be followed as defined by RBEI or RBEI’s Customer
  • Preparation & participation in the project status and review meeting
Thanks & Regards,
 
 
Read more
The Venya
Krisha Malhotra
Posted by Krisha Malhotra
Noida, Sector 127
2 - 5 yrs
₹4L - ₹6L / yr
Digital Marketing
Marketing
Sales

Job Responsibilities

  • Generating sales from direct & indirect channels. (Online & Offline)
  • Responsible for closing potential leads to achieving defined targets.
  • Monitoring the market and competitor products and activities and providing detailed sales forecasting.
  • Effectively managing inventory for properties across various channels.
  • Reviewing customer activity, anticipating customer needs, and improving customer satisfaction/experience.
  • Establishing and maintaining key customer relationships.
  • Create promotional plans and strategies to develop sales plans and achieve defined sales goals.
  • Ensure guests will have a pleasant stay experience by assisting during the stay.

Required Skills

  • A user-centric approach to drive higher satisfaction among guests, and owners.
  • Ability to execute and drive efficiency through continuous process improvement.
  • Strong Interpersonal skills with the ability to collaborate and manage.
  • Strong in advanced excel, google sheet management.
  • Ability to deliver results under pressure and within the deadline.
  • Strongly inclined to do high-quality and impactful work in a dynamic environment.

      Qualification & Experience

  • Bachelor/Master’s degree in engineering, business administration, or related field with a minimum of 2 years of work experience in sales required.

     Travel Required

  • Up to 50% of the time is to be spent in the region for a better understanding of the local market and to be more responsive to our stakeholders.
Read more
Rey Ecom Ops
at Rey Ecom Ops
1 recruiter
Arjoo Singh
Posted by Arjoo Singh
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
1 - 3 yrs
₹2L - ₹3.5L / yr
Electronic commerce
E-commerce
Ecommerce
MS-Excel

Summary-

Looking for E-commerce Executive position with a relevant experience of 2 - 3 years. You will be responsible for the complete management of the US based marketplaces. Amazon Expert

 

Responsibilities-

You will be responsible for..

*Managing products catalogues ensuring products are listed accurately.

*Managing the listing quality and the regular updates.

*Implement and maintain the new regular changes in catalog

 

Skills and Qualification -

 

*Excellent in communication ,both oral and written .

*Excel, photoshop, project management tools

*That would be a plus if you are using Shopify , Google, Walmart , and eBay or any other US marketplaces.

 

Location- Laxmi Nagar Delhi.

 

Salary- 20,000 - 35,000pm

 

Note - please apply only if you are ok with this salary.

 

Shift - Night Shift.

Employment Type

Full-time

https://www.linkedin.com/talent/contract-chooser?contractId=306426011&;destUrl=https%3A%2F%2Fwww.linkedin.com%2Ftalent%2Fjob-posting%2Fonline%2Fdescription%3FjobId%3D2729621577">Edit job description
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos