Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

e.Soft Technologies Ltd.
Mumbai
1 - 6 yrs
₹3L - ₹5L / yr
Cold Calling
Lead Generation
Sales

We are looking for "Tele Sales Representative"


Location: Mumbai (Goregaon-W)

Role: Tele Sales Representative

Experience: 3-5 Years


Key traits:

  • Make outbound calls to customers.
  • Pitch and explain the company products/services effectively over the call.
  • Generate leads and convert them into successful sales.
  • Achieve daily, weekly, and monthly sales targets.
  • Good communication skills in English (mandatory).
Read more
Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Gurugram
2 - 4 yrs
₹15L - ₹20L / yr
Ui design
User Experience (UX) Design
Product design
Usability testing
Product based company

Role & Responsibility -:


Create close working relationships with Product, Strategy, Marketing, and Engineering, to shape and deliver design vision and strategy

Gather and evaluate user requirements in collaboration with product managers and engineers

Illustrate design ideas using storyboards, process flows and sitemaps

Practice an iterative, user-centered design approach and create best-in-class deliverables in every phase of the UX design lifecycle.

Lead discovery sessions and brainstorms.

Develop user flows, wireframes, UI mockups and prototypes that clearly illustrate how sites, feature function and look like

Present concepts, ideas and potential solutions to stakeholders and senior management and implement their feedback.

Participate actively in UX testing and revise designs after synthesizing test results.

Utilize deep knowledge of UX best practices and trends in media, online learning and emerging

Identify and troubleshoot UX problems (e.g. responsiveness)

Creating and maintaining a site-wide style guide

Read more
Zeus Learning
at Zeus Learning
16 recruiters
Veena Nikharge
Posted by Veena Nikharge
Mumbai
2 - 5 yrs
₹7L - ₹20L / yr
skill iconPython
skill iconJava
skill iconNodeJS (Node.js)
skill iconPHP
skill iconRuby
+6 more

As a Full-stack Developer, you will be involved in designing and implementing web/cloud applications. You will be responsible for designing, programming and technically guiding the team. You will be working with a broad spectrum of technologies in a fast-moving environment.

 

You must possess:

  • 2 to 5 years of professional experience in web application development
  • good logical and problem-solving skills.
  • working experience in building enterprise-scale, multi-tier, distributed applications.
  • hands-on experience in Agile software development methodology including implementing CICD processes.
  • good communication skills.

 

You should be able to:

  • work in teams and coordinate activities effectively with members
  • experiment with new technologies
  • learn new skills on the fly
  • work with a dynamic fast-paced team
  • make technological recommendations based on thorough research
  • write and debug asynchronous and multi-threaded code

 

You will:

  • Analyze requirements and translate them into tasks for subordinates.
  • Independently think of solutions to complex requirements.
  • Diagnose and troubleshoot issues related to application stability, scalability, and availability.
  • Understand source code and improve the code-review process.
  • Grow and train a competent development team.
  • Introduce new technologies, processes, and tools to the organization.
  • Proactively identify defects and weaknesses within the application and suggest remediation.

 

General technical requirements:

  • Good exposure to server-side frameworks and libraries used by C#, Java, Node, Python, PHP, and Ruby. Preference will be given to candidates with working experience with .NET Core MVC/Web-API.
  • Good exposure to client-side frameworks such as Angular, React, Vue, and Backbone
  • Experience in writing optimized queries for databases like SQL Server, MySQL/MariaDB, Postgres, and others
  • Experience in working with NoSQL databases such as MongoDB, CouchDB, Cassandra, and others.
  • Experience in working with one or more build tools like Ant, Maven, MSBuild, Make/CMake, Gulp, and other such tools
  • Experience with implementing CI/CD using tools such as Ansible, Jenkins, TeamCity, and other such tools
  • Working knowledge of Docker and good containerization concepts
  • Have hands-on experience in using the *NIX shell to create/execute scripts and perform basic configuration and system troubleshooting.
Read more
Fleetsimplify
at Fleetsimplify
1 recruiter
Salim Omar
Posted by Salim Omar
Remote only
3 - 7 yrs
$4.8K - $5K / yr
User Interface (UI) Design
User Experience (UX) Design
Figma
Adobe Photoshop
skill iconAdobe Illustrator
+5 more

Requirements:


  • Minimum of 5 years of experience as a UI/UX Designer with a strong portfolio showcasing innovative design projects.
  • High proficiency in Figma is a must. The candidate should be able to create complex design systems, use auto-layout effectively, and leverage Figma's interactive components for prototyping.
  • Strong knowledge and understanding of the design process from ideation to development; including wireframing, prototyping, user testing, and final implementation.
  • Experience in conducting user interviews, surveys, and usability studies. The ability to empathize with users, understand their problems, and translate their needs into effective UI/UX solutions.
  • Demonstrable skills in ideation, sketching, and creating low-fidelity wireframes for early-stage idea exploration.
  • It is an added advantage to have familiarity with HTML, CSS, and JavaScript for close collaboration with our development team.
  • A keen understanding of mobile-first and responsive design. You should be able to create designs that work well on any device and screen size.
  • Excellent visual design skills, including but not limited to, composition, layout, color theory, and typography.
  • Ability to conduct user research, usability testing, A/B testing, rapid prototyping, heuristic analysis and assess user feedback to deliver world-class design solutions.
  • Demonstrated experience using data, user feedback, and market analysis to inform design decisions.
  • A deep understanding of user-centered design principles and best practices.
  • Exceptional communication skills for articulating design decisions to team members and stakeholders.
  • Experience using additional design tools such as Photoshop, Illustrator, or Sketch.
  • Knowledge of prototyping tools.
  • Certification in UX design from a reputable institution.
  • Experience in a fast-paced startup environment.


Read more
Extramarks
at Extramarks
4 recruiters
Prachi Sharma
Posted by Prachi Sharma
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
1 - 5 yrs
₹8L - ₹10L / yr
skill iconHTML/CSS
Adobe Pixel Bender
skill iconExpress
skill iconJavascript
Phaser
+1 more

We are seeking Software Engineers for developing Html5 based content for various target platforms like Android, IOS, and Windows. Primary responsibility will be to create new Html5 Games and modules with new features, translating new design idea, concepts, and requirements into a live interactive module.

Job Description:

Responsibilities:
· Transforming ideas into functional games.
· Design, build, and maintain efficient, reusable, and reliable code.
· Create/update web modules (games/engines/templates)
· Responsible to handle game singlehandedly.

Skills:
· Strong understanding of object-oriented programming.
· Strong knowledge of how the web works and different kind of optimization techniques. · Deep dive onto different HTML5 Game Frameworks used in the industry like CreateJS, Phaser.io, PixiJS, Cocos2d-X.
· Knowledge of how the game physics works.
· Strong & excellent knowledge of Html5 development with Html5 APIs, Canvas, Object       Oriented JavaScript, jQuery, bootstrap, desktop and portable device based web     application & modules development.
· Good Problem solving and analytical skills.
· Strong Debugging skills.
· Proficient knowledge of code versioning tools such as Git and SVN.
· Knowledge of E-Learning Interactive Content Development Skill Requirements.
· Good Communication skills and ability to work with a team of peers.
· Prior experience with educational content development is a plus.


Qualifications and Experience:

Education – B. Tech, MCA

At least 1-4 years’ experience of developing HTML5 games.

Read more
Clubbfit
at Clubbfit
1 recruiter
Anuja Nair
Posted by Anuja Nair
Remote, Bengaluru (Bangalore)
1 - 10 yrs
₹3L - ₹6L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+2 more
We at clubb.fit are looking for a passionate and talented MERN stack developer who can help us revolutionise fitness and sports in India.

clubb.fit is working towards a vision of normalising sports and fitness as an everyday part for Indian adults and kids. We want to create a community of fitness and sports enthusiasts, and convert those non-enthusiasts into enthusiasts.

As the full stack developer, you will have a chance to work on all aspects of our tech, and have freedom to experiment and fail. We see tech as an integral part of making the customer journey more engaging. So if you are somebody who looks at an app and thinks "oh I think these guys should also have this exciting xyz feature added", then we are the right team for you.

You will be working with our senior developer, and help us improve the platform at a fast pace.

We are a small team, and everyone has the freedom to express and introduce ideas. You will work closely with the founding team and help them execute their vision through your tech super power.

The timings on this role are flexible - you can do it part time or full time - with work from office 2 times a week in Bangalore, in case you are in Bangalore..

The role comes with equity stake in a startup and we are aiming to raise our first round in next 6 months.
Read more
Disruptive Electronic Accessories Brand
Disruptive Electronic Accessories Brand
Agency job
via Unnati by Rakhi Gayen
Bangalore
7 - 8 yrs
₹9L - ₹12L / yr
Project coordination
Coordinator
quality assurance
Here is a chance to work for a Consumer Electronics Brand, where you get to deal with some of the best channels and work with some excellent experienced minds. Read on.
 
Started in 2015, this lifestyle and accessories startup has taken over the consumer electronics sector in India. Our client has a product range that includes an extensive catalog of headphones, speakers, travel accessories, and modern earphones. It believes in providing cutting edge electronic products stamped with durability and affordability.

The brand is associated with some of the major icons across categories and tie-ups with industries covering fashion, sports, and music, of course. The founders are Marketing grads, with vast experience in the consumer lifestyle products and other major brands. With their vigorous efforts toward quality and marketing, they have been able to strike a chord with major E-commerce brands and even consumers.
 
As a Technical Coordinator (R&D), you will be responsible for coordinating technology evaluation by various teams- software, hardware, quality assurance, Product Managers, and management team.

What you will do:

  • Coordinating all communication and discussions with technology partner, semiconductor partner, vendors, and other 3rd party companies
  • Coming up with ideas to improve existing products and suggesting the potential new technology adaption to products
  • Performing market reaserch, exploring ideas by working closely with various departments and coming up with new innovative features and architectures

 

Candidate Profile:

What you need to have:

  • Experience in consumer-lifestyle companies
  • Good understanding of any of the product categories including Hearables (TWS, Neckbank, Headphones), Wearable (Band, Smartwatches), Alexa Speakers/Voice Assistant, Soundbars, and any other consumer electronics products
  • Excellent written and oral communication skills
  • Strong sense of duty and initiative    

 

Read more
Navachetana Vignana Samithi,
pub of ManaTelangana newspaper
Navachetana Vignana Samithi, pub of ManaTelangana newspaper
Agency job
via Ixora Global Services by Janardhan Reddy
Hyderabad
1 - 3 yrs
₹1L - ₹2L / yr
Accounting
Tally
Goods and Services Tax
We are looking for a candidate who can handle day to accounting works along with knowledge in employee pay roll including EPF and ESI functions.
Read more
SKP Title Search PvtLtd
Thariq Ahamad
Posted by Thariq Ahamad
Chennai
2 - 6 yrs
₹3L - ₹7L / yr
skill iconPHP
skill iconLaravel
MySQL

Job Description :


1. Coordinate with project managers and team to create detailed project plans for
achieving timeliness and 100% quality in each project and deliverables.
2. Address technical concerns, ideas, and suggestions and provide a technological
solution to them.
3. Creating API endpoints for web applications and internal scripts that will handle
the business logic of applications.
4. Troubleshoot, test, and maintain the core product and database to ensure strong
optimization and functionality.
5. Develop innovative, reusable web-based tools.

Skill Requirements :

1. Understanding the principles behind a scalable application.
2. Understanding of the software development life-cycle and best practices.
3. Must have experience with MySQL/Postgres SQL and should be capable of
writing queries, stored procedures, indexes, etc.
4. Working Experience in Laravel HMVC, Hooks & Plug-in Methodologies. Laravel
is Preferrable.
5. HTML5, CSS3, XML knowledge is mandatory. And experience with JavaScript
and jQuery for producing AJAX applications.
6. Ability to make modifications to the systems with little or no interruption of
service.
7. Exposure to REST API Development & API integrations.
8. Working Experience in Composer & PHP Libraries.

Read more
Mastree
at Mastree
8 recruiters
Priyanka Anand
Posted by Priyanka Anand
Remote only
1 - 15 yrs
₹1L - ₹3L / yr
Teaching
Communication Skills
Remote working
English Proficiency
Presentation Skills
+1 more

**Candidates anywhere from India can apply**

Job Responsibilities 

  • Set Mastree’s classrooms as centers of excellent teaching and creative learning ● Monitor and Review the progress of the students 
  • Identify gaps & provide inputs to the students based on their performance ● Conduct regular PTMs and keep the parents informed about the progress of their kid 

Ideal Candidate 

  • Excellent communicator 
  • Passion to engage students 
  • Energetic and Lively 
  • Great command in the English language 
  • Good screen presence 
  • Drive conversations with the students and parents 
  • Presence of mind to handle parent queries 
  • Believe in conceptual learning 
  • Adapt to non-conventional methods of teaching 
  • Facilitate the class with minimal supervision 
  • Open to feedback and accept constructive criticism 
  • Comfortable with technology and dealing with digital content

Qualifications: 

Bachelor’s/Master's Degree, preferably B.A or B.Ed 

Tech Requirements: 

Good Laptop/Desktop (8GB RAM or higher) 

High-quality webcam (HD/1080p inbuilt or external) 

Stable Internet with speed >5 Mbps 

Power Backup for Internet 

Lighting and Decent Background 

Experience: Minimum 1 year of professional teaching experience, online tutoring experience will be a plus

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos