Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
Python
Scala
Java
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Exogen Technologies
Angelina Neman
Posted by Angelina Neman
Remote only
0 - 10 yrs
₹5L - ₹9L / yr
Graphic Designing

Conceptualization and Design:

  • Develop creative concepts and design solutions for a variety of projects, including marketing materials (print and digital), website graphics, social media content, presentations, and branding materials.
  • Translate project briefs and requirements into visually appealing designs that meet objectives.
  • Maintain and evolve brand guidelines across all design projects.

Production and Execution:

  • Create and deliver high-quality graphic assets in various formats, optimized for different platforms and devices.
  • Manage multiple projects simultaneously, adhering to deadlines and maintaining consistency.
  • Prepare files for print production and digital distribution.

Collaboration and Communication:

  • Collaborate with marketing, product, and other teams to ensure design consistency and alignment with overall strategies.
  • Present design concepts and rationale to stakeholders, incorporating feedback and revisions.
  • Communicate effectively with team members and external vendors.

Software and Tools:

  • Proficiently use industry-standard design software, including Adobe Creative Suite (Photoshop, Illustrator, InDesign, etc.).
  • Stay up-to-date with the latest design trends, techniques, and technologies.
  • Possibly use animation and video editing software such as After effects, and premiere pro.

Brand Stewardship:

  • Ensure all designs adhere to brand guidelines, maintaining brand consistency across all platforms.
  • Contribute to the development and refinement of brand visual identity.


Read more
iFuture Globistic Limited
Priyanka Marra
Posted by Priyanka Marra
Visakhapatnam
4 - 9 yrs
₹5L - ₹10L / yr
PHP
Javascript
React.js
Angular (2+)
AngularJS (1.x)
+15 more
We are looking for an experienced Full Stack PHP Developer for immediate hiring.Candidate must have at least 4-6 years of experience in working on PHP based projects with MySQL backend. The ideal candidate should have the drive and passion to thrive in a startup environment. Should be involved in all aspects of the development cycle of a project. Skills Required:
  • Strong experience in PHP with deep understanding of Codeigniter, Laravel & other frameworks
  • Working experience with SQL, table design, and entity relationships.
  • Familiarity with relational databases mySQL or MS SQL Server
  • Deep knowledge of how the web works (Servers, Sockets, HTTP, Rest API).
  • Up-to-date knowledge of modern HTML5, CSS3/4, Bootstrap, JavaScript, JQueries.
  • Developing APIs and RESTful services
  • Version control systems like Git and GitHub ·
  • Proficient in data structures and algorithms.
  • Helping with the design and development of software
  • Testing and debugging software to keep it optimized
  • Writing clean code for the front and back end of the software
  • Creating servers and databases for the back end of the software
  • Ensuring cross-platform compatibility and optimization
  • Testing and maintaining the responsive design of applications
Education: Bachelor's Degree in Computer Science or any equivalent experience Experience: Minimum 4 years of experience.
Job Types: Full-time, Regular / Permanent
Salary: ₹40,000 - ₹80,000 per month
Schedule:
  • Day shift
Ability to commute/relocate:
  • Visakhapatnam, Andhra Pradesh: Reliably commute or planning to relocate before starting work (Required)
Education:
  • Bachelor's (Preferred)
Experience:
  • PHP: 4 year (Preferred)
  • total work: 4+ year (Preferred)
  • software development: 4+ year (Preferred)
License/Certification:
  • PHP (Preferred)
Friday, October 14th
 
Read more
A fast-growing SaaS commerce company permanent WFH & Office
A fast-growing SaaS commerce company permanent WFH & Office
Agency job
via Jobdost by Mamatha A
Remote only
5 - 10 yrs
₹25L - ₹35L / yr
User Interface (UI) Design
User Experience (UX) Design

Sr. UI/UX Designer: Plum

We are looking for an experienced and creative Senior Product Designer to join the Empuls product team!
As the product designer, you will be responsible for delivering the optimal user experience across the Empuls web and mobile apps. This is a high visibility role and has a large contribution to the overall success of the product and customer satisfaction. The role requires deep collaboration with the product, technology, marketing, and sales teams. This role might include some people management responsibilities.

Craft detail of new and existing product features, from understanding the customer pain point to defining wireframes, high definition prototypes and finally collaborating with the technology team to navigate through constraints and build the product.

Partner closely with our Product, Marketing, and Technology teams to understand what users need, want, and love about the product. Use the data to plan and define the optimal user experience.

Create design systems that help with a common design language across the entire product portfolio in a distributed team.

Aid product marketing in telling the product stories in the best way possible to help users in product adoption and onboarding.

Build and implement processes for user testing. Take a data-driven approach to decision-making.

Mentor other designers and drive the vision for the specific domain by partnering with product owners & engineering leads

 

No of opening 2

Exp Required: 5-10 yrs

NP: Immediate - Within 30 days

CTC: Up to 40 LPA

We are

A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF, Dubai, Singapore, and Dublin. We have three products in our portfolio: Plum, Empuls and Compass. works with over 1000 global clients. We help our clients in engaging and motivating their employees, sales teams, channel partners, and consumers for better business results.

Way forward

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We assure you that we will attempt to maintain a reasonable timeframe for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

 

 

Read more
Supply-Chain Funding Fintech
Supply-Chain Funding Fintech
Agency job
via Unnati by Rakhi Gayen
NCR (Delhi | Gurgaon | Noida)
1 - 6 yrs
₹25L - ₹35L / yr
Product Management
product manager
Product Strategy
Work with a company that pioneers alternative credit scoring for small businesses using proprietary data from non-traditional sources.
 
Our client is a leading fintech, aimed at easing debt-related services to small and micro businesses, which are left out due to credit rating issues. They customize their affordable credit products by creating a risk assessment and rating system for new customers and deliver collateral-free capital. Their products and services reach the businesses in Tier 1 to Tier 4 geographies through their seamless platform and reach to major towns and cities.
 
The startup is co-founded by an XLRI alumnus and a team with extensive capital markets and Banking sector experience. They have currently facilitated a business volume of over 1000 crores, connected to more than 500 rural and semi-urban areas across the country. Their real-time digital app and customer-centric attitude have impacted millions of enterprises with their customised financing and digitized supply-chain services.
 
As a Product Manager, you will take care of the payments charter with a possibility for a 10x impact.

What you will do:
  • Building exciting and high impact features for the small business community such as inventory management, billing, accounting, tax filing
  • Having high user empathy, looking at the entire flow, taking care of all the edge cases and is creative in problem solving
Candidate Profile:

 

What you need to have:
 
  • A customer-first approach - you must always think customer first and be absolutely unwilling to make compromises on customer experience.
  • Past experience in creating products for small and medium businesses will be preferred    
Read more
IT Software based
IT Software based
Agency job
Chandigarh
3 - 7 yrs
₹5L - ₹10L / yr
Angular (2+)
AngularJS (1.x)
We are hiring Frontend Angular Developer
 
JOB DESCRIPTION
 

Title  :-   Frontend Angular Developer

Experience :- 4 - 7years | Permanent Position
 
Location:- CHANDIGARH
 
 

**Candidate should be fine with deployment at client location- CHANDIGARH

 
 
Primary Skills :-  
 

 

  • 4 to 7 years of experience in Frontend technologies
  • Deep knowledge of Angular 7/8/9/10 practices and commonly used modules based on extensive work experience
  • Proven experience implementing front-end and back-end JavaScript applications.
  • Hands-on Experience in designing, coding, and delivery of UI Solutions based on Angular, jQuery, JSON, JSONP
  • Proficient in CSS, HTML, and writing cross-browser compatible code
  • Creating self-contained, reusable, and testable modules and components
  • Must have experience of working with .NET API integration.
  • Must have good communication skills
Read more
Puja Sanskar Pvt Ltd
at Puja Sanskar Pvt Ltd
1 recruiter
Divya P
Posted by Divya P
Mumbai
1 - 8 yrs
₹1L - ₹3L / yr
Field Sales
Sales
Salesforce
We are hiring for an experienced Field Sales executives to join our team. As a Field Sales executives, you will develop sales volume and will be responsible for getting new customers and achieve the set targets. You will investigate and find new sales opportunities and close deals. Candidates residing at Andheri or nearby Location having field sales (Subscription Selling ) experience would be preferred.
Read more
ezeDox
at ezeDox
1 recruiter
Team ezeDox
Posted by Team ezeDox
Remote only
1 - 3 yrs
₹2L - ₹6L / yr
Business Development
Client Servicing
Sales
Presales
Salesforce
Job responsibilities include…Obviously not limited to the ones given below:
 
  • Market research, understanding the competitive landscape and tailoring the customer communication accordingly
  • Lead generation, customer qualification, Demos and achieving sales closure
  • Maintaining the customer interactions on Fresh Sales CRM
  • Meeting Quarterly & Annual Revenue Targets
Required Skills/Experience:
  • Total 0-2 year of experience
  • Prior experience in selling SaaS (Software as a Service) solution or subscription-based product will be a definite plus
  • Excellent written and verbal communication skills. 
  • Well versed with tools to prepare engaging Business presentations
  • Strong knowledge of using LinkedIn and other social media platforms to reach out to prospects
  • Self driven
Read more
BlueOptima
at BlueOptima
1 video
10 recruiters
Annu Rekha
Posted by Annu Rekha
NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore)
2 - 5 yrs
₹12L - ₹15L / yr
J2EE
Java
Object Oriented Programming (OOPs)
Whom are we looking for? Our ground-breaking work requires talented software engineers to solve complex technical challenges.We are looking for world-class developers to join our growing company and be a part of our success story. We are looking for a talented hands-on software engineer with deep experience of software engineering to join our research and development team in India, work on our product and provide end-to-end solutions.What does the role involve? This software engineer will be responsible for all aspects of software development including application architecture, designing, coding and unit testing. This is a hands-on position and the candidate is expected to write code on daily basis. The engineer will be part of a global software development team and should have strong interpersonal, communication and analytical skills.Responsibilities includeConceiving, developing, releasing and maintaining features. For us, a feature isn’t delivered until it’s in production and each team member is responsible for the features that they release.Contributing to overall technical architectureUnderstanding, prioritizing and paying off technical debtMeasuring, diagnosing and improving product performanceFamiliarity with Windows and Linux development environmentsWhy work for us?Compensation is higher than market salaryPotential Stock OptionsStimulating challenges that fully use your skills, e.g. real-world technical problems to which solution cannot simply be found on the internetWorking alongside other passionate, talented engineersOur fast-growing company offers the potential for rapid career progression
Read more
Prodio DesignWorks
at Prodio DesignWorks
3 recruiters
VAIBHAVI RAO
Posted by VAIBHAVI RAO
Mumbai
0 - 3 yrs
₹3.3L - ₹4.5L / yr
NodeJS (Node.js)
Javascript
Communication Skills
HTML/CSS
React.js
+2 more
The Candidate is expected to join with reasonable learning ability and intensity of purpose. We'll take care of his skill graph over 2 years into the following areas.Front-EndWeb fundamentals like HTML, JavaScript, and CSSCSS preprocessors like Sass or LESSJavaScript frameworks like AngularJS, React, or Ember etc., or JS-based build tools like Grunt, Gulp, and BowerLibraries like jQuery or Backbone.jsFront-end (CSS) frameworks like Foundation or BootstrapAJAXBack-EndAPI design and developmentCRUD (Create, Read, Update, Delete)RESTful ServicesWeb fundamentals like HTML, JavaScript, and CSSServer-side languages like PHP, Python, Ruby, Java, JavaScript, and .NetDatabase technologies like MySQL, Oracle, PostgreSQL, and MongoDB.Web server technologies like Node.js, J2EE, Apache, Nginx, ISS, etc.
Read more
Ez Rankings It Services
at Ez Rankings It Services
1 video
1 recruiter
Mansi Rana
Posted by Mansi Rana
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹10L - ₹16L / yr
Search Engine Optimization (SEO)
Web Analytics
Community Management
Viral Marketing
Content Writing
We are looking for an SEO expert of at least 1+ years of work experience to manage all SEO related activities. You will be responsible for managing all SEO activities such as keyword analysis, link building and content strategy to increase rankings on all major search engines.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos