Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

D2C E-commerce Startup
D2C E-commerce Startup
Agency job
via Merito by Merito Talent
Mumbai
3 - 6 yrs
₹12L - ₹20L / yr
Procurement & Buying
Procurement management
Sourcing
Sourcing management
Procurement
+1 more
About Merito :

Merito is a curated talent platform where we identify, assess, and connect candidates for matching job opportunities. We are working with the mission to change the way hiring is done. The company is founded by a team consisting of alumni from IIM Ahmedabad, McKinsey with more than 2 decades of experience in recruitment, training, and coaching.

About our Client :

Our client is an Indian retail conglomerate which is setting up a tech driven brand co-creation platform that transforms powerful ideas into authentic, profitable and experience-led brands that will define the future of brands in fashion, beauty, food and home decor space.

Role: Manager - Sourcing / Procurement

This opportunity is for new brands that are in stealth mode & backed by major retail giant. It's a house of Personal care D2C brands in the space of haircare, skin care & kids personal care.

In 2020, CoVid 19 affected every business, few positively and many negatively. However, E- commerce adoption has gone through the roof and we have seen consumer's e-commerce spends grow. India's fast-growing e-commerce market is seen growing by 30 percent a year to $200 billion (roughly Rs. 14,68,640 core) by 2026.

On the back of strong product-market fit and a change in human behaviour due to CoVid that buoyed e-commerce, we are currently building D2C personal care brands. The overall D2C market in India is expected to reach $100 billion in the next 7-8 years. We will be building a digital first content led approach to target this community of consumers. We aim to win shoppers at the moment of purchase by algorithmically managing demand forecasting, promotions and advertising spend, supply chain, content optimization and other aspects that help shoppers make online purchase decisions, all backed by Data Science.


Requirement :-

- 3-5 Yrs Exp. Ecommerce / D2C exp preferred
- Ideally from the future ecosystem, who will be able to manage imports, TP purchases
- Also lead Traded Products + Packaging Procurement.

Read more
Genius Placement Services
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
1 - 2 yrs
₹1L - ₹3L / yr
Human Resources (HR)
Generalist
Interpersonal Skills
Job description:

Hiring And Interviewing Staff, , Benefits, And Leave, And Enforcing Company Policies And Practices. Handles Employment-Related Inquiries From Applicants, Employees, And Supervisors, Referring Complex And/Or Sensitive Matters To The Appropriate Staff.
Read more
TechUnity Software Systems India Pvt Ltd;
Senthil Kumar M
Posted by Senthil Kumar M
Coimbatore
3 - 5 yrs
₹5L - ₹15L / yr
skill icon.NET
ASP.NET
skill iconC#
MVC Framework
ASP.NET MVC

We at TechUnity Inc, is looking for a .Net developer to build software using languages and technologies of the .NET framework. Your goal will be to work with internal teams to design, develop and maintain software.

Responsibilities

  • Participate in requirements analysis
  • Collaborate with internal teams to produce software design and architecture
  • Write clean, scalable code using .NET programming languages
  • Test and deploy applications and systems
  • Revise, update, re factor and debug code
  • Improve existing software
  • Develop documentation throughout the software development life cycle (SDLC)
  • Serve as an expert on applications and provide technical support
  • Requirements and skills
    • Proven experience as a .NET Developer with MVC knowledge
    • Familiarity with the ASP.NET framework, SQL Server and design/architectural patterns (e.g. Model-View-Controller (MVC))   Knowledge of at least one of the .NET languages (e.g. C#, Visual Basic .NET) and HTML5/CSS3
    • Familiarity with architecture styles/APIs (REST, RPC)
    • Understanding of Agile methodologies
    • Excellent troubleshooting and communication skills
    • Attention to detail
    • BSc/BEin Computer Science, Engineering or a related field
    • Candidate should be from Coimbatore location
    • Candidate must have a two-wheeler
    • Willing to work US timings i.e 02:00 PM to 11:00 PM IST
Read more
Metawing Pvt Ltd
at Metawing Pvt Ltd
1 recruiter
Ashwin Kain
Posted by Ashwin Kain
Gurugram
1 - 2 yrs
₹4L - ₹8L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
skill iconReact Native
RESTful APIs
+1 more
Roles & Responsibilities :

- Optimizing components for maximum performance across a vast array of web-capable devices and browsers

- Ability to understand business requirements and translate them into technical requirements

- You will ensure that these components and the overall application are robust and easy to maintain.

- Have a good understanding of design and user experience principles.

- Open-minded, flexible, and willing to adapt to changing situations

- Ability to work independently as well as on a team and learn from colleagues

- High adaptability in a dynamic start-up environment

- Ensuring technologies are used efficiently, profitably, and securely. Evaluating and implementing new systems and infrastructure.

- Excellent troubleshooting, analytical and problem-solving abilities with a tenacious commitment to finding the root cause of issues.

Qualifications :

- B. Tech/B.E/MTech or a related technical discipline from reputed universities

Skills Required :

- Minimum 1+ years experience in Front-End Development using ReactJS Framework

- Experience in consuming Restful Web services

- Strong hands-on experience on HTML5, CSS3, JavaScript, Bootstrap & CSS preprocessors

- Should be adept at converting PSD to HTML

- Should know UI/UX

- Excellent development skills on best practices for cross-browser compatibility and Responsive UI.

- Good with agile development practices such as continuous integration and deployment

- Knowledge of Version Control System

- Write and maintain technical documentation

- Knowledge of MVVM Architecture

- Cares deeply about writing Quality, Testable & Modular code
Read more
eMandi
at eMandi
1 recruiter
Keshav Agarwal
Posted by Keshav Agarwal
Mumbai
5 - 8 yrs
₹8L - ₹15L / yr
skill iconPHP
skill iconLaravel
MySQL

Responsibilities

  • Server Side Programming Languages: PHP & Laravel (MUST)
  • Framework: Express, Sails.js, Laravel, Node.js .
  • Web Server technologies: Apache, Nginx.
  • Database creation and integration: MySQL (MUST), PostgreSQL, MongoDb.
  • Cloud computing integration e. g., public cloud providers like Amazon Web Services, or private cloud environments.
  • Integration of user-facing elements developed by front-end developers with server side logic.
  • Optimisation of the application for maximum speed and scalability.
  • Implementation of security and data protection.
  • Design and implementation of data storage solutions.
  • Creating database schemas that represent and support business processes.
  • Setup and administration of backups.
  • Management of hosting environment, including database administration and scaling an application to support load changes

 

    Requirements

  • Knowledge of presenting data in different formats
  • Bachelor's degree or equivalent experience in Computer Science with minimum 5+ years of industry experience.
  • Technical depth across multiple languages.
  • Able to meet deadlines.
  • Leadership experience.
  • Strong communications skills.
  • Proficient in writing REST APIs.
Read more
A digital product engineering company
A digital product engineering company
Agency job
via PeopleBridge by Amitabh Kumar
Remote, Noida, NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹5L - ₹10L / yr
skill iconReact.js
js framework
angular js
Html 5
Css 3
Note-April joiners only.
 
React JS JD
 

Job Description

  • Maintain quality and ensure the responsiveness of applications.

  • Hands on experience on ReactJS , JS frameworks, Angular JS (nice to have)

  • Understanding of Material Design and Accessibility

  • Hands on experience with HTML5 & CSS3.

  • Ensure that software meets or exceeds specified standards and end-user requirements

  • Handling end to end UI development, Unit Testing for the project.

  • Build reusable code and libraries for future use

  • Optimize application for maximum speed and scalability

 

Read more
Casey Foods
at Casey Foods
7 recruiters
Abhipsa Padhi
Posted by Abhipsa Padhi
Remote, Khurda
3 - 7 yrs
₹3L - ₹3L / yr
Team building
Team Management
Communication Skills
Sales and operations planning
Problem solving
+3 more

We require District Sales Manager for the Khurda District to carry out the sales activity, and the incumbent should be compatible to carry out the following activities. The candidate must be male, belonging to the respective district and having a sound knowledge about the area, district and block. He must have at least 4 years of experience with FMCG/Retail/Insurance sectors. 

  • To appoint Block Sales Manager in all their blocks coming under their Districts.
  • To create a super stock point in their district headquarters.
  • To manage Sales operations in the assigned district to achieve revenue goals.
  • To supervise sales team members on daily basis and provide guidance whenever needed.
  • To identify skill gaps and conduct training to the sales team.
  • To work with the team to implement new sales techniques to obtain profits.
  • To assist in employee recruitment, promotion, retention and termination activities.
  • To conduct employee performance evaluation and provide feedback for improvements.
  • To contact potential customers and identify new business opportunities.
  • To stay abreast of customer needs, market trends and competitors.
  • To maintain clear and complete sales reports for management review.
  • To build strong relationships with customers for business growth.
  • To analyze sales performances and recommend improvements.
  • To ensure that the sales team follows company policies and procedures at all times.
  • To develop promotional programs to increase sales and revenue.
  • To plan and coordinate sales activities for assigned projects.
  • To provide outstanding services and ensure customer satisfaction.
Read more
New Empire Corp.
at New Empire Corp.
1 recruiter
Candice Peng
Posted by Candice Peng
Mumbai
2 - 100 yrs
₹2L - ₹2L / yr
Sales
capital market
EB5
Job Description Increasingly recognized as one of the most active and innovative one stop real estate developers in New York City, New Empire Corp. (“New Empire”) offers in-house expertise that spans a myriad of real estate disciplines ranging from the sourcing and analysis of target properties to zoning, capital raising, architecture and design, construction management, marketing and property management. For the past 20 + years, and with a staff of over 300 industry professionals, New Empire has evolved into a fully vertically integrated business that has successfully renovated, built and developed over 100 mixed-use, residential, rental, condo, and hotel real estate projects, in premier locations, throughout New York City, resulting in over $1.5 Billion in real estate sales. Our 2018 Portfolio was $1 Billion Dollars Ground Up Development in The NYC Market. We are selectively searching for a self-motivated sales associate to join our organization to call upon potential equity investors and EB-5 experience will be helpful but not a necessity to invest with us in real estate in 1st MSA’s surrounding the gateway city of NYC and in secondary MSA’s. What we need is the right candidate to have a track record in sales. It is a prerequisite that the right party have experience in: Your responsibilities and daily output for our Sales Associate: • Be a part of a fast paced, energetic work environment working with potential investors • Work closely with Senior Capital Specialists during the closing process • Complete tasks with a sense of urgency • Build quality relationships with new clients • Prospect potential clients, and gather documentation to begin the funding process • Develop leads, cultivate a list of targeted prospects with equity investors, banking, investment banking, capital markets and EB-5 industry • Lead sales efforts, working closely with and reporting to the COO Leadership at our HQ in NYC • Develop relationships and collaborate with leadership to formulate and execute a go-to-market strategy that includes lead generation and CRM data entering daily-specific trends • Understand competitive landscape • Identify and influence decision-makers at all levels for the leads, • Assist COO Led team and practice leaders with qualifying, pursuing, and closing sales opportunities • Develop strategic and tactical plans to meet or exceed your sales objectives • Maintain accurate and timely customer, pipeline, and forecast data working with Sales Operations team and populate our CRM daily • Develop a client base by canvassing and conducting meetings You should possess: • Minimum 2 year experience in Capital Markets, Real Estate or EB-5 industry. A successful and proven sales history, Previous experience in above sales is not a prerequisite but is preferred • Results-driven and self-motivated • Comfortable conducting business over the phone • Articulate and well spoken, strong communicator • Strong time management skills • Works well in a telecommunicating-environment • Strong work ethic and professional attitude • Demonstrated abilities in sales, marketing and networking • Proficient in Microsoft office • Excellent communication and networking skills • Self-motivation and drive • Financial background is a plus • Must have an India Driver’s License • Must have a Laptop Computer and Webcam capability The Benefits of working with New Empire Group and its vertically integrated divisions: • Competitive Base Salary and Commission Structure USD • Opportunity for Advancement • Monthly Company Events and Contests • Comprehensive Product and Industry Training • Mobile Phone & CRM provided NOTE: Fluent Hindi/other official languages of India and English speakers will be given preference Job Type: Full-time
Read more
RESTOLABS
at RESTOLABS
2 recruiters
YOGITA JAYSAWAL
Posted by YOGITA JAYSAWAL
Noida, NCR (Delhi | Gurgaon | Noida)
0 - 1 yrs
₹2L - ₹3L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconPHP
skill iconAngularJS (1.x)
Restolabs is looking for a skilled creative genius who not only loves to design but also loves to code his way through those designs. The dev will be joining a high-performance start-up team for adding his design sense to the product and giving it a skin for an enhanced look and feel. We would love to have someone who believes in leading from the front and is always willing to go the extra mile. The dev should have strong knowledge of building responsive and progressive web applications based on PHP framework. Our culture is not to dictate but to let you define your role yourself; you will get ample opportunity to experiment with your work and build it through. If you are the guy who takes pleasure in seamless user experiences, have an eye for great design, and have the ability to combine brilliant UI with the art of programming, then come meet us. Required Experience, Skills and Qualifications · Proficiency in PHP, JavaScript, Jquery, HTML, CSS.. · Developed Rich user experience & visualization tools. · knowledge of AngularJS and Node.js is a plus. · Ability and passion to learn new technologies quickly. Responsibilities and Duties · Analyze requirements and propose software solutions to solve problems · Develop layouts and prototypes to ensure the solution meets requirements · Write well-structured and testable code following the set guidelines · Maintain system by monitoring and correcting software bugs · Integrate multiple systems from different vendors with seamless data flow
Read more
Anuvaa Softech Pvt Ltd
at Anuvaa Softech Pvt Ltd
1 recruiter
Mayur Potdar
Posted by Mayur Potdar
Mumbai, Jalgaon
1 - 3 yrs
₹2L - ₹3L / yr
skill iconJava
skill iconAndroid Development
Mobile Payments
skill iconXML
We are looking for dynamic professionals to lead the start up firm with creativity, passion & dedication. Responsibilities Design and build advanced applications for the Android platform Collaborate with cross-functional teams to define, design, and ship new features. Work with outside data sources and API’s Unit-test code for robustness, including edge cases, usability, and general reliability. Work on bug fixing and improving application performance. Continuously discover, evaluate, and implement new technologies to maximize development efficiency. Requirements BS/MS degree in Computer Science, Engineering or a related subject Proven software development experience Proven working experience in Android development Have published at least one original Android app Experience with Android SDK Experience working with remote data via REST and JSON Experience with third-party libraries and APIs Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies Solid understanding of the full mobile development life cycle.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos