Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Gurugram
2 - 3 yrs
₹22L - ₹25L / yr
Financial reporting
Financial analysis

CA Candidates are not applicable for this role.

2. Need candidate from Tier 1 and Tier 2 colleges only.

3. 2–3 years of hands-on experience in Financial Analysis / FP&A

4. Strong proficiency in Financial Modelling, forecasting, budgeting, and variance analysis

5. Experience preparing financial reports, presentations, and management dashboards with Advance Excel skills.

6. Strong attention to detail with high accuracy in analysis and reporting

7. Strong problem-solving skills and ability to recommend practical solutions on different Scenarios.

8. Candidate should be good in Cost Management

Read more
AVE-Promagne Business Solutions LLP
Jaipur
5 - 10 yrs
₹3L - ₹5.5L / yr
HR management
Human Resources (HR)
Human Resource Management System (HRMS)
What a Typical day looks like: • In consultation with business leaders and HR colleagues, develop and deliver an annual HR plan for meeting business needs. • Provide advice and support to business leaders on key HR matters, including organizational design and restructuring, talent management / talent development, career development, employee engagement etc • Coordinate and facilitate delivery of cyclical HR initiatives (such as recruiting, workforce planning, new hire training, performance review, talent review, succession planning, compensation planning and review) for the site / businesses. • Drive employee communications / engagement within business segment. • Assist with HR communications and training of managers on new programs, systems and processes as required • Responsible to support compliance policies and its effective implementation. The experience we’re looking to add to our team: • Requires a degree in Human Resources Management or related areas. MBA a plus. • Typically requires a minimum of 10 years of related experience. • Self-starter who demonstrates accountability for results. • Sound knowledge of Organization Development, Change Management and HR practices. • Excellent business acumen and demonstrated competency in business partnership. • Excellent interpersonal skills with the ability to build rapport quickly with senior management and communicate effectively with all levels of the organization. • Strong project management, process management, analytical and consulting skills. Judgment, initiative, and tenacity demonstrated in an environment of rapid change. • Ability to collaborate globally across boundaries, disciplines, and cultures, especially in an evolving matrix environment. • Effective verbal and written communication skills accompanied with cultural sensitivity. Excellent planning, co-ordination, and organizational skills. • Strong process orientation. Use of the following tools may be required: Office Skills: telephones, data entry, HR related and office software to include, word processing, spread sheets, and presentation packages.
Read more
Cambay Healthcare LLC
Vadodara
0 - 1 yrs
₹1.9L - ₹2.6L / yr
Communication Skills
Customer Relationship Management (CRM)
Negotiation
Relationship building
Business Development
+1 more

Job description:

  • Maintain the database of candidates along with all follow-ups related information.
  • Posting vacancies on portals.
  • Match the profile of the candidate on technical grounds Responsible for negotiation, paperwork validation and closed candidates for assigned requisitions.
  • Responsible for editing and formatting resumes matching consistency and giving visual and technical perfection to them for presenting it to clients.
  • Maintaining Candidate/Vendor relation on the progress of submittals made, Interview Coordination and taking care of the joining formalities, background checks, references, coordination with internal accounting team and for timesheets, etc.
  • Ensure the target is met in terms of required submittals daily as well as required number of placements.
  • Marketing our Bench Consultants (H1 Transfer/OPT/CPT/F1/L1, GC, and US CITIZEN).
  • Developing new contacts with tier 1 vendors / Clients. Someone who has been in the industry and can be bring existing clients to support us.
  • Should be able to generate Leads by cold calling to acquire a new direct client.
  • Understanding their requirement and clearly articulating the resume and formatting it as required.
  • Communicating with the consultants daily and update about submissions and interviews.

Required Candidate profile:

  • Any graduate can apply (BBA/BCOM will be preferable)
  • Good Communications Mandate.

Experience:

  • Freshers and Experienced (Min 6 months relevant experience)

Working Location:

  • 3rd Floor Vicenza House, Friends Society, Opp. C H Jewellers, Alkapuri, Vadodara, Gujarat 390007

Working Hours:

  • US Shift (Mon-Fri)
  • Onsite


Read more
zazzy
at zazzy
2 recruiters
Gurnoor Juneja
Posted by Gurnoor Juneja
Pune
1 - 3 yrs
₹4.5L - ₹6L / yr
User Experience (UX) Design
Design thinking
Interaction Design
Problem solving
As a part of your role as UX designer, you will be responsible for various client projects in different domains. You will be required to apply different UX processes after understanding the business needs and have good communication to present the work done to the client. You will work closely with the UI and development team to make sure the designs are delivered as per the UX.

We are looking for someone who :
1. Creates designs based on logic, reason and research 
2. Is eager to learn and explore new ideas in every project. 
3. Self-driven and motivated to keep learning and up-skilling
4. Understands the importance of being a team player. 
5. Not afraid to make mistakes and learn from them.

Team collaboration and good communication is highly valued at zazzy. We are a hands-on team who are enthusiastic and passionate about what we do. If this sounds like you, we would love to know more and see how we can work together. 
Read more
BluetickVR
at BluetickVR
4 recruiters
Anshul Padyal
Posted by Anshul Padyal
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹6L - ₹8L / yr
skill iconPHP
MySQL
To work on an already developed php product. Major work would involve making the desired changes in the php based app
Read more
Redcrackle
at Redcrackle
1 recruiter
Alpna Prasad
Posted by Alpna Prasad
Remote only
5 - 15 yrs
₹15L - ₹30L / yr
skill iconJavascript
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
Major skills : React JS, NodeJS, MongoDB, Express JS, AWS.

The candidate must have :

1. Excellent problem solving and logical skills.

2. Highly proficient with Node JS and JavaScript design patterns.

3. Developing RESTful APIs that read and write JSON.

4. Experience with databases like MongoDB, Redis or any NoSQL databases.

5. Proficient understanding of code versioning tools, such as Git.

6. Experience with AWS, Elastic Search would be an added advantage.

7. Ability to plan, execute projects to deliver in time and with quality.

8. Highly motivated Individual to learn and to mentor project members.

9. Excellent Communication and collaboration skills.
Read more
Rave Digital
at Rave Digital
1 recruiter
Sneha Mishra
Posted by Sneha Mishra
Indore
0 - 6 yrs
₹2L - ₹8L / yr
skill iconPHP
Wordpress
Drupal
Web

We are looking for CMS (WordPress and Drupal) Developers for our offshore development center in Indore, India.

Responsibilities:

  • 1+ years experience in development, theming.
  • Must have knowledge of Customizing WordPress and Drupal Applications
  • Develop modify and enhance CMS plugins.
  • Develop high-performance, highly scalable, custom development and/or plugin development for WordPress and Drupal sites – integrating templates into CMS.
  • Mentor to Junior Developers
  • Ability to juggle multiple client projects of varying scope, complexity, and effort.

Requirements:

  • Graduate in Computer Science.
  • The overall experience of 1+ years in Software Development.
  • We are looking for solid CMS (WordPress and Drupal) developer who should have done 3 or more CMS (WordPress and Drupal) projects.
  • CMS (WordPress and Drupal) experience is a must.
  • 1+ years of experience in development, theming.
  • Should be able to write design/requirements documentation.
  • Ability to understand technical documents like SRS, Design Document.
  • Self-motivated and proactive professional who can take ownership of modules/projects.
  • Fluent English communication (verbal & written).
Read more
Manufacturing Company
Manufacturing Company
Agency job
via Kalibre global konnects by Sophiya Sama
Ahmedabad
1 - 1 yrs
₹1.8L - ₹2.4L / yr
Marketing
Sales
Industrial relations
B2B Marketing
Sales presentations
Hello Marketing Professional,

We are looking for a talented #MarketingExecutive to undertake marketing projects for the benefit of our company in one of the well-known pipes manufacturing company..
Location: Navrangpura ,Ahmedabad
Exp: 1 to 3year
Salary: 15k to 20k + petrol Allowances+ Performance incentive
vacancy: - 03
Job Type: Full-time
requiredskills: Curiosity, Modesty, Sales ability, Good observational skills, Innovation, Sense of responsibility, Relationship builders, Eternal learners, Creativity, Adaptability
references are highly appreciated!
Read more
Airtel Xlabs
at Airtel Xlabs
2 recruiters
Pragya Singh
Posted by Pragya Singh
NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore)
5 - 12 yrs
₹18L - ₹45L / yr
skill iconJava
skill iconMongoDB
NOSQL Databases
Spring

Out of many tools and technologies, we use Java, MongoDb, Cassandra, Redis, Twem, Netty extensively for our back-end development.

 

  • Leading the entire Backend platform for a product portfolio.
  • End to end delivery new features.
  • Evolving the architecture for performance and scalability.
  • Design, develop and own components of a highly scalable, distributed web services platform.
  • Constantly strive to improve software development process and team productivity.
  • Mentor and train team members
  • Lead module development independently

 

Required background, Knowledge, Skills and Abilities

 

  • 5.5+/ 7+ Years of experience in a scalable product/ecommerce organization·       
  • Excellent Java skills, Understanding of Spring framework & MVC approach
  • Strong knowledge of Performance optimization and caching techniques.
  • Strong Object Oriented Programming concepts, data structure and algorithms
  • Experience in developing scalable, fault-tolerant, distributed backend services
  • Experience with prevalent design patterns and advanced system designing
  • Good experiences with databases and Schema design. We heavily use NoSQL databases
  • Strong Problem Solving skills
Read more
Agilatest Technologies
at Agilatest Technologies
1 recruiter
Saurabh Chaturvedi
Posted by Saurabh Chaturvedi
Pune
0 - 1 yrs
₹1L - ₹2L / yr
skill iconPHP
skill iconHTML/CSS
MySQL
AJAX
skill iconCodeIgniter
We are looking for freshers in following technologies: 1. PHP Developer 2. Graphics Designer 3. Software Tester
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos