Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Resources Valley
at Resources Valley
1 recruiter
Manind Gupta
Posted by Manind Gupta
Jaipur
1 - 10 yrs
₹3L - ₹15L / yr
skill iconPHP
MySQL
skill iconLaravel
skill iconCodeIgniter
Yii

Requirements:

  • Knowledge of PHP web frameworks including Yii, Laravel, or CodeIgniter.
  • Knowledge of front-end technologies including CSS3 JavaScript, and HTML5
  • Understanding of object-oriented PHP programming.
  • Previous experience creating scalable applications.
  • Proficient with code versioning tools including Git, Mercurial, CVS, and SVN.
  • Familiarity with SQL/NoSQL databases.
  • Ability to project manage.
  • Good problem-solving skills.

Qualifications and Skills:

  • Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent work experience).
  • Proven experience as a PHP Developer with a portfolio showcasing PHP development projects.
  • Proficiency in PHP programming and experience with one or more PHP frameworks.
  • Strong understanding of web development principles, HTML, CSS, and JavaScript.
  • Familiarity with front-end libraries and frameworks (React, Angular, Vue. js) is a plus.
  • Knowledge of database management systems (e. g. , MySQL) and SQL queries.
  • Experience with version control systems (e. g. , Git) and collaborative coding workflows.
  • Ability to work collaboratively in a team environment, communicate effectively, and provide constructive feedback.
  • Problem-solving skills and the ability to debug and troubleshoot technical issues.
  • Benefit from invaluable mentorship provided by seasoned leaders.
  • Enjoy a vibrant atmosphere enriched with engaging games and activities.
  • Receive quarterly rewards as a token of recognition for your valuable contributions.
  • Immerse yourself in a creative and open culture that fosters innovation.


Read more
Bengaluru (Bangalore)
1 - 4 yrs
₹8L - ₹15L / yr
B2B sales
International sales
US Sales

Ideal Candidate

1+ year of experience working as a business development representative (or other relevant roles) at a B2B SaaS company.

Solid hustle and entrepreneurial mindset; Thrive under the uncertainty that comes with an early stage setup.

Excellent written and oral communication skills.

Experience working with CRM, lead databases, sales engagement tools, ChatGPT, etc

Familiarity with CRM systems and proficiency in managing leads, pipelines, and automations

Willingness to get your hands dirty and do the grunt work in the early days

Strong first principles understanding of business fundamentals; Ability to empathize with the end user, and understand their pain points; Ability to understand the product at a granular level

Comfortable working late at night to ensure sufficient overlap with US prospects

Self-driven individual with high ownership and strong work ethic

Ability to build, manage and motivate a team

Not taking yourself too seriously :)

Read more
Pune
5 - 10 yrs
₹15L - ₹40L / yr
skill iconC#
skill iconC++
Windows Presentation Foundation(WPF)
User Interface (UI) Design

About Us

CCTech's mission is to transform human life by the democratization of technology. We are a well established digital transformation company building the applications in the areas of CAD, CFD, Artificial Intelligence, Machine Learning, 3D Webapps, Augmented Reality, Digital Twin, and other enterprise applications.

We have two business divisions: product and consulting. 

simulationHub is our flagship product and the manifestation of our vision. Currently, thousands of users use our CFD app in their upfront design process.

Our consulting division, with its partners such as Autodesk Forge, AWS and Azure, is helping the world's leading engineering organizations, many of which are Fortune 500 list of companies, in achieving digital supremacy.


Job Description

We are seeking highly skilled C# developers with over 5+ years of experience. The ideal candidates will have a strong background in .NET development, with a focus on performance improvement and concurrent programming. You will play a key role in designing and optimizing high-performance applications while working collaboratively with a dynamic team.


Responsibilities:

  • Collaborate with the development team to enhance and globalize the application.
  • Analyze and implement features, bug fixes, and optimizations in the codebase.
  • Write clean, efficient, and maintainable code in C# and/or C++.
  • Adapt and extend existing code to support internationalization and localization requirements.
  • Conduct unit testing, integration testing, and debugging to ensure robust and reliable software.
  • Work closely with QA to ensure quality assurance and address identified issues.
  • Provide technical support and documentation for developed features.
  • Coordinate with cross-functional teams and stakeholders, ensuring timely delivery of project milestones.


Requirements

Required Skills and Qualifications:

  • 5+ years of experience in Windows application development using C# or C++.
  • Strong understanding of object-oriented programming and design principles.
  • Proficiency in working with Windows Presentation Foundation (WPF) or similar UI frameworks.
  • Experience with globalization/localization processes, including handling multilingual user interfaces and data.
  • Solid understanding of Windows APIs and system-level programming.
  • Familiarity with version control systems like Git.
  • Strong problem-solving skills and the ability to debug complex systems.
  • Flexibility to work at least half of the time in US Portland timezone.

Preferred (Good to Have) Skills:

  • Knowledge of CAD software.
  • Experience with COM-based development.
  • Experience in integrating or maintaining localization frameworks in existing applications.
  • Understanding of software performance optimization techniques.
  • Prior experience working with global teams and distributed development workflows.


Benefits :

  • Opportunity to work with a dynamic and fast-paced IT organization.
  • Make a real impact on the company's success by shaping a positive and engaging work culture.
  • Work with a talented and collaborative team.
  • Be part of a company that is passionate about making a difference through technology.


Read more
HashRoot
Agency job
via HashRoot by Deepak S
Remote only
4 - 15 yrs
₹6L - ₹15L / yr
Windows Azure
DevOps
SQL
Shell Scripting
Bash
+2 more

Overview

As an engineer in the Service Operations division, you will be responsible for the day-to-day management of the systems and services that power client products. Working with your team, you will ensure daily tasks and activities are successfully completed and where necessary, use standard operating procedures and knowledge to resolve any faults/errors encountered.


Job Description

Key Tasks and Responsibilities:

Ensure daily tasks and activities have successfully completed. Where this is not the case, recovery and remediation steps will be undertaken.

Undertake patching and upgrade activities in support of ParentPay compliance programs. These being PCI DSS, ISO27001 and Cyber Essentials+.

Action requests from the ServiceNow work queue that have been allocated to your relevant resolver group. These include incidents, problems, changes and service requests.

Investigate alerts and events detected from the monitoring systems that indicate a change in component health.

Create and maintain support documentation in the form of departmental wiki and ServiceNow knowledge articles that allow for continual improvement of fault detection and recovery times.

Work with colleagues to identify and champion the automation of all manual interventions undertaken within the team.

Attend and complete all mandatory training courses.

Engage and own the transition of new services into Service Operations.

Participate in the out of hours on call support rota.


Qualifications and Experience:

Experience working in an IT service delivery or support function OR

MBA or Degree in Information Technology or Information Security.

Experience working with Microsoft technologies.

Excellent communication skills developed working in a service centric organisation.

Ability to interpret fault descriptions provided by customers or internal escalations and translate these into resolutions.

Ability to manage and prioritise own workload.

Experience working within Education Technology would be an advantage.


Technical knowledge:

Advanced automation scripting using Terraform and Powershell. 

Knowledge of bicep and ansible advantageous. 

Advanced Microsoft Active Directory configuration and support.

Microsoft Azure and AWS cloud hosting platform administration.

Advanced Microsoft SQL server experience.

Windows Server and desktop management and configuration.

Microsoft IIS web services administration and configuration.

Advanced management of data and SQL backup solutions.

Advanced scripting and automation capabilities. 

Advanced knowledge of Azure analytics and KQL.

 

Skills & Requirements

IT Service Delivery, Information Technology, Information Security, Microsoft Technologies, Communication Skills, Fault Interpretation, Workload Prioritization, Automation Scripting, Terraform, PowerShell, Microsoft Active Directory, Microsoft Azure, AWS, Microsoft SQL Server, Windows Server, Windows Desktop Configuration, Microsoft IIS, Data Backup Management, SQL Backup Solutions, Scripting, Azure Analytics, KQL.

Read more
Triveous
at Triveous
2 recruiters
Dibyasree Nandan
Posted by Dibyasree Nandan
Remote only
1.5 - 3 yrs
₹3L - ₹5.5L / yr
User Experience (UX) Design
User Interface (UI) Design
Product design

Tasks and Responsibilities

  • Understand business requirements and user needs
  • Create user personas, journey maps, and various other design artifacts
  • Create prototypes of varying fidelity
  • Communicate design solutions to key stakeholders
  • Define and track key metrics related to user experience
  • Utilize quantitative and qualitative research to generate meaningful insights that will drive creative concepts

Skills and Requirements

  • Experienced with 1.5+ years in Product Design/UX roles.
  • Good experience in user experience and interface design, with a supporting portfolio
  • Experience in designing mobile and web applications
  • Experience in understanding and mapping complex user journeys
  • Ability to form, prototype, and clearly communicate ideas and decisions.
  • Business know-how: Understanding of business metrics and the ability to translate company goals and objectives into digital experiences
  • Familiarity with prototyping tools like Figma/Sketch
  • Good problem-solving and analytical skills
  • Able to work well with remote, cross-functional teams
  • Responsible, self-motivated, and comfortable taking the initiative.
  • Attentive to the finer details and love what you do


Read more
Technology product Startup company based in Bangalore.2
Technology product Startup company based in Bangalore.2
Agency job
via Multi Recruit by Sapna Deb
Bengaluru (Bangalore)
2 - 5 yrs
₹10L - ₹12L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconJavascript
SQL
  • Bachelor’s degree in Computer / Information Science (BE / BTech) or Master’s in Computer Applications (MCA) Experience:
  • Two to five years general software engineering experience
  • Experience in web development using the Ruby on Rails web application framework
  • At least two years of Ruby on Rails programming experience
  • Thorough understanding of the philosophy and design of Ruby on Rails
  • Desktop publishing skills: HTML5, xHTML, CSS

Knowledge of:

  • JavaScript and JavaScript libraries: jQuery, Plugins etc.
  • Unix and Linux systems
  • Relational databases: SQL, etc.
  • Frameworks: Active record, etc.
  • Servers: Nginx, Mongrel, Webrick
  • Performance management using New Relic, Web Page Test tools
  • SEO rules, minification, rails asset pipelines
  • REST APIs and their usage

 

Highly preferred experience:

  • Ability to work with the Amazon EC2, S3, and EBS services
  • NoSQL databases: MongoDB, Memcached, CouchDB
  • Git, SVN
  • Proactive and resourceful person who achieves tasks with minimal oversight
  • Team player with the ability and desire to become an integral part of a fast-paced team
  • Ability to handle multiple tasks in parallel
Read more
Recro
at Recro
1 video
32 recruiters
Samiksha  Singh
Posted by Samiksha Singh
Remote only
3 - 5 yrs
₹1L - ₹10L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Hey Java Experts,

Are you looking for a job opportunity?

Here you go, there is an opportunity to work with leading startups and unicorns in INDIA at RECRO.

 

JOB DESCRIPTION

1.Contribute in all phases of the development lifecycle.

2.Write well designed, testable, efficient code.

3.Ensure designs are in compliance with specifications.

4.Prepare and produce releases of software components.

5.Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

 

Requirements:

2.5 + years experience in development in JAVA technology.

2.Exposure in SpringBoot or Spring MVC and J2EE.

3.Strong Java Basics and good at problem solving.

4.Hands on experience on Relational databases (SQL query or Hiberent)+ Mongo( JSON parsing)

4.Proficient in REST API development.

5.Understanding of AI/ML algorithms is a plus.

Employment Type

Full-time

 
Read more
KhataBook Office
at KhataBook Office
2 recruiters
Carol Lucas
Posted by Carol Lucas
Bengaluru (Bangalore)
3 - 7 yrs
₹25L - ₹60L / yr
skill iconAndroid Development
skill iconKotlin
Mobile App Development
  • Design, build and maintain high performance, reusable, and reliable Java & Kotlin code
  • Writing unit-tests code for robustness, including edge cases, usability, and general reliability
  • Take ownership of product/features: End to end development with testing and meet the deadline
  • Work closely with our product and design teams to customize the Khatbook experience for the Android platform.
  • Prototype new and redesign features.
  • A focus on UI design principles and making apps work intuitively.
  • Contribute best-in-class programming skills to develop highly innovative, consumer-facing mobile products.
  • Writing efficient android code in Java/Kotlin following MVP framework guidelines.
  • Tracing and profiling android java code. Own and manage the finance technology control frameworks.
Read more
Quixote Automotive Technologies Pvt. Ltd.
Ahmedabad
3 - 8 yrs
₹1.8L - ₹12L / yr
Hardware
PCB
3D CAD
Embedded Hardware

When you join us, you’ll lead the full-cycle development of the hardware focusing on robust and cost-effective solutions for hardware design, layout design and the fabrication of PCBs. You’ll be responsible for the successful production of the hardware coordinating directly with the production team. Your role will be crucial to Quixote’s success.


DUTIES & RESPONSIBILITIES 

  • Design multi-layer printed circuit board layouts incorporating the latest fabrication and assembly standards. 
  • Design the schematics for the PCB and gather their inputs to ensure the electrical characteristics of the PCB are within specification.
  • Collaborate with mechanical, fabrication, manufacturing and test engineers for a functional, cost-effective layout.
  • Develop, check and release full documentation packages as required per work instructions and project requirements.
  • Analysis and evaluation of company requirements, initial BoM creation and component selection accordingly with consideration of costs, schedule, platform, quality etc. 
  • Development of complex modules & components of the latest technology to implement them into other projects and future automotive systems 
  • Develop modules & components’ system design, schematic design/integration, layout design following design rules, design verification 
  • Evaluation of relevant technology, functions regarding requirements, market trends and feasibility together with other engineering core teams & procurement to ensure the best design & best cost 
  • Observation and analysis of latest technology trends, the definition of next-generation key components together with other technical division and key component suppliers 
  • Preparation of technical supplier decisions for the business units and automotive executive management according to the development process, evaluate risks and opportunities 
  • Close cooperation with different functional teams such as Controlling, Legal, Purchasing, Manufacturing Engineering, Quality, Customer Business Units

REQUIRED SKILLS & EXPERIENCE 

  • Understand how to develop PCB layouts for digital, analog, and power supply circuits on multilayer PCBs.
  • Excellent knowledge of fine-pitch designs with multiple BGAs, blind and buried VIAs, and high part densities.
  • Expert with industry standard commercial PCB layout CAD software, such as Mentor Graphics, OrCAD, Cadence, Zuken, or similar but should be flexible to switch to any of them.
  • Knowledge of PCB manufacturing tools such as Valor, SAP, and GerbTool software
  • Good knowledge of hardware function blocks, memory designs & high speed interfaces
  • Basic understanding of electrical schematic symbols and functions.
  • Ability to create dimensioned drawings for release.
  • Possess functional knowledge of IPC guidelines.
  • Excellent technical understanding of electrical designs inside automotive field is a plus
  • Should be passionate, diligent, thorough, and detail oriented
Read more
Anibrain
at Anibrain
2 recruiters
Sneha AnibrainHR
Posted by Sneha AnibrainHR
Pune
0 - 3 yrs
₹0L - ₹10L / yr
academic
PR Activities
Communication Skills
We are India's leading VFX facility, delivering high-end VFX Services to big banners, Hollywood Studios & global blockbusters CEO, Jesh Murty, laid the foundation stone of Anibrain, with a few employee and small facility Spread over 8000 sq. ft. & 400+ employee base, entrenched in Pune, India & Los Angeles, USA , has emerged as India’s most efficient Studio in stereoscopy Anibrain’s renowned quality & deliverables can be seen in more than 85+ Award winning Hollywood Films namely Guardians of the Galaxy, The Mortal Instruments, Pompeii, Ghost Rider: Spirit of Vengeance, Terminator, Resident Evil, Salt, Harry Potter etc. to name a few.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos