Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

EaseMyTrip.com
at EaseMyTrip.com
1 recruiter
Madhu Sharma
Posted by Madhu Sharma
Noida
2 - 6 yrs
₹3L - ₹6L / yr
ticketing
galelio
PNR
Flights
Aviation
+3 more

We are hiring for Corporate Ticketing (Male)

Location- Noida

Experience- 3+ Yrs

Rotational Shifts (1pm to 10pm)


Required:

●  Possess in-depth knowledge of GDS systems, specifically Galileo and sabre

●  Demonstrate proficiency in managing both international and domestic ticketing operations

●   Strong understanding of city codes, airport codes, and airline hubs.

●   Excellent communication skill in both written and verbal formats

●   Willingness to work in rotational shifts, including nights and weekends


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Poornima Varadarajan
Posted by Poornima Varadarajan
Bengaluru (Bangalore)
5 - 8 yrs
₹18L - ₹20L / yr
skill iconPython
PowerBI
Banking
skill iconData Analytics


Data Analysis visual tools (PowerBI, Streamlit, Dash, etc)

SQL, Python Scripting is mandatory

Cloud knowledge (AWS, etc)

Experience in BFSI domain is must.


Read more
CMS INFO SYSTEMS LTD
at CMS INFO SYSTEMS LTD
2 recruiters
Agency job
via Job Listings by Babblebots by Drashti Parikh
Navi Mumbai
5 - 10 yrs
₹10L - ₹25L / yr
skill iconPython
Internet of Things (IOT)
Message Queuing Telemetry Transport (MQTT)
Edge Development

Responsibilities:

  • We are seeking a highly skilled and motivated Full-Stack Developer with expertise in DVR, NVR, IP Camera integration, and IoT communication. The ideal candidate will have experience with the ONVIF protocol and be capable of developing a seamless, unified application that provides live streaming, NVR/DVR management, and smart home automation.
  • Design and develop robust applications for integrating DVR, NVR, and IP Camera systems.
  • Implement live video streaming using protocols such as RTSP.
  • Develop and maintain RESTful APIs for managing and configuring NVR/DVR settings.
  • Integrate ONVIF protocol to ensure compatibility with ONVIF-compliant devices.
  • Establish and configure IoT communication using protocols like MQTT, CoAP, or HTTP/HTTPS.
  • Integrate smart home automation systems (e.g., Google Home, Amazon Alexa, Apple HomeKit).
  • Collaborate with cross-functional teams to define, design, and ship new features.
  • Write clean, maintainable, and efficient code.
  • Conduct thorough testing and debugging to ensure the reliability and security of the application.
  • Stay updated with the latest industry trends and technologies.


Requirements:

  • Bachelor's degree in computer science, Engineering, or related field, or equivalent practical experience.
  • Proven experience as a Full-Stack Developer or similar role.
  • Strong proficiency in Python & CPP back-end technologies
  • Familiarity with IoT communication protocols (MQTT, CoAP, HTTP/HTTPS).
  • Experience with smart home automation platforms (Google Home, Amazon Alexa, Apple HomeKit).
  • Proficiency in database management (PostgreSQL, MySQL, MongoDB).
  • Solid understanding of security best practices and secure communication channels (TLS/SSL).
  • Hands on with Linux/Debian
  • Experience of working with Raspberry PI/Arduino Uno/Andbox
  • Strong problem-solving skills and the ability to work independently or as part of a team.


Good to have:

  • Knowledge of ONVIF protocol /ONVIF SDKs
  • Working knowledge of IP Camera
  • Excellent communication and collaboration skills.
Read more
Quick Radius
at Quick Radius
1 recruiter
Manish Dodiya
Posted by Manish Dodiya
Ahmedabad
1 - 3 yrs
₹2L - ₹3.5L / yr
Motion graphics
Animation
Adobe Photoshop
skill iconAdobe Illustrator
Adobe Premiere Pro
+3 more

As a Motion Graphics Designer at Quick Radius, you do more than bringing graphics to life. You use your strong creative background to create powerful videos that capture an audience and leaves them wanting more. In addition, you have these skills and experiences:

  • Strong technical skills and proven ability to use a variety of Adobe software (Photoshop, Illustrator, Premiere Pro, After Effects, Audition)
  • The ability to partner with other creative team members and key stakeholders to create content used across a variety of platforms (web, mobile, social media, and more)
  • Able to work in a fast paced environment and have strong project management skills
  • Interact with clients to understand brief and share ideas
  • Be a great communicator, receive and interpret feedback, and meet tight deadlines
  • Respond to user feedback, data/analytics, and client feedback to improve the creative work in future iterations
Read more
UcodeSoft
at UcodeSoft
1 recruiter
Akanksha Sharma
Posted by Akanksha Sharma
Mohali
1 - 3 yrs
₹3L - ₹5L / yr
UIKit
SwiftUI

Responsibilities:

  •   Collaborate with the development team to design and implement new features for our iOS applications using Swift.
  •   Write clean, maintainable, and efficient code under the guidance of senior developers.
  •   Assist in translating UI/UX designs into high-quality code.
  •   Participate in debugging and troubleshooting to identify and fix bugs.
  •   Write unit and UI tests to ensure code quality and robustness.
  •   Contribute to code reviews to learn from and share knowledge with the team.
  •   Stay up-to-date with the latest iOS development trends, tools, and best practices.
  •   Work with version control systems like Git.
  •   Communicate effectively with team members regarding progress, challenges, and ideas.

Required Qualifications:

  •   Basic understanding of Swift programming language concepts.
  •   Familiarity with the iOS SDK (UIKit and/or SwiftUI).
  •   Experience with Xcode IDE.
  •   Fundamental understanding of mobile development concepts (e.g., view life cycles, memory management, networking).
  •   Basic knowledge of version control using Git.
  •   Strong problem-solving skills and attention to detail.
  •   Excellent communication and teamwork skills.
  •   A strong desire to learn, grow, and take on new challenges in iOS development.
  •   Bachelor's degree in Computer Science, Engineering, or a related field, OR equivalent practical experience demonstrated through projects or portfolio.

Preferred Qualifications (Nice-to-Haves):

  •   Familiarity with RESTful APIs and JSON to connect iOS applications to back-end services.
  •   Understanding of common architectural patterns (e.g., MVC, MVVM, VIPER).
  •   Experience with dependency managers (e.g., CocoaPods, Swift Package Manager).
  •   Exposure to Agile/Scrum development methodologies.
  •   Personal projects or contributions to open-source projects (please provide links if available, e.g., GitHub profile).
  •   Basic understanding of automated testing frameworks (e.g., XCTest).


Read more
AxionConnect Infosolutions Pvt Ltd
Shweta Sharma
Posted by Shweta Sharma
Mumbai
5 - 7 yrs
₹20L - ₹25L / yr
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+9 more

Role – Java Full-Stack Developer

 

Skills

  • Professional experience (5-8Y) in commercial software or corporate application Backend and Frontend/UI development
  • Strong experience in Typescript/ Javascript - Min 3Y
  • Knowledge and experience in enterprise-scale, multi-tier, distributed architecture
  • Solid experience in object-oriented design and development with languages such as Java 8.0 onwards
  • Solid knowledge of high-scale, multi-tenant Web service development, including REST/JSON and Microserviceservice patterns
  • Solid experience in Spring Boot
  • Solid experience in Spring Data/JPA/Hibernate
  • Exposure to multithreading and Junit is a must.
  • Proficient in database concepts and working experience with Oracle Database
  • Proficient in performance analysis and tuning
  • Proficiency with agile development methodologies
  • Excellent written and verbal communication skills
  • Good analytical and problem-solving skills
  • Strong and real production experience with Angular 8.0 onwards and its core principles – Min 3Y
  • In-depth knowledge of HTML5, CSS3, SCSS, Angular Material UI web standards and how to apply them.
  • Experience in responsive design using bootstrape or similar framework and progressive enhancement techniques
  • Experience in developing reusable components in Angular
  • Working knowledge of Forms-based Applications
  • Integration experience with REST-based APIs
  • Familiarity with modern front-end build pipelines and tools
  • Experience with data structure libraries (e.g., Immutable.js)
  • Ability to understand business requirements and translate them into technical requirements
  • Proficiency with Git (Bitbucket, GitHub, Gitlab) is an advantage
  • Proficiency with agile development methodologies
  • Excellent written and verbal communication skills
  • Good analytical and problem-solving skills

 

 

JD/Responsibility

  • Developing new user-facing features using Angular 8.0
  • Building reusable components and front-end libraries for future use.
  • Translating designs and wireframes into high quality code
  • Optimizing components for maximum performance across a vast array of web-capable devices and browsers
  • Debugging/troubleshooting web applications
  • Collaborate closely with groups in and outside the development team (eg. QA, Product Management, Tech Pub) to achieve well groomed, predictable results
  • Analyze, design, develop and unit test software applications with high quality and on schedule, including business critical Web services to be consumed by internal/external applications.
  • Analyzes, programs, and modifies software enhancements and/or new products used in local, networked, or Internet-related computer programs.
  • Use modern technologies and apply industry-standard software development best practices.
  • Collaborate closely with groups in and outside the development team (eg. QA, Product Management, Tech Pub) to achieve well-groomed, predictable results
  • Flexible for Domestic travel based on project needs.

Experience: 5-7 Yrs

Location: Mumbai (onsite)

Notice Period: 30 days maximum

Read more
Avekshaa Technologies
at Avekshaa Technologies
3 recruiters
Vivek Rai
Posted by Vivek Rai
Mumbai
9 - 16 yrs
Best in industry
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+4 more
  • Experienced in defining & realizing end-to-end Technical Architecture for large scale enterprise systems. Ability to identify and define non-functional requirements and design systems to meet the same.
  • Strong experience in OOAD and in applying Design patterns
  • At least 5 years’ hands-on experience in Java/ JEE technologies like Struts/JSF, Spring, EJB, JMS Experience only on front-end technologies like Struts, JSP, Servlets, HTML will not be sufficient.
  • Experience in performance testing and optimization of JEE systems on any of the following application servers - WebLogic, WebSphere and JBoss. Deep expertise in any one of the application server is a
  • Strong experience in at least one RDBMS (Oracle, MS-SQL, MySQL).
  • Experience in creating and reviewing technical documents like Architecture blueprint, Design specifications, Deployment architecture, Workload modeling
  • Excellent understanding of software development methodologies and
  • Experience in either of these areas is a definite add-on - Infrastructure sizing, Capacity planning, Performance modeling, Cloud
  • Working experience on Linux/Unix based OS system is a
  • Working experience on any one of these open source technologies (LAMP stack, Node.js framework, ELK, Cassandra, MongoDB, Couch base NO-SQL databases).

 

Read more
Athh Technologies LLP
Nikita Vekariya
Posted by Nikita Vekariya
Surat
1 - 3 yrs
₹1.5L - ₹3.5L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
SDK
RESTful APIs


We are seeking a highly skilled and experienced Android developer to join our dynamic development team. In this role, you will be responsible for designing, developing, and maintaining high performance for Android platforms.


Responsibilities:-


  1. 1+ years of technical experience with Android.
  2. Good understanding and proficiency in Java/Kotlin.
  3. Strong knowledge of Android SDK, frameworks, and development patterns.
  4. Experience with Rest APIs integration.
  5. Implement testing procedures to identify bugs.


Read more
Bullseye knowledge system pvt ltd
Chandigarh
2 - 3 yrs
₹2L - ₹3L / yr
Search Engine Optimization (SEO)
On-page Optimization
Search Engine Marketing (SEM)
Keyword Research

Greetings from Hitbullseye !!!

About Hitbullseye:

Hitbullseye is one of the fastest-growing portals in the test prep education space. It is ranked among the top test prep portals in India by Alexa.com(an Amazon Company). With 1 crore + page views annually portal has traffic from MBA. Law PO & campus placement training domains. Bulls Eye has a classroom presence and has trained close to more than 2 lac students in classrooms since its inception in 1998.

Website: www.hitbullseye.com

Venue: E-305, Industrial Area, Sector 75,

Sahibzada Ajit Singh Nagar,

Punjab 160055

Currently, we are hiring an SEO Executive for our organization.

Work Profile

  • · Develop a web content strategy that encompasses the goals of a company and aligns with the company's image
  • · Keyword search and using target keywords to write search-engine copy that is optimized for search engines (SEO) while remaining entertaining and informative
  • · Editing and proofreading content
  • · Maintain content calendar for timely servicing of articles
  • · Provide editorial, creative and technical support to digital marketing
  • · Track web analytics to ascertain content engagement levels
  • · Stay abreast of current best practices in the industry and review competitor websites to compare their activities with those of your company
  • · Work with SEO team to improve meta descriptions, alt tags, headings, etc to improve rankings
  • · Develop and execute successful SEO strategies
  • · Conduct keyword research to guide content teams
  • · Help with lead magnets – ebooks, marketing page copy, brochures, emails, SMS, Whatsapp, etc.

Required Candidate

  • Excellent Communication Skills ( Written & Verbal)
  • Experience (0-2) Years Only
  • Graduate or Post Graduate Can Apply
  • Work From Office Only
Read more
Indian top MNC
Bengaluru (Bangalore)
5 - 14 yrs
₹12L - ₹24L / yr
Data migration
skill iconPostgreSQL
Oracle

Data Engineer - GCP - data migration/PostGres/ORACLE

 

Budget : 200,000 Rs/Month

Domain Knowledge : Banking

Contract Hire : 12 Months

No. of Open Position : 2 Nos

Roles and Responsibilities :

- This role will involve all aspects of data migration with respect to any microservice being migrated.

- Analyze the source schema for the service in question

- Skilled at using the migration design to produce an instance of any templates or artifacts required to migrate the data

- Deliver a working version of the migration design to migrate the data for the service in question

- Develop a suite of scripts that will allow technical verification - either automated (e.g. - rowcouts) or manual (e.g field comparisons)

- Assist in the triage and resolution of any data related defects

Mandatory skills :

- Previous experience of data migration

- Knowledge of PostGres and ORACLE

- Previous experience of Data Analysis

 

 

 
 
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos