Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Leader in cross-border property purchase & Prop-Tech
Leader in cross-border property purchase & Prop-Tech
Agency job
via FxConsulting by Ankit Yadava
Hyderabad
4.7 - 10 yrs
₹30L - ₹40L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)
+3 more

About the Role -


We’re seeking a seasoned Senior Java Engineer to drive the development of our B2B product suite. In this pivotal role, you will build robust, scalable, and intuitive applications that empower customers to seamlessly handle money movement transactions, including international payments. You will ensure technical excellence by advocating best practices, prioritizing security, enhancing development processes, and championing a quality-first mindset.


What You'll Do -


• Design and Development: Create robust, efficient, and scalable backend services using Java and Spring Boot.

• API Development: Design, build, and maintain APIs for web and mobile applications.

• Performance and Security: Ensure application performance, scalability, and security best practices.

• Cloud Integration: Collaborate with cross-functional teams to integrate cloud services into our backend infrastructure.

• Code Quality: Write high-quality, maintainable code that adheres to industry standards.

• Mentorship: Support junior and mid-level team members, conduct code reviews, and foster a culture of continuous improvement.


What You’ll Need -


• 5+ years of professional experience as a Backend Engineer.

• Experience showing strong problem-solving skills and a passion for creating user-centric solutions.

• Core Java proficiency. A strong command of the Java language, including object-oriented programming, design patterns, exception handling, and memory management.

• Spring Framework (including Spring Boot)- In-depth knowledge of Spring, especially Spring Boot for building efficient and scalable backend applications.

• Understanding of Spring components like controllers, services, repositories, and security.

• RESTful API Development: Proficiency in designing and implementing RESTful APIs.

Bonus Points -


• Mastery over Java’s core APIs, such as collections, streams, and concurrency frameworks.

• Experience within a B2B fintech environment would be highly desirable

• Database-driven performance query optimization and Kafka messaging systems

We welcome people from all backgrounds who seek the opportunity to help build a future where we connect the dots for international property payments. If you have the curiosity, passion, and collaborative spirit, work with us, and let’s move the world of PropTech forward, together.

Redpin, Currencies Direct and TorFX are proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, colour, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law.

Read more
MAQ Software
Parveen Kaur
Posted by Parveen Kaur
Noida
1 - 12 yrs
Best in industry
MEP
Facilities
Facility management

Open Position: Facilities Engineers (2 positions)


MAQ Software, a leading global software consultancy, is nearing completion of our first office tower in Noida Sector 145 to support 2,000 engineers. Our new facility is located near Sector 145 Metro station adjoining the proposed 15 acre Microsoft campus. Our 350,000 square feet, 11 story building is designed by the leading architects and technical consultants. Our Platinum Green qualified building takes advantage of the recent advances in energy efficiency and uses 500KW solar plant.


Job Description:


We are seeking a Facilities Engineer to oversee all aspects of building functions and guarantee the safety and functionality of all facilities. Duties include working with contractors, planning maintenance work, maintaining records, and supervising facilities staff. The Facilities Engineer will ensure that our facilities are safe, functional, and efficient while also adhering to the government regulations. The ideal applicant will be well-versed in mechanical, electrical, and plumbing systems and have previous building management expertise.


Key Responsibilities:

• Design and oversee the construction of new facilities, ensuring they are functional, efficient, and safe.

• Manage and supervise facility maintenance staff, contractors, and vendors.

• Identify opportunities to improve energy efficiency and sustainability and implement solutions as appropriate.

• Maintain accurate records of maintenance and repair activities, as well as expenses.

• Develop and implement preventive maintenance programs for all facilities and equipment.

• Inspect buildings’ structures to determine the need for repairs or renovations.

• Maintain equipment and building provisions to meet health and safety requirements.

• Control activities like parking space allocation, waste disposal, building security etc.

• Prepare and implement project budgets and time limits.

• Work with other departments to identify and prioritize facility-related projects and allocate resources accordingly.

• Ensure that all facilities are equipped with necessary safety equipment and that staff are trained to use it.

• Provide technical support and guidance to other departments as needed.


Qualifications & Skills:

• Bachelor's degree in mechanical engineering, electrical engineering, or a related field.

• 8+ years of experience in facilities management or a related field.

• Strong understanding of mechanical, electrical, and plumbing systems.

• Knowledge of HVAC and other building systems.

• Experience in project management, including budgeting and scheduling.

• Ability to read and interpret technical drawings and specifications.

• Strong analytical and problem-solving skills

• Excellent communication and interpersonal skills.

• Familiarity with local and federal regulations related to facilities management.

• Experience with energy efficiency and sustainability initiatives is a plus.


Experience: 1-10 years


Work timings: To support our high-performance engineering team, we must limit downtime. You will be required to work in shifts to address issues with contractors as expected in new buildings in the new Noida sector.


We prefer candidates staying close to Noida Sector 145 to reduce traffic related issues.


Job location: MAQ Software, A3, Sector 145, Noida 201301

Read more
Mysore
3 - 5 yrs
₹5L - ₹8L / yr
skill iconC++
Linux/Unix
RTOS
ARM Microcontroller
Internet of Things (IOT)

We are searching for a talented embedded developer to join our team. You will be working along-side with other engineers and developers working on different layers of the infrastructure. Therefore, commitment to collaborative problem solving, sophisticated design, and creating quality products is essential.

The candidate should be proficient in C and C++ and possess detailed knowledge of microcontroller protocols. The candidate would be responsible for,

  • Design and implement software of embedded devices and systems from requirements to production and commercial deployment.

  • Design, develop, code, test and debug system software

  • Review code and design

  • Analyze and enhance efficiency, stability and scalability of system resources

  • Integrate and validate new product designs

  • Support software QA and optimize I/O performance

 
 

Mandatory Skills:

  • Experience in C++ based applications development  for embedded system applications

  • Solid understanding of OOPs, SOLID Principles, Design Patterns.

  • Drivers/BSP development on peripherals like ADC, SPI, I2C, UART etc

  • Firmware development experience on ARM Series of microcontrollers

  • Strong knowledge of hardware architecture such as ARM, MIPS, and x86.

  • Familiarity with hardware protocols including USB, UART, I2C, and SPI.

  • Familiarity with OS platforms such as Linux, Unix, and RTOS.

  • Knowledge on different communication protocol like Wi-Fi, Zigbee, Bluetooth and sub–GHz.

  • Basic Hardware knowledge and debugging skills

  • Strong analytical and problem-solving abilities.

  • Strong organizational and project management skills.

  • Strong knowledge of SDLC, test cycle and logical thinking on various complex use case call scenarios.

  • The ability to keep abreast with the latest advancements in technology and techniques.

 
 

Desired Skills:

  • Knowledge on IoT based systems

  • Preferably worked on a Linux based project.

  • Ability to lead the team & handle the project and own all technical aspects of design and development of systems from scratch.

  • Meticulous and very organized.

  • You will not hesitate to ask questions and call upon the knowledge of your coworkers to make sure you produce the best possible documentation for our customers.

  • Worked on 3-5 project from starting of project to delivery of project (Depending on experience)

Read more
Cloudbloom Systems LLP
at Cloudbloom Systems LLP
5 recruiters
Sahil Rana
Posted by Sahil Rana
Bengaluru (Bangalore)
6 - 10 yrs
₹13L - ₹25L / yr
skill iconMachine Learning (ML)
skill iconPython
skill iconData Science
Natural Language Processing (NLP)
Computer Vision
+3 more
Description
Duties and Responsibilities:
 Research and Develop Innovative Use Cases, Solutions and Quantitative Models
 Quantitative Models in Video and Image Recognition and Signal Processing for cloudbloom’s
cross-industry business (e.g., Retail, Energy, Industry, Mobility, Smart Life and
Entertainment).
 Design, Implement and Demonstrate Proof-of-Concept and Working Proto-types
 Provide R&D support to productize research prototypes.
 Explore emerging tools, techniques, and technologies, and work with academia for cutting-
edge solutions.
 Collaborate with cross-functional teams and eco-system partners for mutual business benefit.
 Team Management Skills
Academic Qualification
 7+ years of professional hands-on work experience in data science, statistical modelling, data
engineering, and predictive analytics assignments
 Mandatory Requirements: Bachelor’s degree with STEM background (Science, Technology,
Engineering and Management) with strong quantitative flavour
 Innovative and creative in data analysis, problem solving and presentation of solutions.
 Ability to establish effective cross-functional partnerships and relationships at all levels in a
highly collaborative environment
 Strong experience in handling multi-national client engagements
 Good verbal, writing & presentation skills
Core Expertise
 Excellent understanding of basics in mathematics and statistics (such as differential
equations, linear algebra, matrix, combinatorics, probability, Bayesian statistics, eigen
vectors, Markov models, Fourier analysis).
 Building data analytics models using Python, ML libraries, Jupyter/Anaconda and Knowledge
database query languages like  SQL
 Good knowledge of machine learning methods like k-Nearest Neighbors, Naive Bayes, SVM,
Decision Forests. 
 Strong Math Skills (Multivariable Calculus and Linear Algebra) - understanding the
fundamentals of Multivariable Calculus and Linear Algebra is important as they form the basis
of a lot of predictive performance or algorithm optimization techniques. 
 Deep learning : CNN, neural Network, RNN, tensorflow, pytorch, computervision,
 Large-scale data extraction/mining, data cleansing, diagnostics, preparation for Modeling
 Good applied statistical skills, including knowledge of statistical tests, distributions,
regression, maximum likelihood estimators, Multivariate techniques & predictive modeling
cluster analysis, discriminant analysis, CHAID, logistic & multiple regression analysis
 Experience with Data Visualization Tools like Tableau, Power BI, Qlik Sense that help to
visually encode data
 Excellent Communication Skills – it is incredibly important to describe findings to a technical
and non-technical audience
 Capability for continuous learning and knowledge acquisition.
 Mentor colleagues for growth and success
 Strong Software Engineering Background
 Hands-on experience with data science tools
Read more
CyborgIntell
at CyborgIntell
1 recruiter
Amit Kumar
Posted by Amit Kumar
Bengaluru (Bangalore)
3 - 5 yrs
₹12L - ₹18L / yr
skill iconPython
skill iconDjango
skill iconFlask
Job brief
We are looking for a Senior Python Developer to join our engineering team and help us develop and maintain various software products. Your primary focus will be the development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end.
Python Developer responsibilities include designing product, writing, and testing code, debugging programs, and integrating applications with web services.
Skills And Qualifications
• Expert in Python, with knowledge of multithreading and multitasking framework
• Expert in PySpark and Spark Framework
• Expert in Docker and Container Environment.
• Strong unit test and debugging skills
• Knowledge on MySql, Hive, Hadoop and NoSQL Databases
• Good Understanding of event-driven programming in Python
• Hands on experience on Kubernetes and container management using Kubernetes on Azure Cloud
• Hands on experience on Azure Cloud Load Balancer and VPC networking
• Good Understanding of Azure Cloud services
• Knowledge of user authentication and authorization between multiple systems, servers, and environments. eg. Single Sign On (SSO)
• Proficient understanding of code versioning tools as Git
• Understanding of accessibility and security compliance
• Implement security and data protection solutions
• Coordinate with internal teams to understand user requirements and provide technical solutions
Read more
Fragma Data Systems
at Fragma Data Systems
8 recruiters
Sandhya JD
Posted by Sandhya JD
Remote only
3 - 5 yrs
₹3.5L - ₹7L / yr
Recruitment
Recruitment/Talent Acquisition
it recruitment
technical recruitment
Dear All,

We are Hiring...!

We are immediately looking for the IT recruiters who has exclusively worked into E2E recruitments.

Must have skills:
Good understanding on Technologies
Strong Communication Skills
Experienced in handling C2H recruitments
Exclusively worked into End to End recruitments process
Expereince range 3-6 years

If you are interested to apply, then please share your updated resume at jayantim(at)fragmadata(dot)com 

Regards,
Jayanti M
Read more
Sloshout
at Sloshout
1 recruiter
Shalini Gautam
Posted by Shalini Gautam
New Delhi, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
3 - 15 yrs
₹3L - ₹5L / yr
Business Development
Sales
Lead Generation
Sourcing
Marketing
+4 more

Designation - Business Development Manager

Company Name - Sloshout

Company Location - New Delhi, Connaught Place

Company Website - www.sloshout.com

Salary Range - ₹25,000 - ₹45,000 per month + Incentives (Rs.8000 to Rs.55000 per month)

 

About Role:

We are looking for an ambitious and energetic Business Development Manager to help us expand our clientele. The candidate must be at the front of the company and will have the dedication to create and apply an effective sales strategy. The goal is to drive sustainable financial growth through boosting sales and forging strong relationships with clients.

 

Job Responsibilities:

  • Convince and onboard new Venue clients every month by selling subscription packages.
  • It will be a hardcore On-Field B2B Sales Job.
  • Develop a growth strategy focused on financial gain.
  • Self-generate leads and builds effective pipeline of prospective clients to meet monthly set targets.
  • Conduct research to identify new markets and client needs.
  • Promote the company’s value add subscriptions to onboarded venue clients.
  • Document sales contracts and ensure adherence to law-established rules & guidelines
  • Keep records of sales, revenue, invoices, etc.
  • Provide trustworthy feedback and after-sales support
  • Build long-term relationships with new and existing clients.
  • Develop & Train entry-level staff into valuable salespeople.

 

Requirements:

  • Male Candidate with 3-5 years of Work experience as a BDM, Sales Executive, or any relevant role
  • Own Conveyance – 2 Wheeler/4 Wheeler (Fuel will be reimbursed)
  • Proven sales track record
  • Proficient in MS Office
  • Proficient in oral and written - Hindi & English
  • Market/Industry knowledge
  • Ability to build rapport, Good Communication and negotiation skills
  • Time management and planning skills
  • Full-Time Graduate/Post Graduate
Read more
Yatra
at Yatra
4 recruiters
Anusha Vasishta
Posted by Anusha Vasishta
Gurugram
3 - 5 yrs
Best in industry
Google Tag Manager (GTM)
Google Adwords
Email Marketing
Digital Marketing

Job Brief -

  • We are looking for a Facebook & Google Ads expert to support our lead strategists with social & search ad campaigns for our clients. 
  • You will be tasked with pulling reports, making optimization recommendations, getting ads live, and making strategy adjustments as needed. 
  • You'll learn how we create and optimize campaigns using our process and conversion techniques that deliver real results and get to share in the success of our marketing/advertising objectives. You will spend most of your time in Google Ads, Facebook & Linkedin & experience with Google Analytics, and Google Tag Manager is a must.
Read more
XAMPR
Jhansi Kalasani
Posted by Jhansi Kalasani
Hyderabad
1 - 4 yrs
₹3L - ₹5L / yr
Adobe Photoshop
skill iconAdobe Illustrator
Any phototyping tool
UI/UX & Visual designer Job description: Should be hands-on: 1) Photoshop 2) Illustrator 3) Any prototyping tool (InVision / Xd / UXPIN etc) 4) Immaculate oral and written communication skills 5) Portfolio to include: some UX work (Apps / website etc), some shapes (icons etc), some print media (Standees, corporate stationary etc) 6) Should have knowledge on artboards, dp - pixel ratios, typography and color palletes, Material design, 12 grid Bootstrap..
Read more
CricBattle Inc.
at CricBattle Inc.
1 recruiter
Siddanth Reddy
Posted by Siddanth Reddy
Ahmedabad
2 - 4 yrs
₹1L - ₹3L / yr
System Administration
Windows Server Administration
Selenium
QTP
Load Testing
+3 more
About Us: CricBattle is the Only Draft Based and Salary Cap Fantasy Cricket and Football Platform in the World. With there being such a passion for both of these sports out there globally, we want to ensure our users enjoy and socialize on the platform we are providing, for which we provide the best customer service experience. If you're crazy about sports, and want to put your childhood dream of working in a sports related profession, this is your chance! We have always believed in living in dreamland, and what's better than working while watch the match you don't want to miss or interact with cricketers, along with all your co-workers!! You will be the key backbone on our unique fantasy platform. You will be mainly dealing with backend admin settings. You will also be responsible for analysis and design techniques to solve business problems using information technology. You will also serve as change agent who identify the organizational improvements needed, design systems to implement those changes, and train and motivate others to use the product. You will have an opportunity to wear multiple hats of system admin, database admin, software tester, client interaction, customer support etc. The role will move up to heading future system administrator, support teams in 2-3 years. Experience Must : · Minimum 2 years of experience with Bachelor's Degree in related discipline. · Ability to provide backend admin support and to be responsible for maintaining system quality. · Ability to review of software requirements, Preparation of test case and Execution of tests. · Ability to Reporting of defects and Preparation of test reports. · Knowledge of functional automation testing using tools like QTP, RFT, Load Runner and Selenium will be preferred. · Experience Web application testing to different browsing platforms (Web browsers, Mobile browsers). · Experience Mobile Apps testing to different platforms (Android, IPhone, windows) Additional Skillset Preferred: -> Ability to communicate with clients and maintaining customer relations . -> Providing customer support voice/non-voice. -> Ability to prepare technical document, User guides etc. Please forward your resume to [email protected]
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos