Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable
About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more
Company video
Thoughtworks's video section
Thoughtworks's video section
Connect with the team
Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect
Company social profiles
bloginstagramlinkedintwitterfacebook

Similar jobs

Coders Van
at Coders Van
2 candid answers
Satadru Roy
Posted by Satadru Roy
Remote only
11yrs+
Upto ₹3L / yr (Varies
)
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

Software Developer job

Java Full Stack Developer

Are you a talented Java Full Stack Developer with a passion for building innovative web applications? We are looking for an experienced professional to join our team and help us design, develop, and maintain end-to-end solutions that delight our users.

Responsibilities:

  • Design, develop, and maintain web applications using Java, front-end technologies (HTML, CSS, JavaScript), and various frameworks.
  • Collaborate with cross-functional teams, including UX/UI designers and backend developers, to deliver high-quality, responsive, and user-friendly web solutions.
  • Create and maintain RESTful APIs for seamless integration between the front-end and back-end components.
  • Optimize application performance, ensuring scalability and responsiveness.
  • Implement best practices for security, data protection, and code quality.
  • Stay up to date with the latest web development trends and technologies to drive innovation.
  • Provide technical leadership and mentorship to junior developers.
Read more
Indonesia based Fintech
Indonesia based Fintech
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
7 - 15 yrs
₹20L - ₹40L / yr
Product Management
Product Manager
Product Strategy
Product development
We are looking for a Product Manager who has the creativity to look at problems in new ways, the discipline to make decisions based on data, and the boldness to experiment with innovative ideas. As our Product Manager, you are accelerating growth by delivering delightful experiences to customers

Why this role is unique
● Blank canvas: you'll be one of the founding members of our Growth team and help lay the foundation for what we work on and how the team operates

● Massive impact and visibility: our product is just now taking shape and your work will
directly serve 60M+ SMBs in Indonesia

● World class team: you will work side-by-side with serial entrepreneurs and startup veterans that sail from all corners of the world (including Indonesia, Singapore, Hong Kong, Taiwan, UK, US, Canada, India and more)

What you will own
At the company, product-led growth (“PLG”) is our secret weapon to delighting our customers and driving business impact. As a Product Manager in the Growth team, you will help create a product-driven culture that is obsessed with experimenting with new ways to deliver simple, fun, and inspiring product experiences to our customers.

You will:
● Own the strategy and roadmap for product initiatives that drive one or many growth areas,ranging from acquisition to retention
● Design, develop, test, and ship product features, funnels, loops, and flywheels that drive
organic, self-sustaining growth
● Partner with engineers, designers, data scientists, and researchers to conduct data-driven experimentation (A/B tests, multivariate tests)
● Define, analyze, and monitor metrics that inform the success of products
● Champion, strengthen, and be the evangelist for product-led growth within the company


Qualities we look for:
● Has a proven track record of owning the end-to-end product development lifecycle, including
ideation, development, testing, and launch
● Has experience designing, running, analyzing, and interpreting experiments (A/B tests,
multivariate tests)
● Has strong customer empathy and experience translating customer needs/feedback into
actionable product growth initiatives
● Can communicate effectively, influence without authority, and align a cross-functional team
towards a common goal
● Is detail-oriented with superior organization skills and the ability to effectively manage
multiple priorities, projects, and deadlines
● Enjoys working on complex, ambiguous problems with a diverse, multidisciplinary group of
people in a fast-paced environment
● Is passionate about software, fintech, and emerging markets
Read more
Rubiq Solutions Private Limited
Panaji
1 - 5 yrs
₹2L - ₹5L / yr
Presentation Skills
Business continuity planning
Channel Sales
Communication Skills
Sales presentations
+7 more
We are hiring Sr. Business Development Executive in Goa with a demonstrated history of working in Sales & Marketing/E-commerce in depth in IT Industry. Worked in esteemed OTAs & Travel SAAAS companies, we are looking for strong sales professionals focused in Hospitality, OTA, Travel Administration and sales execution.
Responsibilities
• Develop a Strategic Sales plan to increase our market share and revenue.
• Conduct research to identify potential regions and customer needs.
• Managing all the inbound and outbound leads for the hospitality sector
• Targeting our existing customers with an upsell strategy plan.
• All activities and processes to be maintained on Salesforce CRM.
• Maintaining & Building relationships with OTA’s, PMS’s & Payment Gateway partners.
• Building long-term relationships with new and existing customers.
• Report on month-end activity,
Read more
Key Account Manager - eCommerce
Key Account Manager - eCommerce
Agency job
via Unnati by Sarika Tamhane
Mumbai
4 - 5 yrs
₹6L - ₹7.5L / yr
skill iconGoogle Analytics
Account Management

In today’s marketing-dependent consumer world, businesses demand innovative brand solutions and our client is engaged in providing brand solutions across businesses. They import renowned global brands & distribute the same. They have a dedicated eCommerce practice to build digital retail footprints for their brands in India. They focus on major categories under FMCG such as F&B, Personal care, etc. and also Home & Fabric Care.

 

Founded in 2003, our client has over 250 Pan-India Distributors and more than 300 SKUs. They deal with 25+ brands and some of the brands are Mogu Mogu, SAN REMO, Simpkins, Moccona, OMINO BIANCO, etc.

 

As a Key Account Manager - eCommerce, you will be responsible for leading and executing the company’s overall eCommerce strategy for website and primary channel partners – Amazon, Big Basket, Flipkart, Nykaa, Supr/BB Daily, Milkbasket as well as other new partners [Smytten, e-pharmacies, etc].

What you will do:

  • Charting out plans for listing and relisting of brands and select SKUs on different channel partners
  • Driving ecommerce operations – site availability, POs and ensuring 95%+ fill rates
  • Managing all in-app visual merchandising, liaisoning with different brand leaders across US, Europe, Australia and South East Asia for accessing content related to respective partner brands and keeping the brand folder up to date with thematic, product hero and lifestyle content
  • Driving in-app brand visibility, targeted marketing and promotional offers on different platforms
  • Establishing processes for monitoring, measurement and optimization of performance marketing metrics to results in desired target sales achievement

 

 

Desired Candidate Profile

What you need to have:

  • Adept at business planning, JBPs and channel specific planning with 1+ years’ experience in Google Ads and Google Analytics
  • Proficiency in using MS Excel and MS PowerPoint
  • Prior experience of ecommerce vertical with Flipkart, Amazon or Big Basket will be an added advantage    

 

Read more
Cirtru - Circles of Trust
at Cirtru - Circles of Trust
1 video
1 recruiter
Navish Jain
Posted by Navish Jain
Mumbai
2 - 5 yrs
₹6L - ₹12L / yr
skill iconReact Native
skill iconJavascript
TypeScript
es6
Clojure
+5 more

We are looking for a Senior React Native Mobile App Developer interested in building performant mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as coordinating with the teams responsible for other layers of the product infrastructure. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required.


Responsibilities

  • Build pixel-perfect, buttery smooth UIs across both mobile platforms
  • Leverage native APIs for deep integrations with both platforms
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native
  • Reach out to the open source community to encourage and help implement mission-critical software fixes- React Native moves fast and often breaks things
  • Maintain code and write automated tests to ensure the product is of the highest quality
  • Transition existing React web apps to React Native

Skills

  • Firm grasp of the JavaScript and TypeScript or ClojureScript language and its nuances, including ES6+ syntax
  • Knowledge of object-oriented programming
  • Ability to write well-documented, clean Javascript code
  • Rock solid at working with third-party dependencies and debugging dependency conflicts
  • Familiarity with native build tools, like XCode, Gradle, Android Studio, IntelliJ
  • Understanding of REST APIs, the document request model, and offline storage
  • Experiences with automated testing suites, like Jest or Mocha
Read more
SpringHouse Coworking Private Limited
Vedant Gupta
Posted by Vedant Gupta
NCR (Delhi | Gurgaon | Noida), Gurugram
1 - 5 yrs
₹2L - ₹3L / yr
Bookkeeping
Accounting
Taxation
Accounts payable
Accounts receivable
+11 more
Monthly Invoicing
Expense Recording
Bank Reconciliation
Debtor Reconcilation
Vendor Payments
Vendor Reconciliation
GST & TDS Returns
Read more
Simpliclarify
at Simpliclarify
1 recruiter
Kamal Bhartiya
Posted by Kamal Bhartiya
Remote only
0 - 1 yrs
₹5000 - ₹15000 / mo
Email Marketing
Search Engine Optimization (SEO)
  • Identify target audience and grow our email list
  • Design and implement direct email marketing campaigns
  • Proofread emails for clarity, grammar and spelling
  • Ensure mobile-friendly email templates
  • Write newsletters including all company updates
  • Upgrade our email templates using graphics, personalization and advanced features
  • Ensure prompt and accurate communication with clients via email to minimize unsubscribes
  • Create email databases for lead generation
Read more
Wissen
at Wissen
1 recruiter
Sravani K
Posted by Sravani K
Bengaluru (Bangalore)
5 - 8 yrs
₹9L - ₹14L / yr
Performance Testing
JMeter

Job Description:

 

Location: Bangalore

Senior QA Engineer Responsibilities: • Design, maintain and execute manual and automated test cases for API, performance and end-to-end functional tests. • Develop automated tests with industry-standard testing tools and frameworks (e.g. JMeter, Junit, RestAssured) • Ensure comprehensive end-to-end coverage of test suites. Knowledge and Skills: • 4+ years of industry experience doing manual testing for web applications • 2+ years of industry experience in Performance testing tools such as JMeter • Experience with testing Web Services or REST APIs either from code or with tools like SoapUI/Postman • Experience of creating test cases based on requirements given in BRD • Bachelor's degree in Computer Engineering, Computer Science, Information Systems or Equivalent • Experience with code management and version control software (e.g. Git, GitLab, Bitbucket) • Knowledge of continuous integration tools (e.g. Jenkins, ANT, Maven, Gradle) • Knowledge of databases (MySql, MS-SQL, MongoDB

 

Read more
World's most valuable ed-tech company.
World's most valuable ed-tech company.
Agency job
via zyoin by Alton Abraham
Bengaluru (Bangalore)
5 - 8 yrs
₹35L - ₹50L / yr
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconPython
skill iconRedis
+4 more
Description

We are looking for talented engineers who are passionate about using software
engineering to make kids love to learn and redefine learning@home. You will
have an opportunity to work in a highly motivated fast paced environment in a fastest
growing Ed-Tech company. You will be building platforms and services to be used across
various products. You will have the opportunity to create significant impact on our
systems, our business and most importantly on the life of millions of our students as we
take on challenges that will reshape education industry. You will operate at the
intersection of diverse disciplines - Backend, Frontend, Big Data, ML, Computer vision
and various open source tech. You will build solutions for Byju’s learning Apps as well as
few upcoming products with huge market potential and are high on innovation.
We are looking for smart people with excellent coding skills and can-do attitude.
Candidates should be eager to learn, flexible to pivot when needed, savvy enough to
thrive in a dynamic environment and should possess a growth mindset.

Roles & Responsibilities

● Writes high quality code & unit tests, builds, tests as per agreed timelines
● Participates in technical design and provides estimation
● Owns one or more small to medium features
● Becomes a go-to person in at least one area
● Communicates clearly and gets clarification upfront to minimize rework. Knows when
to ask for help to unblock.
● Consistently follows and promotes SDLC best practices: Coding standard, testing,
code reviews, code comments etc.
● Exhibit strong problem solving skills, helps other developers and demonstrates
teamwork

Ideal Candidate Profile

● Understands detailed requirements and demonstrates excellent problem solving skills
● Deep understanding of software engineering practices, Design Patterns, Data
Structures, Algorithms
● Excellent programming skills in ROR, Golang, NodeJS, Python
● Strong communication skills
● Strong sense of ownership, drive and ability to deliver results
● A Bachelors or Masters degree in engineering from a reputed institute (preferably
IITs, NITs, or other top engineering institutes)
● Experience in Golang, RoR, Unity, ML or Python will be an added advantage
Read more
We have urgent opening for the Position of Web Chat Support Process (Non Voice).
We have urgent opening for the Position of Web Chat Support Process (Non Voice).
Agency job
via Quarec Resources Pvt Ltd by Udit Yadav
Ahmedabad
0 - 2 yrs
₹2L - ₹3L / yr
Creative Writing
English Proficiency
Communication Skills
• Good communication skills – written English • To be able to understand the customer query and provide the optimum resolution and at the same time upsell other products/services of the client • Flexibility – Individuals for now should be flexible to work in a permanent night shift – 11:30 pm to 8:30 am IST window with 2 rotational weekly offs • Multitasking – Individuals would be expected to work on multiple queries at the same point of time, which would demand a very high level of multi-tasking • Immediate Joining. • Any Graduate + employee benefits + performance based incentives + night shift allowances Note: PICK & DROP FACILITY IS PROVIDED TO EMPLOYEES.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos