Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

LOGICAL Soft Tech
at LOGICAL Soft Tech
1 recruiter
Sumit Aryan
Posted by Sumit Aryan
Indore
0 - 0.5 yrs
₹0 - ₹5000 / mo
skill iconPython

Looking for Fresher Python /Django intern candidate who want to make carrer in IT company and want to learn some live project on it


location : Indore work from office


Responsibilities:


● Assist in the design, development, and maintenance of RESTful APIs using FastAPI


or Flask.


● Integrate third-party APIs and develop internal API connections.


● Support debugging and optimization tasks to enhance API performance and


reliability.


● Collaborate with front-end developers to ensure seamless integration with the


backend.


● Contribute to code reviews and maintain best practices in API development.


● (Optional) Utilize machine learning knowledge to support the development of



************************


Please call and visit office for detail discussion and for free counseling Monday To Saturday 11 Am to 7 P.M


Company name : Logical Soft Tech Pvt Ltd, Indore(M.P)


Contact : - +91-826.982.972.9(HR), +91-786.973.159.5(HR), +91-741.595.091.9(HR), +91-821.025.182.4 (technical Department),


Address: - 2nd floor, 388,PU4, Scheme 54 PU4, Next to Krozzon hotel, Infront of Old Eye Retina Hospital, Vijay Nagar, Indore, M.P

Read more
binaryel
at binaryel
1 recruiter
Chetan S
Posted by Chetan S
Pune
0 - 10 yrs
₹7L - ₹16L / yr
skill iconRuby on Rails (ROR)
skill iconJavascript
MySQL
skill iconMongoDB
skill iconReact.js
+3 more

Skill set Requirement
RoR
Any front end frameworks (good to have)
Docker, Aws and Kubernetes
Sidekiq

Note : This position is for Pune location.  Please only apply if you are in pune or willing to relocate to Pune.

 

We are a product company with headquarter in New York and development centre in Pune.

Read more
B2B product development and manufacturing comapny
B2B product development and manufacturing comapny
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore), Gurugram
6 - 10 yrs
₹40L - ₹70L / yr
Engineering Management
Engineering Head
Engineering Manager
Director of Engineering
VP of Engineering
+5 more
  • Has led engineering teams before with full-stack developers preferably and can contribute to building the team as per requirement
  • Lead the team to plan, deign and build solutions
  • Work closely with the founders to decide the direction of the product
  • Have experience redefining the MSME sector
  • Have worked on digitizing the supply side of the organization
  • Have an experience of 6-8 years in the industry
  • Preferable SaaS experience with a B2B set up
Read more
Disruptive Digital Healthcare platform
Disruptive Digital Healthcare platform
Agency job
via Unnati by Veena Salian
Bangalore
3 - 6 yrs
₹12L - ₹15L / yr
Data engineering
Big Data
SQL
Python
Our client is the Health-tech initiative of India's largest business house. Started in 2015, it empowers healthcare providers and consumers in India. All healthcare monitoring services are made available through an app that will help connect doctors, hospitals, pharmacies, laboratories and consumers, enabling preventive and predictive healthcare. It helps the care-givers to track the entire patient journey from the initial appointment and maintaining their records, generating lab test reports to providing virtual consultation and home-care solutions. It is expected that this futuristic guide will strengthen doctor-patient relationship and enhance the in-clinic experience.
 
As a Data Engineer, you will be responsible for building the data pipeline required for optimal extraction, transformation and loading of data from diverse data sources using Python and databases.

What you will do:

  • Assembling large, complex data sets
  • Assisting Data Science initiatives with data set preparation, annotation etc.
  • Enabling Data Science teams to design solutions that are highly scalable and available
  • Managing code pipelines for ML and Reporting

 


Candidate Profile:

What you need to have:

 
  • B.Tech/ B.E (Masters would be an advantage)
  • Expert level experience in Python Development
  • Knowledge of Database and Data Structures (My SQL and Postgre)
  • Good hands-on experience of SQL
  • Experience working on real time production systems (either of Data Science/ Application development is fine)
  • Experience of backend development that includes python APIs, Flask, integrations etc.
  • Exposure of MLOps (Operationalizing statistical/ ML algorithms)
  • Experience working on Data Science engagements/ Use cases
  • Basic knowledge of Statistics
  • Exposure to any of these- NLP/ Statistical Modelling/ Image Analytics
  • Good aptitude to understand business use cases/ requirements
  • Previous experience of technical solutioning
  • Excellent problem solving skills
  • Good Communication skills    
Read more
Digicred Technologies Private Limited
NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore), Mumbai
3 - 7 yrs
₹6L - ₹16L / yr
Sales
Business Development
Channel Sales
We at Veris create modern digital workplaces for the millennial generation. We help transform offices into a smarter workplace with the help of SaaS-based mobile-first products. The product is now industry proven with installations across more than 50 large enterprises, 250+ offices & 40+ commercial buildings. There is a strong pull for the product in the market and we are looking for smart Sales/BD professionals who are efficient in scaling businesses. Individual Reports to Head of Sales/Co-Founder, its a very close-knit team, hence opportunities to grow galore. Location: Initially Gurgaon (will have to travel/based out of Bangalore or Mumbai) Responsibilities: 1. Will be responsible for direct selling to large enterprises - Fortune 500 companies - End to end business development/sales from lead generation to closing - Pitch to a variety of stakeholders - Facility managers, Security, IT department, C-suite at large enterprises - Build a network of Veris 2. Manage channel partners (Resellers) - Help them sell more! (partnered with world's largest facility management group) - Knowledge transfer/ training/market understanding/collaterals etc - Foster a healthy relationship between the company and resellers - Participate in joint sales calls to customers and assist the Partner in closing opportunities 3. Co-ordinate with the Customer support/product/marketing/tech team 4. Brainstorm new and creative revenue growth strategies and partnership opportunities 5. Willing to take up responsibilities which adds value/supports other functions of the company The individual gets exposure to a high growth startup from close quarters and gets an opportunity to work in an industry growing at the rate of not. The Founders of the company hail from the premium business/grad schools with IIT-D, IIM-A & IIFT and have a diverse experience of global and domestic assignments in the domains of FMCG, Banking, Automobile & Telecom. We want to build a scalable technology product for enterprises and see building a product for the global market. We are looking for : - Smart, efficient and organized professionals - Grad/MBA degrees - A shared belief in the vision & the desire to outgrow yourself
Read more
Disruptive Electronic Accessories Brand Unnati
Disruptive Electronic Accessories Brand Unnati
Agency job
via Unnati by Astha Bharadwaj
Bengaluru (Bangalore)
3 - 5 yrs
₹12L - ₹13L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
Model-View-View-Model (MVVM)
Here is a chance to work for a Consumer Electronics Brand, where you get to deal with some of the best channels and work with some excellent experienced minds. Read on.
 
Started in 2015, this lifestyle and accessories startup has taken over the consumer electronics sector in India. Our client has a product range that includes an extensive catalog of headphones, speakers, travel accessories, and modern earphones. It believes in providing cutting edge electronic products stamped with durability and affordability.

The brand is associated with some of the major icons across categories and tie-ups with industries covering fashion, sports, and music, of course. The founders are Marketing grads, with vast experience in the consumer lifestyle products and other major brands. With their vigorous efforts toward quality and marketing, they have been able to strike a chord with major E-commerce brands and even consumers.
 
As a Android App Developer, you will be responsible for the development and maintenance of applications aimed at a range of Android devices . Your primary focus will be development of Android applications and their integration with back-end services. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is essential.

What you will do:

  • Designing and building advanced applications for the Android platform
  • Collaborating with cross-functional teams to define, design, and ship new features
  • Unit-test coding for robustness, including edge cases, usability and general reliability
  • Working on bug fixing and improving application performance
  • Continuously discovering, evaluating and implementing new technologies to maximize development efficiency

 

Desired Candidate Profile

What you need to have:    
 
  • Bachelor's degree in computer science or related technical discipline
  • 3-6 years Android app development experience
  • Strong hands on experience in developing high performance mobile applications
  • Strong knowledge of Java, Kotlin, Android SDK, different versions of Android, and how to deal with different screen sizes
  • Familiarity with RESTful APIs to connect Android applications to back-end services
  • Strong knowledge of Android UI design principles, patterns and best practices
  • Experience with offline storage, threading and performance tuning
  • Ability to design applications around natural user interfaces, such as touch
  • Familiarity with cloud message APIs and push notifications
  • Familiarity with the use of additional sensors, such as gyroscopes and accelerometer
  • Experience in BLE and BT
  • Good understanding of unit, system and end to end testing and automation of mobile applications / Android applications
  • Familiarity with the MVC and MVVM design patterns
  • Knowledge of the open-source ecosystem and the libraries available for common tasks
  • Experience building, testing and distributing native apps that consume RESTful services
  • Proficient understanding of code versioning tools such as GIT
  • Strong analytical and problem solving skills
  • Excellent oral and written communication skills
  • Good logical sense, strong technical skills and the ability to learn new technologies quickly    

 

 

Read more
B2B start up.
B2B start up.
Agency job
via TalentXo by Chaitra talentxo
Gurugram
2 - 9 yrs
₹60L - ₹70L / yr
Product Management
Product Strategy
Roadmaps
Growth Hacking
Role & Responsibilities
  • Develop and lead the product vision and strategy for Dotpe's products
  • Understand the jobs to be done for the platform, synthesize those needs to shape the product roadmap for a suite of platform products, and define key metrics
  • Strategically assess new opportunities and develop alignment around these
  • Collaborate and build executive alignment for your vision
  • Foster a community of data-informed decision making
  • Strong track record of execution
Ideal Candidate
  • Technical and analytical background.
  • Education from Tier 1 Institute.
  • 5 - 9 yrs of experience in Product and have exposure of working in a startup environment.
  • Customer-oriented: you are driven by our purpose of economic employment and serving our sellers and developers.
  • The ability to think strategically and craft a high-level narrative is critical.
  • Excellent written and verbal communication skills.
  • Optimist and Ownership drove: the ability to stand up for your work when you believe in it.
  • Strong track record of execution.
Perks, Benefits, and Work Culture
  • Opportunity to work in a fast-growing Start-Up with lucrative compensation benefits.
  • Working directly with the leaders; having a high level of work independence, autonomy and empowerment to lead company-wide changes.
  • Work with a market-dominating technology.
  • Being part of a start-up from an early stage, lead your area of expertise and be a part of this exciting growth journey.
  • Excellent platform for learning how to build teams, achieve goals and handle high-growth situations. Ideal for people with entrepreneurial ambitions
Read more
Brighter Bee Technologies
Pratik Dalvi
Posted by Pratik Dalvi
Nashik
1 - 2 yrs
₹6L - ₹8.5L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
  1. Good experience in react components, hooks and state.
  2. Experiences in the implementation of responsive web layouts
  3. Ability to discuss and explain design options.
  4. Good experience with HTML5 & CSS3, Bootstrap Good understanding of JavaScript.
  5. JavaScript libraries and CSS frameworks are preferred.
Read more
Early age startup building a customer onboarding software
Early age startup building a customer onboarding software
Agency job
via Qrata by Mrunal Kokate
Chennai
5 - 11 yrs
₹30L - ₹40L / yr
skill iconReact.js
skill iconJavascript
skill iconHTML/CSS
skill iconAmazon Web Services (AWS)

Qrata is hiring for a Venture funded company that is backed by marquee investors. Founded in

2020, the product provides a collaborative new way for SaaS companies to onboard their

large customers. Their unified workspace aims to help streamline customer onboarding and

implementation journeys, and get every customer off to a great start.

 

Role: Senior frontend lead

Description: Are you a front-end developer looking to fast-track your learning and growth? Have you looked at world class products like Asana, Notion, or Airtable, and felt “I wish I were part of the early team that built these products”?

They are a team that has previously built and rolled out globally successful SaaS

products used by tens of thousands of customers. They're laser focused on delivering a world

class new product again, and looking for an ambitious front-end engineer to join our existing

team of 9 engineers.

If it excites you to think of a fast paced start-up environment, building something big from

scratch, breaking down new problems, creating well structured UI components, executing on

pixel perfect design, paying great attention to every little interaction detail, and doing demos

of your work every Friday with a happy and passionate team, then this is the right

opportunity for you.

Some of the tech problems you get to work-on as a front-end developer would include

building real-time collaboration experiences across their product, building live document

editing and modern spreadsheet experiences from scratch, creating flexible new Kanban-style views of work tasks, and crafting cool new UI components and interactions that we will use across our product.

 

Tech Requirements:

● Expertise in React

● Hands-on experience in HTML, CSS, SASS & Object Oriented Javascript

● Code audits and guidelines

● SPA Framework patterns

● Browser features (Caching / Storage / Compatibility etc )

● Test automation

● Deployment strategy

 

Nice to have:

● Familiarity with AWS

● Experience with startups or early stage teams

● Typescript

● Knowledge of module bundlers like Webpack

Read more
CheckNCall
at CheckNCall
1 recruiter
Sudhama Bhatia
Posted by Sudhama Bhatia
Mumbai
4 - 7 yrs
₹8L - ₹15L / yr
MVC Framework
skill iconSwift
skill iconiOS App Development
Xcode
Internet of Things (IOT)
+2 more
We are looking for an amazing iOS developer to work on an extremely challenging Real Time iOS application which also uses Natural Language Processing and Artificial Intelligence. You should have great understanding of the following

1. Design Patterns MVC, MVVP, MVVM (MVC != Massive View Controller )
2. Data Structures and Algorithms
3. Writing bridge code in Swift.
4. Backrground jobs
5. VOIP Notifications
6. Delegates
7. Using NIB files


In addition, you should be open to learning and able to challenge yourself and push yourself to accompish more in less time

Other skills include
1. Being a team player.
2. Being a good person
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos