Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Fragma Data Systems
at Fragma Data Systems
8 recruiters
Harpreet kour
Posted by Harpreet kour
Bengaluru (Bangalore)
1 - 6 yrs
₹10L - ₹15L / yr
Data engineering
Big Data
PySpark
SQL
skill iconPython
 Good experience in Pyspark - Including Dataframe core functions and Spark SQL
Good experience in SQL DBs - Be able to write queries including fair complexity.
Should have excellent experience in Big Data programming for data transformation and aggregations
Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
 Good customer communication.
 Good Analytical skills
Read more
Recro
at Recro
1 video
32 recruiters
Mounashree JP
Posted by Mounashree JP
Remote only
3 - 3 yrs
₹4L - ₹25L / yr
skill iconGo Programming (Golang)
Microservices

Responsibilities:

• Take on complex problems that span multiple components and teams.

• Independently own one or more multiple modules, which include: requirement analysis, design, development, maintenance & support

• Write extensive, efficient code to address complex modules that handle the interaction between multiple components.

• Rapidly iterate to add new functionalities and solves complex problems with simple and intuitive solutions

• Produce architecture with clean interfaces, that are efficient and scalable

• Participate and contribute to architectural discussions

• Solve production issues. Investigate and provide solutions to minimize the business impact due to the outage

• Continuously improve performance metrics of modules you own.

• Collaborate effectively across teams to solve problems, execute and deliver results

 

Requirements:

• Experience: 3+ years

• A Bachelor's or Master's Degree in Computer Science

• Software engineering and product delivery experience, with a strong background in algorithms

• Experience in architecting & building real-time, large-scale e-commerce applications

• Experience with high-performance websites catering to millions of daily traffic is a plus

• Excellent command over Data Structures and Algorithms

• Experience with web technologies, Go/Java/Python

• Language: GO or Python

• Strong expertise in DS and Algo

• Strong leadership skills - have experience mentoring, building products from scratch or incumbent in design and architecture.

• Have worked in the scaling of the system right from scratch.

• Someone worked in small user base to a large user base and wrote optimized code

• Both HLD and LLD

Read more
Digital first brand(Italian  Pvt.Ltd.)
Digital first brand(Italian Pvt.Ltd.)
Agency job
via Merito by Sana Patel
Mumbai
2 - 8 yrs
₹9L - ₹25L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

Hi


About the Company:Our Client is Private Limited aims to be the country’s first food platform that brings together digitalfirst brands, experiences and retail destinations that will influence and shape the narrative around food amongst India’s most discerning consumers.


Job Location : Mumbai


What you’ll be doing?

• Developing new React Applications

• Building reusable components and front-end libraries for future use.

• Translating designs and wireframes into high-quality code.

• Optimizing components for maximum performance across a vast array of web-capable devices and browsers

• Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model - Thorough understanding of ReactJS, React Native, and it's core principles.

• Experience with the backend framework ExpressJs. - Experience with popular ReactJS workflows (such as Flux or Redux)

• Familiarity with RESTful APIs, javascript unit testing framework, modern front-end builds pipelines, and tools


What you’ll bring?

• We are looking for an experienced React developer to be part of a diverse, fast pace and energetic team at Consumer Technologies

. • The candidate will be expected to develop and manage Web and Mobile interfaces built in ReactJS and React Native and at the same time provide troubleshooting and 2nd-tier support for existing applications

. • The candidate should be a self-starter, who is proactive, positive, flexible, and a good leader.

• Minimum qualifications: B.Tech./B.E. in CS, IT, or ECE

• 3 to 5 years of experience as React Native Developer or React.JS development.


Regards

Team Merito

Read more
Setrac Hospitality
Shreya sharma
Posted by Shreya sharma
Navi Mumbai
2 - 5 yrs
₹4L - ₹7.2L / yr
skill iconPHP
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+3 more

Php and framework full stack developer

Knowledge of Nodejs and python an added advantage

Understands ci cd and webapp deployment

Aws development and deployment understanding

Javascript understanding

Read more
Inevitable Infotech
Abhishek Srivastava
Posted by Abhishek Srivastava
Lucknow
4 - 8 yrs
₹3L - ₹8L / yr
Oracle EBS
Accounts receivable
Account Management
Oracle Procurement
Automation
+1 more
Expertise:

Oracle EBS (R12) covering Financial Modules: Payables, Receivables, Assets, GL, Inventory, Cash Management, Expenses, Project, Procurement, Contract and Revenue automation module
Read more
Tatvic
at Tatvic
2 recruiters
Aastha Bhadani
Posted by Aastha Bhadani
Ahmedabad
2 - 4 yrs
₹1L - ₹8L / yr
Google Tag Manager (GTM)
skill iconJavascript
Content Writing
skill iconData Analytics
Google Cloud Platform (GCP)
Location: Ahmedabad (Work From Office)

Website: www.https://sgnldomain.online/click?redirect=http%3A%2F%2Ftatvic.com%2F&;dID=1615815352065&linkName=tatvic.com" target="_blank">tatvic.com

Job Description

Responsibilities of Technical lAnalyst:

Responsibilities w.r.t Customer:

  1. Requirement gathering by asking questions to the customer and getting to the main objective behind the query.

  2. Analyze and understand and when necessary document the requirement 

  3. Design or develop PoC as per the business requirements / Customer development team requirements

  4. Completing the implementation of the task as per the schedule 

  5. Should make extensive use of analytics data to generate insights and recommendations

  6. Work with client technical team to fix the tracking issues

Team Responsibilities

  1. Participate in the recruitment process based on your seniority. This includes interviews, creating test as required based on the need to recruit people who are compatible with our culture and skilled to accomplish the job.

  2. Share and coach colleagues in making the team more effective.

  3. Share and Create content for training and publishing. These includes blogs and webinars.

  4. Identify potential team members who are worthy of band change and prepare them with required guidance

  5. Identify the repetitive tasks and manage to delegate to other team members or automate the process to reduce TAT & improve the productivity

Technical Responsibilities

  1. Understanding the Event Schemas and Scripting

  2. Designing solutions using GTM configurations for various environments

  3. Creating database schemas as per business requirements

  4. Create technical specifications and test plans

  5. Development within any frameworks/platforms as used by the customers websites platform for implementing tracking components.

  6. Understand and implement the various scripts and code which can work with different Analytics Tools

  7. Understand the connection of GCP with GA 360 and its working

  8. Integrate existing software products and getting various platforms to work together

  9. Configure alerts on top of tracking to monitor & correct the same

  10. Building reusable, optimized, scalable, secure code and libraries for future use

  11. Initiate new research tasks which enable the analyst at Tatvic or Client to leverage to improve the business KPIs

Read more
Azani Sports
at Azani Sports
1 recruiter
Ashima Galhotra
Posted by Ashima Galhotra
Remote, Bengaluru (Bangalore)
1 - 4 yrs
₹4L - ₹5L / yr
Graphic Designing
Adobe Photoshop
skill iconAdobe Illustrator
Adobe After Effects
Adobe Premiere Pro

We are looking for a Motion Graphic Designer, with up-to-date tool subject knowledge and trends, to design solutions with high visual impact.

 

Roles And Responsibilities

  • Ability to understand complex products and convert to graphical representations within timelines while maintaining quality
  • Create videos from concept to production. Should be able to ideate, storyboard, script, and illustrate animate the video
  • Create gif banners, motion graphics, social media short videos, product explainer videos, presentations, etc.
  • Understand the product(s) to capture the essence as well as understand the target audience to capture their interest.

 

What We Are Looking For

  • Freshers or 1 year Experienced Candidate
  • Proficient with Adobe Photoshop, Illustrator, After Effects, Premiere Pro
  • Strong digital design background
  • Strong portfolio to showcase creativity and ability to tell stories through illustrations, videos, motion graphics, and - - editing skills
  • Creative, ownership driven and has communication presentation skills.
Read more
A sports-focused digital media agency
A sports-focused digital media agency
Agency job
via Jobdost by Ankitha Vyas
Mumbai
1 - 2 yrs
₹2L - ₹5L / yr
Project Management
JIRA
Project manager
Agile
digital project management

Designation:  Associate 

Office Location: Goregaon Mumbai


Position description:

1+ years’ experience as a project manager in the information technology sector.


Primary Responsibilities:

  • Work with stake holders to plan, allocate and assign development tasks for multiple development teams
  • Work with identified development teams to accurately estimate development effort and dependencies to inform the prioritization of the product backlog
  • Take direct Project Management responsibility for the delivery of products
  • Develop and maintain core project documentation, including product vision and scope, detailed business/customer requirements
  • Create and work with delivery teams to prioritize product development project plans, schedules, and budgets
  • Take ownership to thoroughly test and delivered to the highest quality

Required Skills:


Mandatory: 
Passionate about sports, Problem solving, Team player, Target & Result oriented.


Functional: 
Project management in the information technology sector, manage projects using modern web and app technologies, JIRA, Agile, experience in building digital fan experiences, understanding of analytics and dashboards.

Read more
Directi
at Directi
13 recruiters
Richa Pancholy
Posted by Richa Pancholy
Bengaluru (Bangalore)
4 - 10 yrs
₹5L - ₹30L / yr
skill iconPostgreSQL
Databases
oracle
We are looking to hire outstanding individual to join our Engineering team to manage and support the database infrastructure. What is the job like? *Manage Postgres server database product lifecycle in production and pre-production environments. *Monitor system health and performance and ensure high performance, availability and security. *Apply data modelling techniques to ensure development and implementation support efforts meet integration and performance expectations. *Independently analyze, solve and correct issue on high priority. *Assist developer with complex query tuning and schema. *Provide 24x7 support for the production database and help in outage resolution. What do we look for? *4+ years of strong experience with Performance tuning and optimization. *Experience in High Availability, maintenance and Disaster Recovery plans. *Good understanding and experience in Backup, restore and recovery models.
Read more
Think learn Pvt-ltd Byjus
at Think learn Pvt-ltd Byjus
24 recruiters
Aneesh Raghavan
Posted by Aneesh Raghavan
Bengaluru (Bangalore)
3 - 7 yrs
₹2L - ₹6L / yr
Graphic Designing
User Experience (UX) Design
skill iconHTML/CSS
Graphic designer with Fashion Knowledge people like Myntra and Ajio
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos