Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Rayvat Outsourcing
at Rayvat Outsourcing
1 recruiter
HR Rayvat
Posted by HR Rayvat
Gandhinagar
1 - 2 yrs
₹2.4L - ₹3L / yr
Unity 3D
OpenGL
3ds Max
DirectX
skill iconC#
+3 more

We are looking for a Unity or Unity3D Developer to join our team! As a Unity or Unity3D Developer at our company, you will be responsible for implementing 3D Virtual Tours for Real Estate projects helping  translate design ideas, concepts, and requirements into a functional and engaging VR experience. Development platforms include Android,IOS and Oculus Rift.

 

Roles and Responsibilities

  • Plan and implement virtual tour functionality
  • Transform design specification into functional tours
  • Communicate with other team members for creating a seamless experience.
  • Design, build, and maintain efficient, reusable, and reliable code
  • Ensure the best performance, quality, and responsiveness of applications and tours
  • Identify process and application bottlenecks and bugs

 

Desired Candidate Profile

 

Key Skills: Unity3D, C#, C++ and Javascript

  • Extensive knowledge of Unity, as well as extensive experience as a game/real estate tour programmer, using C# on a major development platform, such as Microsoft Visual Studio (or equivalent).
  • Has extensive knowledge of 3D computer graphics, including use of DirectX SDK, OpenGL, shader programming languages, and optimizing 3D performance in games/tours on both high-end and lowed.
  • Experience with UI design & development.
  • Experience with scripting, textures, animation, GUI styles, and user session management
  • Native iOS & Android app development experience a plus
Read more
Hiringdog Interview Platform
Remote only
4 - 8 yrs
₹25L - ₹35L / yr
skill iconNodeJS (Node.js)

Responsibilities:

  • Develop and Optimize: Design and implement scalable backend services and Frontend services.
  • Cloud and Integrations: Work with AWS/GCP and integrate third-party APIs seamlessly.
  • System Architecture: Design databases, microservices, and backend workflows for scalability.
  • Independent Execution: Own projects end-to-end, from architecture to deployment.
  • R& D and Experimentation: Innovate and experiment with new tools, frameworks, and AI-driven features.


Requirements:

  • 4+ years of experience in a startup or product-based company.
  • Strong proficiency in backend development and Frontend.
  • Experience with Cloud Platforms (AWS/GCP) and API integrations.
  • Ability to work independently in a fast-paced, early-stage startup.
  • A humble, learning-oriented mindset with a passion for problem-solving.


Read more
A B2B SAAS company
A B2B SAAS company
Agency job
via Qrata by Prajakta Kulkarni
Remote only
3 - 8 yrs
Best in industry
Content Marketing
Content Strategy
Content Writing

🔥 About this role

We are building our founding team and are looking for folks who are excited to get their hands dirty in a 0 to 1 journey.


If you are expecting a working playbook that you can scale, we are probably not the right fit for you at this point.


However, if you are excited about creating the playbook from scratch, we would love to hear from you 🙂


You will work closely with the founders.


We are looking for a versatile, enthusiastic content marketer with an inclination towards digital long-form content to join our founding team.


As the second member of our marketing team, you'll need to possess a strong drive, take ownership of your work, and have an insatiable desire to take action and make things happen 🚀


We don’t write content for the sake of writing content - we only write content that genuinely adds value to our users.


You will be responsible for developing engaging, high-quality, and SEO-friendly content.


Your primary focus will be on creating original content that attracts and engages our target audience, solves their problems, drives organic traffic, and promotes brand awareness.


You will be working closely with the founders and product teams to ensure that the content you produce stays relevant, user-friendly, and SEO-friendly at all times.


You will play a pivotal role in shaping our brand's voice and message and ensuring that our content is engaging and relevant to our target audience.




You will be required to:

  • Develop a deep understanding of the user, their pain points, stage of the journey and intent
  • Create content formats like videos, blog posts, email campaigns, webinars, eBooks, whitepapers, templates, guides etc, constantly keeping in mind our ICP and buyer persona.
  • Hustle your way to find channels to promote the different forms of content that you will create
  • Ensure that the content we produce reflects your understanding of their pain points and actually solves it through your content
  • Frequently conducting keyword research and incorporating best SEO practices in the content you produce
  • Set up personal processes to improve the efficiency and effectiveness of the writing process: Strive to get to the published stage with minimal reviews
  • Ensure all-around consistency with regard to the style, fonts, images and tone
  • Research competitors and industry trends to come up with content pegs that communicate our USPs and strengths to the correct TG
  • Publish high-quality, compelling content within established timelines to achieve outcomes
  • Work towards minimizing the time for research by curating high-quality sources for research



📎 Key qualifications

  • Minimum 3 years as a content marketer, or similar role in a B2B SaaS company.
  • Portfolio with work samples showcasing your writing skills with different forms of content.
  • Tech-savvy with the ability to do deep research and explain complex technical matters in a simple manner without using jargon.
  • Excellent skill at researching new and obscure topics online.
  • Excellent command of the English language (grammar and vocabulary) and a passion for crafting compelling and creative content.
  • Excellent communication, verbal, and interpersonal skills.
  • Comfort in using tools like Ahrefs, SEMrush, Buzz Sumo, Webflow, Uber Suggest, and ChatGPT, among others.
  • Motivated self-starter who likes a fast-paced work environment with multiple active projects.
  • Grit and curiosity to learn new topics in great depth.
  • Ability to build, manage and motivate a team.
  • Self-driven individual with high ownership and strong work ethic
  • Previous entrepreneurial experience is a huge plus.
  • Experience catering to CFO persona is a plus.
  • Familiarity with billing systems, CPQ and accounting systems is a plus.
  • Not taking yourself too seriously :)



🤝Good To Have:

  • Experience working for an early-stage startup
  • Experience with finance/accounting terms or Fintech software
  • Experience with hiring and managing interns


Read more
Pinsout Innovation
Ayush Singhal
Posted by Ayush Singhal
Noida
1 - 2 yrs
₹3.2L - ₹4.2L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconLaravel
+1 more
  1. Proven experience as a Laravel Developer with a strong portfolio of past projects.
  2. In-depth knowledge of Laravel, PHP, and MySQL.
  3. Experience with front-end technologies such as HTML, CSS, JavaScript, and jQuery.
  4. Familiarity with version control systems (e.g., Git).
  5. Understanding of RESTful API development and consumption.
  6. Strong problem-solving and communication skills.
  7. Ability to work collaboratively in a team environment.
  8. Attention to detail and a commitment to delivering high-quality solutions.
  9. Experience with testing frameworks (e.g., PHPUnit) is a plus.
  10. Knowledge of other PHP frameworks and CMS (e.g., Symfony, CodeIgniter, WordPress) is a plus.


Read more
VCTI
VCTI
Agency job
via Bohiyaanam Talent Solutions by Sakshi kulkarni
Bengaluru (Bangalore)
4 - 5 yrs
₹15L - ₹20L / yr
skill iconC
skill iconC++
Kernel Programming
Linux kernel
skill iconPython
+2 more

                      Velankani Communications Technology

                                         Job Description

Immediate joiner/ 30 days Notice Period
Location: Bangalore

Academics:

B.E. / B. Tech / MCA/ M. Tech (Computer Science / Electronics & Communication / Electrical) With 4-5 Years of industry experience. 

Primary Skills:

  • Candidate should have 4-5 years of development experience with hands-on work on Linux kernel programming skills and device driver development in the products like SD-WAN, ADS/ADC,
  • Advanced firewall, WAN Optimization, etc.

Experience:

  • Experienced in System Programming and developing multi-threaded high performance networking products.
  • Strong in Linux kernel programming and device driver development.
  • Knowledge of DPDK, VLAN, Trunking, WiFi 802.11 standards, and LTE.

Preferred:

  • Experience in hypervisors and cloud platforms
  • Strong Knowledge in the networking domain (L2/L3/L4)

Languages:
  • C, C++
  • Python(Good to have)

Primary Skills:
C, C++, Linux kernel programming, Device Driver, VLAN, DPDK.

Secondary Skill: Data Structures, Cloud, Python, Networking.


Read more
Santbay Technologies
at Santbay Technologies
1 recruiter
Sandhya Vasu
Posted by Sandhya Vasu
Cochin
0 - 1 yrs
₹1L - ₹3L / yr
Digital Marketing
Marketing
Search Engine Optimization (SEO)
Social Media Marketing (SMM)
Social Media Optimization (SMO)
  • Perform keyword research in coordination with client business objectives to optimize existing content and uncover new opportunities
  • Provide SEO analysis and recommendations in coordination with elements and structure of websites and web pages
  • Provide recommendations and execute strategies for content development in coordination with SEO goals – general and keyword specific
  • Administer search engine programs (XML sitemaps, shopping feeds, webmaster tools) for purposes of diagnostic reporting on client projects
  • Help to create and support marketing content to socialize and use for social media purposes (e.g. customer videos briefs, customer case studies, blog posts, posts from analysts and customers)
  • Implement link building campaigns in coordination with client SEO goals
  • Assist in development and execution of communication/content strategies via social communities in coordination with SEO goals
  • Keep pace with SEO, search engine, social media and internet marketing industry trends and developments
  • Research and administer social media tools in support of clients’ social media strategy
  • Monitor and administer web analytics dashboards, reports and key reporting tools, and point out key areas of importance in accordance client goals
  • Monitor and evaluate search results and search performance across the major search channels
  • Communication to team and management on project development, timelines, and results
  • Work closely with the other team members to meet client goals

Job Type: Full-time

Salary: ₹12,000.00 - ₹15,000.00 per month

Read more
Headrun
at Headrun
7 recruiters
Ravi Chandra Rampalli
Posted by Ravi Chandra Rampalli
Bengaluru (Bangalore)
3 - 5 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask

Requirements 

 

  •  3-5 years of experience working on Python Environment
  •  Knowledge on software development methodologies and being able to work on projects individually or as part of a team. Should be able to work with AGILE methodology
  •  Knowledge of relational databases, version control tools and other development tools
  •  Understanding of the threading limitations of Python, and multi-process architecture
  •  Understanding of accessibility and security compliance
  •  Strong interest in learning new skills/technologies and curiosity to explore various Technologies.
  •  Should have strong analytical skills
  •  Good communication
  •  Able to integrate multiple data sources and databases into one system
  • Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform

 

Must Required Skills:

 

  • Python 2/3
  •  should have worked on one or more major Python web frameworks like Django.
  • Worked with APIs development, integration of third-party APIs
  • Working knowledge of MySQL databases integration with Python Environment.
Read more
Finly.io
at Finly.io
1 video
9 recruiters
Prernna Barla
Posted by Prernna Barla
Bengaluru (Bangalore)
4 - 5 yrs
₹18L - ₹24L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconElastic Search
Nginx
skill iconRedis

Opportunity in our Product Team?
Our system has over 4 products & 12 modules designed by product managers working with banking & finance experts. The company’s growth from here is based on a multi-product strategy. The way we’re scaling our product team is in-line with the company’s strategy.

Your customers are the CFOs & Finance Teams in mid to large scale enterprise businesses and you will build these products to solve the problems faced by them.

You’ll become familiar with all parts of our stack from end to end. You’ll design and implement features to be scalable and resilient by working with both our infrastructure engineers and our product engineers. You’ll be a driver for positive change to Finly’s engineering culture, processes and technology.

Here are some examples of the projects in the different products:
Payment automation by building a deep integration with multiple banking systems:

  • Governance frameworks with policy controlled workflows.
  • Core finance document management system.
  • Automating reconciliation of transactions across business
  • Collaboration tools among finance, vendors & employees.
  • Continuous ETL for integrating with CRMs like Salesforce & Accounting Systems like SAP.

WITHIN 1 MONTH, YOU'LL

  • Complete Finly’s new-hire training week, and learn Accounts Payable
  • Processes & the various partners we work with to make Finly happen.
  • Investigate, solve and release a bug fix to production. In order to do this you will ramp up on Finly’s engineering stack by pair-programming with your teammates and attending engineering training sessions designed and presented by the team.
  • Meet with cross-functional peers around the company to learn how the product functions.
  • Complete your engineering starter project and deploy your first changes to production.

WITHIN 3 MONTHS, YOU'LL

  • Individually contribute reliably ship full features to customers.
  • Own major product areas and take features from mock to deploy.
  • Estimate technical scope and time to complete major features and initiatives.

WITHIN 6 MONTHS, YOU'LL

  • Move to new product vertical & initiative and start designing and architecting scalable systems as per the requirements discussed with Product Manager.
  • Have made a visible impact on the product for all the users of Finly.
  • Work closely with your team to remove roadblocks, educate on best practices and improve how we work.
  • Be comfortable navigating most of our stack and infrastructure
  • Be responsible for the planning, scoping, design, and implementation of new features
  • Participate in interviewing and hiring, as a way to influence team growth and how our values inform our culture

WITHIN 12 MONTHS, YOU'LL

  • Individually contribute and lead teams to reliably ship full features to customers.
  • Estimate technical scope and time to complete major products and initiatives.
  • Define tools and standards for product engineering to measure performance impact of releases
  • Help grow other engineers technically by mentoring, pairing and developing other learning opportunities
  • Collaborate with engineering and product leadership to define priorities and set delivery goals.

So in this role, you will work with the respective team’s product manager and other engineers in that team. You may work on the front-end or backend or both based on the requirement of the project.

Join us & have the authority and responsibility to make things happen!

Read more
Synergy Telematics Pvt Ltd
Rajeev Kumar
Posted by Rajeev Kumar
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹3.5L - ₹7L / yr
Recruitment/Talent Acquisition
Human Resources (HR)
Performance Evaluation
Training and Development
Compensation & Benefits
+3 more

Position :      Recruiter - (IT / Telecom)


Location : Delhi/NCR



Job Description


1) Should have Strong analytical and logical abilities

2) Excellent verbal & written communication skills
3) Should have Experience & Knowledge into domestic IT/Telecom hiring industry.
4) Strong Experience in Client Handling/Team Handling.

5) Experience in Sourcing profiles through Job Portals, Networking, Headhunting & Social Networking Sites.
6) Should have Knowledge about Technical Skills & Recruitment Process. (Sourcing).

7) Should have strong Telecom Technology Skills.

8) Must be target driven and must be able to thrive in a time pressured environment.

9) Strong Experience in End to End Recruitment Life Cycle(Sourcing to On boarding).

10) Familiarity with Applicant Tracking Systems and resume databases

11) Screen incoming resumes and application forms

12) Following up on the interview process status

13) Reference and background checks
14) Must have basic knowledge of Salary Heads
15) Comfortable for travelling if required to visit rest of the offices

Read more
Promobi Technologies
at Promobi Technologies
1 video
15 recruiters
Amol Ugalmugale
Posted by Amol Ugalmugale
Pune
3 - 7 yrs
₹4L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconAngularJS (1.x)
skill iconHTML/CSS
skill iconJavascript
Fullstack Developer
Ruby on Rails architecture best practices Strong OOP knowledge in Ruby. Asynchronous Networking in Ruby Designing RESTFul HTTP APIs using JSON-Schema or JSON API (jsonapi.org). Ability to architect and develop API only backend Experience in using ActiveRecordSerializer Understanding O-Auth2 or JWT (Json Web Token) authentication mechanisms. How to use RSpec Rails Security Best Practices PostgreSQL and Rails.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos