Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Talent Pro
Bengaluru (Bangalore)
6 - 8 yrs
₹20L - ₹45L / yr
skill iconPHP
skill iconNodeJS (Node.js)
skill iconJava
skill iconAmazon Web Services (AWS)
RabbitMQ
+2 more

Strong Senior Backend Engineer profile

Mandatory (Experience 1) - Must have more than 6+ YOE in Software Development

Mandatory (Experience 2) - Should have strong backend development experience in any backend language - Java, Javascript (NodeJS), Go, PHP (PHP experience is preferred)

Mandatory (Core Skill 1) - Must have Experience in any databases - MySQL / PostgreSQL / Postgres / Oracle / SQL Server / DB2 / SQL

Mandatory (Core skill 2) - Experience with async workflows and messaging queues such as( RabbitMq, Kafka, Message Broker / Queue, Google Pub / Sub, Kinesis etc)

Mandatory (Core Skills 3) - Experience in Cloud - AWS / Google Cloud / Azure

Mandatory (Company) - Product Companies only

Mandatory ( Education) - BE / BTECH / MCA

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Bengaluru (Bangalore), Mumbai
6 - 10 yrs
₹6L - ₹24L / yr
Investment banking
Equity derivatives
Derivatives
Equity
capital market

JD

Prior experience of about 6-10years

1 - Must have fair understanding of products like future, forward, options(call and put), bonds, swaps etc

2 - Must have fair understanding of mutual funds and NAV

3 - Should have good communication skill.

4 - Basic SQL

5 - Business analyst experience and should know about BRD.

6 - Good to have Knowledge of risk management in general.


Responsibilities:

Candidate will have to perform data analysis.

Candidate will have to speak with different risk engine team to identify the appropriate engine for given asset classes, and accordingly he has to do requirement analysis and testing.

Should have good product knowledge.

Should have good communication skill.


Read more
The Editing Table
at The Editing Table
2 candid answers
Nitisha Pradhan
Posted by Nitisha Pradhan
Mohali, Punjab, Chandigarh
1 - 2 yrs
₹1.5L - ₹3L / yr
Image editing
Adobe Photoshop Lightroom

#hiring #lightroomeditor

THE EDITING TABLE is looking for a skilled Lightroom Photo Editor to elevate our creative team. We are looking for someone with an exceptional eye for color correction, image enhancement, and the ability to maintain visual consistency across all projects.

Requirements:

* Expertise in Adobe Lightroom is essential.

* Wedding photo editing experience is a strong advantage.

* 1+ year of experience in photo editing.

* Impressive portfolio showcasing before/after transformations

* Proven ability to meet tight deadlines with accuracy


Location : Mohali, Punjab (On site job)


Read more
Tech based Photography platform
Tech based Photography platform
Agency job
via Merito by Jinita Sumaria
Gurugram
2 - 6 yrs
₹5L - ₹6L / yr
Social Media Marketing (SMM)
Paid Marketing
Paid Social
Performance Marketing
Paid Media

Role - Social Media Executive


About Company :-


Our client is a Tech Based Platform for freelance Photographer, Videographers, Food stylist and Cinematographer. Founded by alumni of IIM Bangalore. They are operational in about 100 Cities and 28 Countries. Leader in Food and Real Estate Photography. Done about 7000+ projects across the Globe.


Job description :-


1. Plan, monitor & execute social media activities on channels like Facebook, Instagram, Linkedin, Twitter, etc.

2. Run ads on Facebook, Instagram, Google, and other similar channels.

3. Be actively involved in SEO efforts (keyword, image optimisation etc.)

4. Website content management

5. Measure performance of digital marketing efforts using a variety of Web analytics tools (Google Analytics etc.)

6. Coordinate and work with any external stakeholders like marketing agency, content writers, etc.

7. Provide creative ideas for content marketing.

Minimum experience - 2 years 

Read more
Kira Studio
at Kira Studio
1 recruiter
Abhishek Rathi
Posted by Abhishek Rathi
Remote only
2 - 5 yrs
₹20L - ₹25L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

About us:
At Priori Capital, we are building The financial SaaS for the Businesses operating with digital assets by empowering the teams to operate in an  effective, efficient and error-free manner by bringing all things finance on one platform. We aim to solve digital asset management for institutions offering cryptographic security, user management setup and secure access to the blockchain ecosystem.

We’re looking for someone passionate about driving innovation and solving exciting problems.


What are you joining: 

We are currently in a fast-paced growth environment where the only constant is evolution!

Our team includes individuals with experience in internationally known blockchain and fintech companies like Polygon (Matic), udaanCapital, Iris, Infosys, Cognizant etc.

We are a part of the Kira community and backed by a Polygon Co-founder as an investor and mentor.


What will you do:

  • Design to simplify the complexity - Work with our designers to simplify the systems that are working across chains, protocols or existing financial systems.
  • Build for the future of finance - Build, deploy and come back to the whiteboard with the core team to innovate, ideate and scale solutions.
  • Own your ship - Be responsible to build framework components, own the development process and drive the development cycle to improve transparency and productivity across the team.

What are we looking for:

  • 2+ years of experience in Frontend Engineering building scalable web applications: Experience in web3/fintech is not a mandate to apply. You learn as you go!
  • You should be good at your game: Detailed oriented and have a thorough knowledge of JavaScript, HTML5 and CSS3 & hands-on experience with either of VueJS, Angular, React OR similar.
  • You have a strong bias for action: You seek problems. If you see one, you find the solution. If you have one, you should be already building it. If it fails, you move to the next!
  • You want to grow but together: You want to learn and master new skills by tackling new problems with the team

We are more excited if you have this:

  • Knowledge of Git, GraphQL, Flux, Webpack, etc.
  • Good at analytical problem solving, know-how of core computer science and algorithms.
  • Interested in blockchain or finance.
  • Experience in Fintech or Web3 Applications

Benefits

  • Learn from the best!
  • Work from wherever
  • Self-managed leave policy
  • Focus on Work-life Balance
  • Learning Budget to hone a skill or learn new ones
  • Be a part of the fast-growing environment
  • Competitive Salary
Read more
yangpoo executive education
Nikita Fernandes
Posted by Nikita Fernandes
Mumbai, Navi Mumbai
0 - 6 yrs
₹2.4L - ₹5L / yr
Communication Skills

Role: Career Counsellors / Inside Sales Managers



Location: Mumbai (Lower Parel / Thane)


Who are we?


We are a learner-centric global EdTech company that transforms people's passion into profession through new-age, future-ready and industry-relevant education. We equip learners with cutting-edge skills and qualifications so they can #StayRelevant in a transforming global landscape.


Who are we looking for?


A Career Counsellor who can join our young and vibrant team. If you are someone who has the gift of the gab and wants to transform the higher education sector, we would love to hear from you. As part of our team, you will be in the forefront of transformative initiatives in higher education and a valuable resource who will directly contribute to and benefit from our growth.


Roles and Responsibilities:


● Connect daily with 80-100 working professionals on calls. Accordingly, generate and track leads via CRM databases. (Minimum 120 minutes of talktime.)


● Understand each student's area of interest, build rapport and identify avenues of upskilling.


● Provide comprehensive information about available programs to students via phone calls, emails, WhatsApp, etc.


● Diligently complete daily tasks and achieve weekly/monthly targets.


Qualifications:


● Excellent communication skills and the ability to steer conversations.


● Bachelor's degree in any discipline.


● Candidates from the Education, Insurance, EdTech, BPO, KPO and BFSI sectors will be given preference.


● Freshers can also apply.


Only candidates from Mumbai are eligible to apply.


Requirements:


● Age: 18 - 30 years


● Job Timings - 10.00 am - 7.30 pm (Monday - Saturday)


Candidate must have his / her own laptop.



Yangpoo Executive Education provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type as per Indian laws.

Read more
DuckTale IT Services Pvt Ltd
Shivani Gautam
Posted by Shivani Gautam
Mohali, Punjab
1 - 4 yrs
₹1.8L - ₹5L / yr
Business Development
Lead Generation
Presales
Client Servicing
Business requirements
Business Development Executive
Roles and Responsibilites: 
  • To bid on portals like Upwork, Guru, PPH, etc. Sending Proposal bid to grab new business opportunities Coordinate development of detailed technical proposals with the technical team.
  • Client Handling (Managing Existing clients and acquiring new clients) interaction clients to analyze the project requirements.
  • Bidding and New business generation on Bidding Platforms
Read more
Jivox Software India Pvt Ltd
Remote only
3 - 6 yrs
₹15L - ₹23L / yr
Object Oriented Programming (OOPs)
skill iconAmazon Web Services (AWS)
skill iconJava
J2EE
skill iconSpring Boot
+4 more

Your Opportunity

  • Own and drive business features into tech requirements
  • Design & develop large scale real time server side systems
  • Quickly create quality prototypes
  • Staying updated on emerging technologies
  • Ensuring that all deliverables adhere to our world class standards
  • Promote coding best practices
  • Mentor and develop junior developers in the team

 

Required Experience:

  • 4+ years of relevant experience as described below
  • Excellent grasp of Core Java, Multi Threading and OO design patterns
  • Experience with Scala, functional, reactive programming and Akka/Play is a plus
  • Excellent understanding of data structures and algorithms
  • Solid grasp of large scale distributed real time systems
  • Prior experience on building a scalable and resilient micro service
  • Solid understanding of relational databases, NoSQL databases and Caching systems
  • Good understanding of Big Data technologies such as Spark, Hadoop is a plus
  • Experience on one of AWS, Azure or GCP

 

Who you are :

  • You have excellent and effective communication and collaborative skills
  • You love problem solving
  • You stay up to date with the latest technologies and then apply them in real life
  • You love paying attention to detail
  • You thrive in meeting tight deadlines and prioritising workloads
  • Ability to collaborate across multiple functions

 

Education:

Bachelor’s degree in Engineering or equivalent experience within the field

Read more
 Accoona Global
at Accoona Global
2 recruiters
Deepa Wankhede
Posted by Deepa Wankhede
Pune
4 - 7 yrs
₹4L - ₹9L / yr
Microsoft SharePoint
skill iconHTML/CSS
XSL
XSLT
skill iconJavascript
+1 more
SharePoint Online and SharePoint Server
*Working knowledge of configuration and custom development of SharePoint components including web parts, event receivers, timer jobs, templates, Features, application pages, site pages, custom list types, site columns, content types, custom workflows and site definitions and web development (HTML, CSS, XSL, XSLT, JavaScript/ jQuery)
• Hands on experience on SharePoint applications using Client and Server Object modelling .
• Experience in analysis, design, hands-on development and delivery of web-based applications.
 
Read more
DataAngle Technologies Pvt Ltd
Neeraj Reddy
Posted by Neeraj Reddy
Hyderabad
0 - 5 yrs
₹1.1L - ₹1.5L / yr
Sales
Business Development
Field Sales
Telesales
We are looking for candidate with following skills

- Minimum 6 months of experience into Sales.
- Able to handle visitors inquiries and updating reports
- Should have good communications skills
- Experience in healthcare industry will be preferred
- Good knowledge in using computer (windows)
- Should be willing to visit hospitals, collecting information, conducting trade shows etc
- Available to work in General Shift

Note: This is work @ Office

Interested candidates please walk in for an interview with updated resume

Address:
DataAngle Technologies Pvt Ltd
Plot no 120, Tirumala Mansion,
KavuriHills, Beside Jubilee Ridge Hotel,
Madhapur, Hyderabad - 033

Contract length: 6 months
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos