Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Vysystems
Vysystems
Agency job
via Vy Systems by Sanjai Kumar
Hyderabad, Coimbatore
2 - 5 yrs
₹1L - ₹4L / yr
Voice processing
DNS
VPN
SQL
Troubleshooting

Job Summary:


Technical Support Associates


We are looking for technically skilled and customer-oriented SME Voice – Technical Support Associates to provide voice-based support to enterprise clients. The role involves real-time troubleshooting of complex issues across servers, networks, cloud platforms (Azure), databases, and more. Strong communication and problem-solving skills are essential.


Key Responsibilities:


- Provide technical voice support to B2B (enterprise) customers.

- Troubleshoot and resolve issues related to:

- SQL, DNS, VPN, Server Support (Windows/Linux)

- Networking (TCP/IP, routing, firewalls)

- Cloud Services – especially Microsoft Azure

- Application and system-level issues

- Assist with technical configurations and product usage.

- Accurately document cases and escalate unresolved issues.

- Ensure timely resolution while meeting SLAs and quality standards.


Required Skills & Qualifications:


- 2.5 to 5 years in technical support (voice-based, B2B preferred)

 Proficiency in:

- SQL, DNS, VPN, Server Support

- Networking, Microsoft Azure

- Basic understanding of coding/scripting

- Strong troubleshooting and communication skills

- Ability to work in a 24x7 rotational shift environment

Read more
USP HR Technologies
at USP HR Technologies
2 candid answers
Meghana Guduri
Posted by Meghana Guduri
Hyderabad
8 - 12 yrs
₹20L - ₹30L / yr
skill icon.NET
Entity Framework
skill iconAmazon Web Services (AWS)
MySQL
skill iconRedis

We have an immediate opportunity for Sr Backend Developer position with one of our clients based out of Hyderabad location.


Please find the below Job Description.


Position : Sr Backend Developer

Work Location : Hyderabad

Experience : 8+ yrs

Job Type : Fulltime

Mode : Hybrid


Description:


We are looking for a skilled and proactive Backend Developer with strong hands-on experience in .NET 8, Entity Framework, and AWS services to join our dynamic development team. The ideal candidate will be passionate about building scalable APIs, working with microservices architecture, and deploying infrastructure using Terraform.

You will play a key role in designing, developing, and maintaining high-performance backend systems for cloud-native applications.


Key Responsibilities:


* Design, develop, and maintain robust and scalable APIs using .NET 8 and Entity Framework.

* Optimize data access and caching strategies using Redis Cache.

* Work with MySQL for efficient data storage and retrieval.

* Integrate and manage AWS services including:

 RDS for database hosting

 SQS and SNS for messaging and notifications

 ECS for containerized application deployments

 Secrets Manager and KMS for secrets and key management

* Write clean, maintainable, and testable code following best practices and SOLID principles.

* Collaborate with cross-functional teams in code reviews, architectural discussions, and deployment planning.

* Use GitLab for version control and CI/CD pipelines.

* Provision and manage infrastructure using Terraform.

* Monitor, troubleshoot, and enhance application performance and reliability.


Required Skills & Experience:


* Strong proficiency in .NET 8 and C#.

* Experience with Entity Framework Core.

* Proficient in building and consuming RESTful APIs.

* Hands-on experience with Redis for caching.

* Solid experience with MySQL or other relational databases.

* Practical knowledge of AWS services, especially:

 RDS, SQS, SNS, ECS, Secrets Manager, KMS

* Experience with GitLab for source control and DevOps pipelines.

* Familiarity with Terraform for infrastructure as code.

* Good understanding of microservices, containerization, and scalable architecture.

* Strong problem-solving and debugging skills.


Nice to Have:


* Experience with Docker and Kubernetes.

* Knowledge of monitoring tools (e.g. CloudWatch, Prometheus, Grafana).

* Exposure to CI/CD best practices.

 

Please send us your updated resume and the below required details for further process.


Full Name:

Email ID:

Contact No:

Skype ID:

Total Experience :

Relevant Experience :

Current Location :

Current CTC :

Expected CTC :

Notice Period :

Reason for Change :


References of your friends/colleagues will be appreciated.



Thanks & Regards,

Meghana

USP HR TECHNOLOGIES.(www.usptech.in)

Read more
Skydivine Solution OPC Pvt Ltd
Sandip Nirmal
Posted by Sandip Nirmal
Pune
1 - 2 yrs
₹2.5L - ₹3L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more
Job description
The ideal candidate is a highly resourceful and innovative developer with extensive experience in the layout, design, and coding of websites specifically in PHP format. You must also possess a strong knowledge of web application development using PHP programming language and MySQL Server databases.

Responsibilities

Perform a mix of maintenance, enhancements, and new development as required
Work in a data analyst role and with business intelligence applications
Document features, technical specifications & infrastructure Responsibilities
Work cross-functionally to convert business needs into technical specifications

Qualifications

1+ years of experience in web development and software design
Expertise in front-end technologies (HTML, JavaScript, CSS), PHP frameworks, and MySQL databases
Read more
US based startup that offers an open source authentication
US based startup that offers an open source authentication
Agency job
via Qrata by Rayal Rajan
Remote only
2 - 7 yrs
₹20L - ₹45L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconDjango
skill iconFlask

What kind of work will you get?

We are looking for a Nodejs developer.

Examples of technical tasks:

Working on our backend SDK to implement APIs that will be consumed by the frontend widgets

Designing APIs for different auth recipes

Architecting auth flows

You will also be given non technical tasks like product brain storming, competitor analysis and writing documentation.

Note: Compensation is as per the applicant's geography

Requirements

Well versed in nodejs with 2+ years of professional experience

Familiar with and comfortable working with Web frameworks like FastAPI, Django and Flask

Familiar with HTTP networking in nodejs

Strong understanding of async and sync modes in nodejs

Bonus:

Contributed to open source, or have your own open source repo with a community and many github stars

Built an in-house authentication or authorization solution or worked with solutions such as Keycloak, Auth0, Ory, Okta etc

Read more
Navriti Technologies
Jaipur
5 - 7 yrs
₹6L - ₹8L / yr
Digital Marketing
Search Engine Optimization (SEO)
Social Media Marketing (SMM)
Web Analytics

Job Description: We are seeking a dynamic and experienced Digital Marketing Trainer to join us. The Digital Marketing Trainer will be responsible for designing and delivering comprehensive training sessions on various aspects of digital marketing to our students.


Responsibilities:

  • Design and develop digital marketing training programs, workshops, and materials based on industry best practices and emerging trends.
  • Conduct engaging and informative training sessions on topics including but not limited to:
  • Search Engine Optimization (SEO)
  • Pay-per-click (PPC) advertising
  • Social media marketing (SMM)
  • Content marketing
  • Email marketing
  • Digital analytics and reporting
  • Provide hands-on training and practical assignments to enhance participants' understanding and application of digital marketing strategies.
  • Assess and evaluate participants' performance and progress throughout the training programs.
  • Stay updated with the latest digital marketing trends, tools, and technologies, and incorporate them into training programs as appropriate.
  • Mentor and support participants in applying digital marketing concepts to real-world projects and campaigns.


Requirements:

  • Proven experience of at least 5 years as a Digital Marketing Trainer or similar role, with a strong background in digital marketing strategies and techniques.
  • In-depth knowledge of SEO, PPC, social media platforms, email marketing tools, and digital analytics.
  • Excellent presentation and communication skills, with the ability to explain complex digital marketing concepts effectively.
  • Hands-on experience in managing digital marketing campaigns and projects across multiple platforms.
  • Ability to inspire and motivate learners, fostering a collaborative and supportive learning environment.
  • Bachelor’s degree in Marketing, Communications, or a related field. Additional certifications in digital marketing (e.g., Google Ads, Google Analytics) will be advantageous.
  • Prior experience in curriculum development or instructional design is a plus.


Application Process: Interested candidates are encouraged to submit their resume.

Read more
Bengaluru (Bangalore)
0 - 2 yrs
₹2.5L - ₹4L / yr
Communication Skills
Sales
Customer Relationship Management (CRM)


About Us: Codebrahma Tech Solutions is a leading provider of innovative IT solutions, dedicated to delivering cutting-edge technology and exceptional service to our clients. We are seeking a proactive Business Development Executive to join our IT sales team and drive business growth.


Job Summary: The Business Development Executive will be responsible for identifying new business opportunities, building client relationships, and driving sales of our IT solutions and services. This role requires strong sales skills, excellent communication, and a deep understanding of the IT industry.


Key Responsibilities:

- Identify and research potential clients and market segments.

- Develop and implement effective sales strategies to target new clients.

- Generate leads and build a strong pipeline of potential customers.

- Conduct sales presentations and product demonstrations to prospective clients.

- Develop and maintain long-term relationships with clients.

- Negotiate contracts and close sales to meet or exceed targets.

- Collaborate with the marketing and technical teams to align sales strategies with company goals.

- Track and report on sales activities, opportunities, and progress.

- Stay informed about industry trends, competitive landscape, and emerging technologies.


Qualifications:

- Bachelor's degree in Business, Marketing, IT, or a related field.

- 2+ years of experience in business development or sales, preferably in the IT industry.

- Proven track record of achieving sales targets and driving revenue growth.

- Strong knowledge of IT solutions and services.

- Excellent communication, negotiation, and presentation skills.

- Proficiency in using CRM software and sales tools.

- Ability to work independently and as part of a team.

- Strong organizational and time management skills.


Preferred Skills:

- Experience with digital marketing and lead generation techniques.

- Familiarity with data analytics and reporting.

- Knowledge of industry-specific sales strategies.


Why Join Us:

- Opportunity to work with a dynamic and innovative team.

- Competitive salary and benefits package.

- Professional development and growth opportunities.

- Engaging and collaborative work environment.


Codebrahma is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Read more
Chronic Diseases Management Startup|GGN
Chronic Diseases Management Startup|GGN
Agency job
via Unnati by Sarika Tamhane
NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹6L - ₹7L / yr
Business Development
Sales
Key account management
Pharmacy
pharma sales
Join one of the most advanced healthcare startups, which is led by professionals and startup experts from various sectors.
 
Our client is a very innovative digital healthcare start-up, who specialises in chronic healthcare with proven improvements in patient parameters through coaching coupled with patient data based interventions.Their core focus is to use smart technology to create sustainability, traceability and improvement in the healthcare sector. They have brought valuable information relating to the healthcare sector at your fingertips, so that you as a customer, can make an informed decision.
 
The company has been founded by a group of highly experienced professionals from IIT, IIM and ISB with a background in strategy, consulting and healthcare technology. The members come with extensive experience working with start-ups in India.
 
As a Business Development Manager, you will sign-up partners across Doctors, Hospitals, Labs, and Corporates for our disease management offering.
 
What you will do:
  • Managing the entire business development cycle from enquiry to closure of the deal.
  • Generating and maintaining a healthy sales pipeline at all points of time.
  • Networking well and developing relationship with key decision makers in the target organizations.
  • Understanding client's requirements from the product standpoint and developing an in-depth understanding of the healthcare eco-system.

 

What you need to have:

  • Existing relationships in the healthcare sector, preferably in NCR/ Gurgaon
  • Past experience in similar roles either with healthcare start-ups such as  Practo, Lybrate, Beato, Wellthy, Meddo, DocPrime, ekincare, Portea,  Pharmeasy, NetMeds, Mfine, Pristyn Care, etc. or with pharma, biotech and surgical devices company will be preferred.
  • Past experience in successfully executing partnerships is a must
  • Fluency in English and Hindi is a must
Read more
Award winners and featured by Apple and Google. (AS1)
Award winners and featured by Apple and Google. (AS1)
Agency job
via Multi Recruit by Sukanya J
Bengaluru (Bangalore)
7 - 8 yrs
₹20L - ₹25L / yr
Automation
Test Automation (QA)
Appium
Selenium
Software Testing (QA)
+3 more
  • Create, maintain, and execute automated test cases for APIs and web services
  • Discover, analyze, and document defects in our Jira system
  • Create and maintain automation frameworks using Object Oriented concepts and basic design patterns
  • Create, maintain, and execute test scripts, analyze and communicate test results using Appium and Selenium
  • Create API and web services automated tests using Java, Postman, SOAP UI, Jmeter, REST assured, or similar tools
  • Mentor QA resources in test automation
  • Provide the Team Lead with effort estimates and progress reports


Requirements

  • Minimum 7 years of experience with backend automation with technologies like RESTful APIs, Web Services Java, Postman, SOAP UI, Jmeter, REST assured
  • Minimum 7 years of experience with Java and Core Java
  • Minimum 7 years of experience in QA
  • Experience with tools such as Appium, Selenium, and/or XCUI test
  • Experience using Git and CI tools such as Jenkins
  • Experience with mobile app testing on iOS and Android
  • Experience with testing web apps/websites
  • Great communication skills
  • Ability to contribute to improving QA best practices

 

Currently, we are looking for the below positions:

  • Mobile QA automation engineers
  • Expertise in Selenium, Appium, API testing
  • Java language is preferred
  • Would be expected to do manual testing as part of their role

 

 

Read more
Aryston Web Solution
at Aryston Web Solution
2 recruiters
raheel ahmed
Posted by raheel ahmed
Kolkata
0 - 4 yrs
₹1.4L - ₹2.4L / yr
Sales
Inside Sales
B2B Marketing
website process
cce
+5 more
We are hiring for Website Selling process- International BPO.

Designation: Process associate/ Snr. Process Associate/ CCE/ Web consultant/ website sales executive.
Process: Outbound voice (Website Selling)

Shift: US Shift (Night)/ UK, Australia shift(Morning)

• Candidate should have good presentation, customer service and convincing skills.

• Experienced web consultant preferred(Prior experience in International website campaign)

• Freshers can also apply.

• Fluent in English.

• Excellent conversational and customer service skills.

• Candidate will be responsible for handling outbound calls.

Thank you,
Aryston web solution.
Read more
Tosh Innovations
at Tosh Innovations
1 recruiter
Swati Singh
Posted by Swati Singh
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹3L - ₹7L / yr
Cryptography
Blockchain
Algorithms
Architecture
We are looking for a developer with good programming skills along with clear understanding of blockchain and its ecosystem. You should have proven working experience in cryptography space. Skills And Qualifications • Engineering background preferably with computer science and security as specialisation. • Knowledge of Blockchain architecture • Understanding of algorithms, data structures • experience in cryptography space • Knowledge of Bitcoin, Ethereum, EOS and other major blockchain ecosystems
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos