Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Cognida
at Cognida
2 candid answers
Keshav Kumar
Posted by Keshav Kumar
Hyderabad
6 - 12 yrs
₹12L - ₹20L / yr
Workato
iPaaS

About Cognida.ai


Our Purpose is to boost your competitive advantage using AI and Analytics.

We Deliver tangible business impact with data-driven insights powered by AI. Drive revenue growth, increase profitability and improve operational efficiencies.

We Are technologists with keen business acumen - Forever curious, always on the front lines of technological advancements. Applying our latest learnings, and tools to solve your everyday business challenges.

We Believe the power of AI should not be the exclusive preserve of the few. Every business, regardless of its size or sector deserves the opportunity to harness the power of AI to make better decisions and drive business value.

We See a world where our AI and Analytics solutions democratise decision intelligence for all businesses. With Cognida.ai, our motto is ‘No enterprise left behind’.


Qualifications 

Bachelor's degree in BE/B. Tech /MCA

6+ years of experience

 

Position: Integration Engineer

Location: Hyderabad, India


Job Description

  • Strong hands-on experience building and managing integrations using Workato along with any (similar iPaaS platforms such as Boomi or MuleSoft)
  • Solid understanding of API-based integrations, data flows, and automation workflows
  • Ability to triage and resolve connectivity issues with external and third-party SaaS systems (e.g Salesforce, Sharepoint, NetSuite)
  • Ability to work collaboratively with our Implementation and Product teams to design, test, and deploy integrations


Read more
OTT software solutions
Chennai
4 - 5 yrs
₹10L - ₹12L / yr
skill iconReact.js
skill iconRedux/Flux
TypeScript
skill iconJavascript
skill iconHTML/CSS

🔍 𝐑𝐨𝐥𝐞: Full-Stack Developer

📍 𝐋𝐨𝐜𝐚𝐭𝐢𝐨𝐧: Chennai

💼 𝐄𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞 𝐋𝐞𝐯𝐞𝐥: 3 to 5 years


𝐀𝐛𝐨𝐮𝐭 𝐭𝐡𝐞 𝐑𝐨𝐥𝐞:

As a Full-Stack Developer at ClubSpot, you will:

🔧 Develop and maintain scalable backend systems using Node.js and PostgreSQL.

🌐 Build and optimize frontend components with React and TypeScript.

📡 Design, develop, and maintain APIs (GraphQL and REST) for efficient data communication.

🤝 Collaborate with cross-functional teams to ideate, design, and deliver new features.

💬 Participate in technical discussions and contribute to architectural decisions.

🧹 Write clean, scalable, and maintainable code adhering to best practices.

🛠️ Troubleshoot, debug, and optimize the platform for performance and scalability.

📚 Contribute to team growth through collaborative programming, code reviews, and knowledge sharing.


𝐐𝐮𝐚𝐥𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧𝐬:

🎓 At least 3 years of experience as a Full-Stack Developer, with strong backend and frontend expertise.

🔧 Proficiency in Node.js, TypeScript, and React for frontend development.

🗃️ Experience with relational databases like PostgreSQL.

📡 Solid knowledge of API development (GraphQL and REST).

☁️ Familiarity with cloud platforms, preferably AWS.

🔄 Strong understanding of system architecture and best practices in software development.

🧠 Exceptional problem-solving and communication skills, both technical and non-technical.

🐳 Knowledge of containerization technologies (Docker, Kubernetes).


𝐖𝐡𝐲 𝐉𝐨𝐢𝐧 𝐔𝐬?

- Work in a collaborative, transparent environment.

- Learn and grow with cutting-edge technologies.

- Make a significant impact on a product transforming sports club management.


Read more
VC funded startup-India's largest cashback platform
VC funded startup-India's largest cashback platform
Agency job
via Qrata by Rayal Rajan
Chennai
5 - 9 yrs
₹10L - ₹40L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
API
+6 more

Location: Chennai

Ideal Candidates for this Role should have:

 

  • Minimum 5 years experience in testing.
  • The candidate should have strong experience in Rest Assured, API Testing and Java.
  • Proficiency in API testing tools like Postman
  • Good knowledge in automation testing using Selenium WebDriver with Java.
  • The candidate should be able to write a program to retrieve/parse the Json
  • Good understanding of REST API types (GET, PUT, POST, DELETE) and its working.
  • Good understanding of HTTP, JSON protocol and syntax
  • Good knowledge in automation testing using Selenium WebDriver with Java.
    Be able to work as an individual contributor and be an Expert at writing automated scripts and be 100% hands-on
    Should have automated 1000s of Test cases at various complexity levels and workflows
  • Design, implementation, and delivery of scalable, maintainable, configurable and robust test automation frameworks.
  • Ability to analyze and translate requirements and development stories into test scripts to ensure complete test coverage.
  • Should have strong knowledge of continuous integration tools like Hudson and Jenkins.
  • Strong understanding of testing and automation best practices.
  • Proven experience in functional, regression and cross-browser testing.
  • Willingness to learn new technologies, approaches and test tools
Read more
MyOperator - VoiceTree Technologies
at MyOperator - VoiceTree Technologies
1 video
2 recruiters
Vipra Mishra
Posted by Vipra Mishra
Remote only
3 - 7 yrs
₹7L - ₹13L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconMongoDB
+1 more
MyOperator is a leading Software as a Service (SaaS) for managing cloud communication. 

 

The team will build our next generation cloud telephony platform and provide our customers with new ways to deliver communication experiences to their audiences. This is an exciting and meaningful opportunity both from a technical and career opportunities perspective.

 

Our Stack - ReactJS, Node, Python, PHP, MongoDB, Redis, MySQL, Elasticsearch, RabbitMQ, Git, Docker, Nginx, 

 

Responsibilities:

  • Writing reusable, testable, and efficient code
  • Design and implement high performance applications. 
  • End to end responsibility from development to production.
  • Work with product and design teams to translate designs and wireframes into high quality products.

 

Requirements

  • Minimum 3-6 years of working experience with Node.js,  React, backend and frontend
  • Core understanding of react state management.
  • Knowledge of common JS design patterns.
  • Knowledge of Redux, Webpack, Formik, Thunk and has a working experience on these libraries.
  • Knowledge and experience on REST APIs.
  • Hands-on experience with Jest, Enzyme for TDD.
  • End to end responsibility from development to production.
  • Good written and verbal communication skills.
  • Great at MySQL and query optimization. 

 

Benefits

    • 100% Remote Team
    • 5 days working with flexible working hours
    • We have an amazing design (UI and UX) team so development receives fully researched and designed tasks.
    • Everyone has a voice in the development process.
    • Opportunity to work in a dynamically growing company where what you do has a direct and immediate impact.
 
 
Want hear our CEO? https://www.youtube.com/watch?v=g85J6h8RGCU&;t=157s" target="_blank">https://www.youtube.com/watch?v=g85J6h8RGCU&t=157s
 
Our Product: https://www.youtube.com/watch?v=2uhjcIa5rlE" target="_blank">https://www.youtube.com/watch?v=2uhjcIa5rlE
Read more
Workie Private Limited
Indore
1 - 1.7 yrs
₹1L - ₹1.7L / yr
Effective communication
Client Management
PPT
MS-Excel

Responsibilities:

-Manage and oversee the day-to-day operations of a WORKIE location or multiple locations.

- Ensure the smooth functioning of facilities, services, and amenities provided to members.

- Handle member inquiries and resolve operational issues promptly.

- Collaborate with the community team to create a positive and productive workspace environment.

- Oversee facility maintenance and coordinate with vendors.

- Assist in budget management and cost control.

- Implement operational policies and procedures.

- Maintain high levels of member satisfaction through exceptional service delivery.

- Support and contribute to community-building efforts within the WORKIE space.

Read more
CYK Hospitalities
CYK Hospitalities
Agency job
via Celeckt by Saniya Yadav
Gurugram
1 - 4 yrs
₹2.5L - ₹4L / yr
Graphic Designing
Logo Design
Packaging design
Interaction Design
Adobe Photoshop
+3 more
JOB RESPONSIBILITY AND ACCOUNTABILITY
 Prepare and design concept note by use of Sketches, drawings and illustrations
 Oversee design changes and improvements throughout the development process
 Integrate technical and visual solutions into a design concept
 Understand trends within the scope of the industry they are working in Expected Skill Sets
 Portfolio with design projects that showcase a stunning aesthetic sense
 Responding to the client in a professional manner
 Building a strong relationship with the clients as well as the existing ones
 Reviewing clients' feedback and implementing necessary changes
SKILLS REQUIRED
 Hands on Adobe Photoshop, Illustrator, Aftereffects, premiere pro
 Proficient communication skills, verbal and written
 Ability to handle client relations
 Highly creative mindset with an urge to experiment
 Ensure efficient team working
 Good time management
Read more
Remote only
2 - 15 yrs
$5K - $8K / yr
Facebook Marketing
Digital Marketing

Hello,

I am Prashant, Business Head at Jal Electricals

 

We “Jal Electricals” are famous and leading Supplier, Importer and Distributor with Digital Door Lock product lines, I need a professional Digital Marketing Agent to optimize and run extensive FB ads who know how to create profitable campaigns.

 

The audience and target are developed countries. There are many high-rise apartment buildings where it is easiest for us to bring this Digital Door Lock product closer to them

 

Our daily budget ranges from $500 to $900, and we can spend up to $200,000 per month as this is a large amount that we allocate for a single advertising campaign. Therefore, we need to ensure that the marketer has thoroughly researched the project before starting the implementation.

 

My product needs a marketing campaign to increase sales, so I would like to hire a Facebook advertising company with high expertise and experience in this field.

 

I would like to hire a Digital Marketer with experience in advertising to run Facebook ad campaigns for our business.

 

Read more
Pepper Content
Pepper Content
Agency job
via Qrata by Revathi Satish
Mumbai
5 - 8 yrs
₹18L - ₹30L / yr
skill iconNodeJS (Node.js)
skill iconRedis
MySQL

About-

We are building a global content marketplace that brings companies and content creators together to scale up content creation processes across 50+ content verticals and 150+ industries. Over the past 2.5 years, we’ve worked with companies like India Today, Amazon India, Adobe, Swiggy, Dunzo, Businessworld, Paisabazaar, IndiGo Airlines, Apollo Hospitals, Infoedge, Times Group, Digit, BookMyShow, UpGrad, Yulu, YourStory, and 350+ other brands.

We are creating high-quality remote talent workforces across Content Writers, Graphic Designers, Video Makers, Content Strategists, Audio Artists, and eventually aim to cover each and every creative professional involved in the marketing domain. Imagine us being able to build virtual marketing teams for any company globally, by providing them a product that solves for content operations and gives the customer the ability to strategize, create, distribute and manage all their content projects at one place. At the same time, they have the ability to be able to extend their team by being matched with high-quality creators from our talent marketplace for different projects that they have. It isn’t long before content becomes so fundamental to individuals and brands alike, that there is a need for buying and selling content on-demand. We want to be that force of change!


Responsibilities: -

  • We are looking for solid senior back-end developers who are well-versed with NodeJs.
  • The tech stack on the back end side - MySQL, Postgres, Redis, Node, TypeScript, Express, Knex.
  • We are looking at folks who have a minimum of 6-7 years of experience in back-end development and have been strong experience.
  • The mindset is very different and we are looking for folks who have evolved fast in terms of skills and in terms of working on their own projects.
Read more
Nickelfox
at Nickelfox
1 recruiter
Jyoti Pandey
Posted by Jyoti Pandey
Noida, NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹2L - ₹3L / yr
Human Resources (HR)
Recruitment
Recruitment/Talent Acquisition
Performance Evaluation
Training and Development
+3 more
  • Write and post technical job descriptions
  • Source potential candidates on niche platforms
  • Parse specialized skills and qualifications to screen resumes
  • Proven work experience as a Technical Recruiter
  • Hands-on experience with various interview formats (e.g. phone, Skype and structured)
  • Technical expertise with an ability to understand and explain job requirements for IT roles
  • Familiarity with Applicant Tracking Systems and resume databases
  • Solid knowledge of sourcing techniques (e.g. social media recruiting and Boolean search)
  • Excellent verbal and written communication skills
  • Solid understanding of HR practices and labor legislation
  •  
Read more
Zero1
at Zero1
2 recruiters
Bhawna Khushlani
Posted by Bhawna Khushlani
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹3L - ₹3L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconjQuery
skill iconBootstrap
Responsive Design
+2 more
Zero1 Inc is looking for a full-time Web Designer who is able to create an amazing user experience and be able to translate the requirements into beautiful and functional design.   Responsibilities:  ●     Create original ideas that bring user-friendliness. ●     Working with different content management systems(including but not limited to Wordpress). ●      Developing and maintaining various modules of our in-house company dashboard.  Requirements: ●     0.6-2 years of previous experience as a web designer. ●     Excellent visual design capability. ●     Have up to date knowledge about the latest technologies and techniques. ●     Combination of skills in HTML5, CSS3, Bootstrap, JQuery and Responsive design. ●     Proficiency in Graphic Design and Photoshop. ●     Ability to customize WordPress themes. ●     Excellent visual design skills with sensitivity to user-system interaction. ●     Excited to learn new technologies. ●   Self-motivated, able to contribute to product requirements - and then design, code, debug and test independently.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos