Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

AerTrip India Limited
at AerTrip India Limited
1 recruiter
Aertrip HR
Posted by Aertrip HR
Ghitorni, Delhi
1 - 5 yrs
₹7L - ₹15L / yr
Document processing

Job Title: Visa Executive

Location: Ghitorni, New Delhi

Company: Aertrip.com

About Aertrip:

Aertrip is a fast-growing travel technology company revolutionizing how people plan, book, and experience travel. We simplify complex travel logistics with innovative platforms for flights, hotels, holidays, and visa services. We are seeking an experienced Visa Executive to manage US, UK, Schengen, and Dubai visa applications with expertise and accuracy.

Key Responsibilities:

  • Handle complete visa process for US, UK, Schengen, and Dubai.
  • Guide clients on visa requirements, supporting documents, and timelines.
  • Review and verify documents before submission.
  • Coordinate with embassies, consulates, and visa centers for updates.
  • Stay updated with visa policies and regulations.
  • Maintain proper client records and ensure timely follow-ups.
  • Assist with travel insurance, form filling, and appointment scheduling.

Requirements:

  • 2–4 years of experience in handling US, UK, Schengen, and Dubai visa applications.
  • Strong knowledge of visa documentation and embassy guidelines.
  • Excellent communication & interpersonal skills.
  • Attention to detail and ability to manage multiple applications.
  • Proficiency in MS Office and email correspondence.

Why Join Aertrip?

  • Competitive salary package.
  • Career growth opportunities in a leading travel tech company.
  • Supportive and dynamic work culture.


Read more
Digicorp Information Systems Pvt. Ltd.
Ahmedabad
4 - 6 yrs
₹7L - ₹14L / yr
ASP.NET MVC
SQL server

We are looking for a passionate ASP.NET MVC Developer with 4–5 years of hands-on experience in building scalable web applications. The ideal candidate should have strong expertise in ASP.NET MVCSQL Server, and .NET Core, along with a problem-solving mindset and the ability to work in a collaborative, fast-paced environment.


What we are looking for:


  • 4–5 years of hands-on experience in ASP.NET MVCSQL Server, and .NET Core.
  • Strong understanding of object-oriented programming (OOP) concepts.
  • Good knowledge of SQL queries, stored procedures, and database design.
  • Experience in RESTful APIs and web services.
  • Familiar with HTML, CSS, JavaScript, and jQuery.
  • Experience with Git or other version control systems.
  • Good communication and problem-solving skills.


What will you do at Digicorp ?


  • Develop and maintain web applications using ASP.NET MVC and .NET Core.
  • Write clean, efficient, and reusable code.
  • Work on database design, development, and optimization in SQL Server.
  • Collaborate with the team to deliver quality software solutions.
  • Participate in code reviews and improve application performance.
  • Fix bugs and resolve technical issues.
  • Learn and adapt to new technologies as needed.


Read more
Vdart
Iyngaran Chandrasekaran
Posted by Iyngaran Chandrasekaran
Tiruchirappalli
3 - 5 yrs
₹4L - ₹4.5L / yr
1099
Technical Recruiting
H1B
C2C
W2
+4 more

US IT Recruiter

Location: Trichy, Tamil Nadu (Onsite)

Company: VDart Inc.

Experience: 3 – 5 Years

Employment Type: Full-Time


About VDart Inc.

VDart Inc. is a global IT staffing and solutions company with a strong presence in the United States and India. We partner with Fortune 500 clients and deliver talent across various domains and emerging technologies. We’re currently expanding our recruitment team and are looking for experienced US IT Recruiters to join our Trichy office.

 

Key Responsibilities

·      Manage the complete recruitment life cycle for contract, contract-to-hire, and permanent roles in the US IT space.

·      Source candidates from job portals (Dice, Monster, CareerBuilder), LinkedIn, internal databases, and references.

·      Screen and qualify candidates based on job requirements, technical skills, and cultural fit.

·      Coordinate interviews, negotiate pay rates, and close offers with candidates.

·      Work with Account Managers to understand client requirements and deliver within deadlines.

·      Maintain ATS records, update candidate pipeline, and ensure compliance with recruitment standards.

 

Required Skills & Experience

·      3 to 5 years of proven experience in US IT Recruitment.

·      Strong knowledge of W2, C2C, and 1099 hiring models.

·      Hands-on experience with sourcing tools like Dice, Monster, and LinkedIn Recruiter.

·      Familiarity with VMS portals such as Beeline, Fieldglass, IQNavigator is a plus.

·      Excellent communication, negotiation, and interpersonal skills.

·      Willingness to work in a fast-paced, result-driven environment at our Trichy office.

Read more
Reqroots
at Reqroots
7 recruiters
Dhanalakshmi D
Posted by Dhanalakshmi D
Bangalore
4 - 7 yrs
₹8L - ₹15L / yr
skill icon.NET
ASP.NET
skill iconC#
Web API

We are looking for "Sr.Software Engineer (API)" for Reputed Client @ Bangalore Permanent Role.

Experience: 5 - 7 Yrs

1.Roles & Responsibilities:

• Design, develop, and unit test applications in accordance with established standards.  

• Preparing reports, manuals and other documentation on the status, operation and maintenance of software.  

• Analyzing and resolving technical and application problems  

• Adhering to high-quality development principles while delivering solutions on-time and on-budget  

• Providing third-level support to business users.  

• Compliance of process and quality management standards  

• Understanding and implementation of SDLC process

2.Technical Skills:

Primary Skills

• 2+ years of experience in Web API, C#.Net, OOPS and Entity framework

• Minimum 1+ years of experience on Web Application development HTML, CSS, JavaScript/JQuery, Entity framework and Linq Queries

• Must have a good exposure on query writing and DB management for writing stored procedures/ user-defined functions

Secondary Skills

• Experience in analysing existing code and debugging.

• Should have a solid understanding of the SDLC processes (Design, Construction, Testing, Deployment)

• Proven experience of delivering on-time and with quality

• Should have good unit testing skills to review his own development and identify all the defects and get it fixed before releasing the code

Desired Skills

• Should have experience in developing ERP applications or Database Intensive Data Entry applications. 

• Been on a same role for a period of 2 years or more

• Hands on experience of configuration management and version maintenance

• Prior experience of working in the shipping domain

• Should be able to understand the Functional Specifications and Technical Specifications and develop the application as per the specification provided.

• Full stack developers with experience in Developing products with Angular and C# APIs, from ground-up will be a plus.

3.Abilty:

• Excellent Communication Skills

• Good conceptualization skills

• Strong Visualization ability

• Analytical ability

• Quality Oriented

• Problem solving

4.Educational Qualification:

BE/B-Tech/MCA/ M.Tech

Read more
Bansal Fine Foods Pvt Ltd
Karnal
2 - 5 yrs
₹2L - ₹4L / yr
Shipping
Logistics
Logistics management
Issue tracking

Job description

1.Responsible for making sure supplies, stock, materials, packages, and/or products are processed through the delivery and/or warehouse system efficiently and safely.
2.Achieve high levels of customer satisfaction through excellence in receiving, identifying, dispatching and assuring quality of goods 2. Organize and Plan Inventory storage area. Co-ordinate, Maintain and monitor the receipt and dispatch of goods.
3. Ensure orders are processed efficiently and that the delivery of materials meets customers timescales/requirements.
4.Communicate with suppliers, retailers, customers etc. to achieve profitable deals and mutual satisfaction.
5.Supervise and control order picking, goods in, goods out operations to ensure accuracy with minimum handling and stock damage.
6.Plan and track the shipment of final products according to customer requirements.
7.Keep logs and records of warehouse stock, executed orders etc.

Rolehttps://www.naukri.com/logistics-executive-jobs">Logistics Executive

Industry Typehttps://www.naukri.com/fmcg-jobs">FMCG

Functional Areahttps://www.naukri.com/procurement-supply-chain-jobs">Procurement & Supply Chain

Read more
Intricare Technologies
at Intricare Technologies
3 recruiters
Khushboo Shah
Posted by Khushboo Shah
Vadodara
1 - 3 yrs
₹2L - ₹7L / yr
Unity 3D
Game development
Gaming
Game Design

We are hiring Unity Developers, who will be responsible for planning and implementing game functionality, building the game code, identifying bottlenecks, and ensuring the quality of the finished product. You may also be required to build patches and install game updates.

To ensure success as a Unity Developer, you should have extensive experience working with Unity and Unity3D software, excellent coding skills, and a good eye for detail. A top-class Unity Developer can visualize, design, and code games that speak directly to the target audience.

Unity Developer Responsibilities:

  • Meeting with the design team to discuss gaming ideas and specifications.
  • Establishing strategy and development pipelines.
  • Planning and implementing game functionality.
  • Transforming design ideas into functional games.
  • Designing and building game codes.
  • Identifying and fixing code errors and game bottlenecks.
  • Testing game functionality and theme dynamics.
  • Ensuring products conform to high industry standards.
  • Designing and building game patches and upgrades.

Unity Developer Requirements:

  • Bachelor’s degree in Computer Science, Computer Engineering or a similar field.
  • Previous experience working as a Unity or Unity3D Developer.
  • In-depth knowledge of Unity and Unity3D software.
  • Knowledge of 3D development and integrated game physics.
  • Experience with console and mobile game development.
  • Good communication skills.
  • Experience with memory and space optimization.
  • Knowledge of scripting, animation, session management, and textures.
  • Good troubleshooting skills.
  • Excellent attention to detail.

Kindly visit our website : www.intricaretech.com
Read more
This opening is with an MNC
This opening is with an MNC
Agency job
via LK Consultants by Namita Agate
Ahmedabad
3 - 9 yrs
₹2L - ₹4L / yr
Office administration
Administrative support

Coordinate office activities and operations to secure efficiency and compliance to company policies


Supervise administrative staff and divide responsibilities to ensure performance


Manage agendas / travel arrangements / appointments etc. for the upper management


Manage phone calls and correspondence (e-mail, letters, packages etc.)


Support budgeting and bookkeeping procedures


Create and update records and databases with personnel, financial and other data


Track stocks of office supplies and place orders when necessary


Submit timely reports and prepare presentations / proposals as assigned


Assist colleagues whenever necessary


Requirements and skills


Proven experience as an office administrator, office assistant or relevant role


Outstanding communication and interpersonal abilities


Excellent organizational and leadership skills


Familiarity with office management procedures and basic accounting principles


Excellent knowledge of MS Office and office

Read more
Genius Placement Service
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
1 - 3 yrs
₹2L - ₹5L / yr
Shopify
skill iconPHP
skill iconHTML/CSS
Wordpress

We are hiring Shopify Developer.

Experience - 1-3 years

Location - Ahmedabad. 

5 Days working 

Required Skills:

• Strong knowledge of liquid programming language.
• Generate custom – tailored Shopify theme and altering pre – existing template.
• Act as Shopify expert, specializing in all facets of the ecommerce platform.
• Clear concept of HTML5,CSS3,javascript/jQuery.
• Knowledge in other ecommerce platform like Magento, woo commerce, Big Commerce will be preferred.
• Experience in Shopify theme development and customization.
• working with different Shopify JS APIs will be added advantage(storefront, AJAX Cart, Sections etc).
• Proficiency in Webhooks, HTML5, CSS3 and JavaScript/ECMA Script 5/6.
• Good Knowledge of SCSS. 
• Hands on experience in installing & customizing new Shopify theme and experience in Shopify custom app development would be added advantage

Read more
Nisum Technologies
at Nisum Technologies
8 recruiters
SaiRaj Perabathula
Posted by SaiRaj Perabathula
Remote, Hyderabad
5 - 14 yrs
₹10L - ₹25L / yr
sterling
IBM Sterling oms
IBM Sterling Commerce
skill iconJava
RESTful APIs
+1 more

What You’ll Do

  • Experience working in eCommerce industry managing high volume applications with an experience of 7 yrs or more. 
  • Expertise in application development with IBM (Sterling) Order Management Fulfillment Suite with a minimum of 4 to 5 yrs of experience. 
  • Implementation Experience in Sterling order management with versions greater than 9.0 is preferred. Experience in XML, XSD, SOAP and REST services. 
  • Expertise in at least one application server; Websphere MQ or JBoss or Weblogic.
  • Subject matter expertise in building large-scale retail B2C web applications using Supply Chain and Logistics Systems. 
  • IBM Sterling Order Management System Configuration Deployment Toolkit (Sterling CDT), Global Inventory Visibility. Caching technologies is a plus. 
  • Comprehensive SDLC experience including strong design skills use of UML, patterns. 
  • Agile and waterfall implementation principles and practices. 
  • Use of version control management such of SVN, CVS, or GIT. 
  • Production environment deployment and maintenance. 
  • Provide support in troubleshooting / investigations pertaining to the order management systems. 
  • Respond quickly to critical requests. 
  • Ability to analyze and design data model. Solid hands-on understanding of DB for the Web environment. 
  • Performance tuning and optimization for scalability and high availability. 
  • Upgrading experience on IBM Sterling Order Management System to 9.3 or higher is a plus.
  • Experience working on Omni Channel Implementations with IBM Sterling OMS is a plus. 
  • Exposure towards Cassandra is a plus.  


What You Know

  • Set your ECommerce skill set to work, helping to execute business requirements into specific systems, applications, or processes in business-to-consumer (B2C) environments. 
  • Showcase your in-depth technical knowledge and functional knowledge in IBM Sterling OMS building confidence at client place. 
  • Train and guide new team members on Sterling technical and business concepts. 
  • Able to support in design or POC s to solve business problems in IBM Sterling OMS for new client initiatives. 
  • Should be excited to work on projects that require both Sterling and Java/J2ee. 
  • Build services around Sterling using Java, Rest and SOAP web services. Should be very strong in core Java.
  • Should be having fair idea in building unit tests around the code implemented.
  • Knowledge on continuous integration is needed.
  • You will also ensure that the organization's implementations meet the scalability and reliability required for eCommerce operation, as well as analyze and optimize database and core commerce functions for maximum performance.


Education

  • Bachelor’s / Master’s degree in specific technical fields like computer science, math, statistics preferred; or equivalent practical experience
Read more
Technogen India PvtLtd
at Technogen India PvtLtd
4 recruiters
Karunakar Chilamakuri
Posted by Karunakar Chilamakuri
Bengaluru (Bangalore)
9 - 14 yrs
₹5L - ₹20L / yr
Sensors and Fuel Management Systems
Power & Energy
Aerospace & Defense
Process
Analytical & Research
+3 more
Job Description: The SFMS BU is looking for a person with aerospace domain experience based out of our Bangalore office, reporting to the India R&D Engineering Manager MPS. The candidate will perform all activities related to the aerospace software Development life cycle for the SFMS BU. The candidate will play an important role in development of software for products as an independent lead engineer and must be able to work in an aggressive fast-paced flexible engineering environment. In addition to this, the candidate will have to interface with customers and program managers of the Business unit as per project needs for giving updates of Status and project deliverables. The person will be responsible for the certification of Software and SOI audit that will be conducted by the customer. This is a challenging role in a fast growing Engineering Organization where there will be a significant learning opportunities for the right individual.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos