Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

A domestic client 15 years old, in the logitech industry
A domestic client 15 years old, in the logitech industry
Agency job
via Talent Socio Bizcon LLP by Baishali Dhar
Pune, Mumbai
5 - 9 yrs
₹20L - ₹35L / yr
ASP.NET
skill icon.NET
Microservices
skill iconDocker
skill iconKubernetes

Responsibilities:

  • Work with product owners, managers, and customers to explore requirements and translate use-cases into functional requirements.
  • Collaborate with cross-functional teams and architects to design, develop, test, and deploy web applications using ASP. NETCore | Open-source web framework for. NET, . NET Core, and C#.
  • Build scalable, reliable, clean code and unit tests for. NET applications.
  • Help maintain code quality, organization, and automation by performing code reviews, refactoring, and unit testing.
  • Develop integration with third-party APIs and external applications to deliver robust and scalable applications.
  • Maintain services, enhance, optimize, and upgrade existing systems.
  • Contribute to architectural and design discussions and document design decisions.
  • Effectively participate in planning meetings, retrospectives, daily stand-ups, and other meetings as part of the software development process.
  • Contribute to the continuous improvement of development processes and practices.
  • Resolve production issues, participate in production incident analysis by conducting effective troubleshooting and RCA within the SLA.
  • Work with Operations teams on product deployment, issue resolution, and support.
  • Mentor junior developers and assist in their professional growth. Stay updated with the latest technologies and best practices.


Requirements:

  • 5+ years of experience with proficiency in C# language.
  • Bachelor's or master's degree in computer science or a related field.
  • Good working experience in. NET Framework, . NET Core, and ASP. NETCore | Open-source web framework for. NET and C#.
  • Good understanding of OOP and design patterns - SOLID, Integration, REST, Micro-services, and cloud-native designs.
  • Understanding of fundamental design principles behind building and scaling distributed applications.
  • Knack for writing clean, readable, reusable, and testable C# code.
  • Strong knowledge of data structures and collections in C#.
  • Good knowledge of front-end development languages, including JavaScript, HTML5 and CSS.
  • Experience in designing relational DB schema, PL/SQL queries performance tuning.
  • Experience in working in an Agile environment following Scrum/SAFE methodologies.
  • Knowledge of CI/CD, DevOps, containers, and automation frameworks.
  • Experience in developing and deploying on at least one cloud environment.
  • Excellent problem-solving, communication, and collaboration skills.
  • Ability to work independently and effectively in a fast-paced environment.


Read more
Performance Marketing Agency
Performance Marketing Agency
Agency job
via Merito by Jinita Sumaria
Chennai
5 - 8 yrs
₹10L - ₹12L / yr
Business Development
Client Servicing
Client Management
Influencer Marketing

Role - Senior Account Manager


About Company -


Our Client is a performance marketing agency, that builds bridges between smart machines and people, to work better, smarter and faster. We believe in performance, where we marry creativity with analytics to discover, define and deploy the most engaging stories.


Job Description:-


  • Creating a portfolio of client accounts and monitoring the ongoing activities related to them.
  • Managing, reviewing progress and delivering the client’s advertisement projects.
  • Conducting meetings with the clients as well as informing them about the current work status of their projects.
  • Establishing relationships with new clients and maintaining and nurturing business relationships with existing clients.
  • Identifying accounts whose revenue may be shrinking so as to address any ‘at risk’ customers and reach out to these accounts to ensure they are retained.
  • Monitoring work performance of colleagues and setting sales targets.


Requirement -


  • Experience: 5-7 years into Advertising agency background, Influencer marketing and Social Media. 
  • Skills: Leadership, Business development, Maintaining existing clients Etc.,
Read more
SteelEye
at SteelEye
1 video
3 recruiters
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
1 - 8 yrs
₹10L - ₹40L / yr
skill iconPython
ETL
skill iconJenkins
CI/CD
pandas
+6 more
Roles & Responsibilties
Expectations of the role
This role will be reporting into Technical Lead (Support). You will be expected to resolve bugs in the platform that are identified by Customers and Internal Teams. This role will progress towards SDE-2 in 12-15 months where the developer will be working on solving complex problems around scale and building out new features.
 
What will you do?
  • Fix issues with plugins for our Python-based ETL pipelines
  • Help with automation of standard workflow
  • Deliver Python microservices for provisioning and managing cloud infrastructure
  • Responsible for any refactoring of code
  • Effectively manage challenges associated with handling large volumes of data working to tight deadlines
  • Manage expectations with internal stakeholders and context-switch in a fast-paced environment
  • Thrive in an environment that uses AWS and Elasticsearch extensively
  • Keep abreast of technology and contribute to the engineering strategy
  • Champion best development practices and provide mentorship to others
What are we looking for?
  • First and foremost you are a Python developer, experienced with the Python Data stack
  • You love and care about data
  • Your code is an artistic manifest reflecting how elegant you are in what you do
  • You feel sparks of joy when a new abstraction or pattern arises from your code
  • You support the manifests DRY (Don’t Repeat Yourself) and KISS (Keep It Short and Simple)
  • You are a continuous learner
  • You have a natural willingness to automate tasks
  • You have critical thinking and an eye for detail
  • Excellent ability and experience of working to tight deadlines
  • Sharp analytical and problem-solving skills
  • Strong sense of ownership and accountability for your work and delivery
  • Excellent written and oral communication skills
  • Mature collaboration and mentoring abilities
  • We are keen to know your digital footprint (community talks, blog posts, certifications, courses you have participated in or you are keen to, your personal projects as well as any kind of contributions to the open-source communities if any)
Nice to have:
  • Delivering complex software, ideally in a FinTech setting
  • Experience with CI/CD tools such as Jenkins, CircleCI
  • Experience with code versioning (git / mercurial / subversion)
Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
4 - 8 yrs
₹12L - ₹30L / yr
skill icon.NET
ASP.NET MVC
AJAX
LINQ
Web API
+2 more

NET Profile 

 

DESIRED SKILLS

 

·         Experience in Microsoft technologies (Microsoft Dot Net, C#, http://asp.net/" target="_blank">ASP.NET, MVC, Microsoft SQL, .NET Core, Web API, WCF, Bootstrap, JavaScript, Angular JS, Web API, Web services, Rest API)

 

·         Design a complex architecture landscape involving API integrations.

 

·         Hands-on experience in ASP.Net, C#, MVC, WCF, Restful services, Web API, AngularJS, Entity Framework

 

·         Strong analytical & problem-solving skills

 

·         Must have excellent oral & email communication skills.

 

·         Strong analytical and problem-solving skills

 

·         Must have a positive attitude and a yearning to get things done and demonstrate ownership of deliverables.

 

NICE TO HAVE SKILLS

 

·         Knowledge in Microsoft Azure.

 

·         Good Command on Agile Development & Azure DevOps.

 

·         Knowledge in Angular / React / Node JS

 

·       Mainly they are looking for:

 

C#

http://asp.net/" target="_blank">ASP.NET MVC,

AJAX,

LINQ,

jQuery,

WebApi.

 
 
KINDLY REVERT WITH YOUR UPDATED RESUME
 
THANK YOU 
 
Read more
EnterpriseMinds
at EnterpriseMinds
2 recruiters
Rani Galipalli
Posted by Rani Galipalli
Pune, Mumbai
5 - 8 yrs
₹1L - ₹16L / yr
Communication Skills
Business Analysis
Visio

Job Description:

  • 5-8 years of experience as business analyst preferably with some experience in healthcare domain
  • Experience in capturing/ defining requirements and creating business requirements document/ software requirements specifications
  • Extensive and hands on experience in creating wireframes using tools like Visio etc.
  • Experience in communicating with stakeholders across the board, including clients, business team, and the development team to make sure the goals are clear and the vision is aligned with business objectives
  • Experience as a BA in software development/ implementation projects is a must
  • Experience in creating and prioritizing the list of user stories/ backlog items and prioritize them based on the overall strategy and business objectives
  • Experience in overseeing the development of the product and taking necessary steps to keep the project on track
  • Strong communication skills, documentation skills. Excellent PPT, word and excel skills are a must

 Good to have

  • Have worked with hospitals or outpatient clinics or public sector healthcare entities
  • BA may have to travel for a few weeks Internationally

 

Read more
Myrsa Technology Solutions
Dipali G
Posted by Dipali G
Mumbai
3 - 7 yrs
₹2L - ₹3L / yr
skill iconPHP
MySQL
skill iconJavascript
skill iconjQuery
skill iconHTML/CSS
As our PHP developer, you should be able to visualize our application and understand our business so that you can provide us with an application that supports our goals and business logic.
You would mainly work on two types of applications: web app with a database background, and APIs that provide our existing software and data to mobile apps and other developers. You will design and architect our code and the way it works to support the front end. APIs are often used when developers or apps need to query our internal data, and they allow us to provide this data to the outside world. For instance, our app might pull a list of entries from QuickBooks API. You will read the API documentation and implement it on our website.
You should be able to design a full application from the ground up and ensure that code is efficient and properly written.
Job description
Are you a highly experienced, ambitious PHP Developer looking for a challenging role where you can learn lots more?
We are looking for a motivated PHP Developer to come join our fast-paced, fun and rewarding agile team of professionals.
If you are passionate about technology, constantly seeking to learn and improve skill set, then you are the type of person we are looking for!
We are offering superb career growth opportunities, great compensation, and benefits.
Duties and responsibilities
• Develop, record and maintain cutting-edge web-based PHP applications on portal plus premium service platforms
• Build innovative, state-of-the-art applications and collaborate with the User Experience (UX) team
• Ensure HTML, CSS, and shared JavaScript is valid and consistent across applications
• Prepare and maintain all applications utilizing standard development tools
• Utilize backend data services and contribute to increasing existing data services API
• Lead the entire web application development lifecycle right from concept stage to delivery and post launch support
• Refactor, optimize and improve the existing codebase for maintenance and scale
• Use test-driven development and acceptance tests to ensure feature quality
• Interface with customer and internal teams to gather requirements and develop software solutions
• Convey effectively with all task progress, evaluations, suggestions, schedules along with technical and process issues
• Document the development process, architecture, and standard components
• Coordinate with co-developers and keeps project manager well informed of the status of development effort and serves as a liaison between development staff and project manager
• Keep abreast of new trends and best practices in web development
PHP Developer requirements and qualifications
• Previous working experience as a PHP Developer for 2 years.
• BE/MCA in Computer Science, Engineering or a similar relevant field
• User authentication and authorization between multiple systems, servers, and environments
• Integration of multiple data sources and databases into one system
• Familiarity with limitations of PHP as a platform and its workarounds
• Proficient in PHP, HTML5, JavaScript, JQuery Expert
Read more
Gobillion Services Private Limited
Kulapradip Bharali
Posted by Kulapradip Bharali
Bengaluru (Bangalore)
4 - 7 yrs
₹20L - ₹40L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
SQL
+6 more

About Gobillion

Gobillion is a YCombinator backed IIM-NIT alumni co-founded social commerce startup headquartered in San Francisco, USA with offices in New Delhi, Bangalore and Guwahati. We are bringing e-commerce 2.0 to the next 400 million online customers across India, through a community and social driven approach. Our co-founding has diversified experience with prestigious organizations including McKinsey & Company, Deloitte US, EY, Adobe and SAP Labs.

Gobillion has been rapidly scaling and is backed by some of the world’s most prestigious investors from US, Europe, SE Asia and India including - YCombinator, Justin Mateen (Founder - Tinder), Pioneer Fund, Soma Capital, Venture Souq, Goodwater Capital, LetsVenture, Vikalp Sahni (Co-Founder- Gobibibo) amongst others.

We have been selected for and globally validated by the world’s leading investors/accelerators including YCombinator, Founder Institute Silicon Valley, NASSCOM 10000 Startups - India and Assam Startup. We have been named as the Top 10 Global startup for YCombinator S21 by Alex Mitchell.


Summary of role:
As a Developer, you will be working alongside our product team in the conceptualization, design and development of server side components. You will be doing the following on the job

  • Write clean, manageable code and maintain proper documentation
  • Create, test and deploy and maintain the applications on production servers
  • Continuously discover, analyze, and implement new technologies and frameworks to maximize development efficiency
  • Lead team in crafting solutions in different areas and ensure timely delivery
  • Ensure secure architecture for Servers


Why Join Us?

  • You will have a chance to be a leader and have the responsibility to scale Gobillon across India's most fast growing cities
  • The opportunity to join one of India’s fastest growing companies at an early stage - We are giving our early team members to benefit from a strong ESOP pool and be part of our growth journey
  • Joining an amazing team of Gobillion rockstars from colleges like IIMs, IITs, NITs etc. and from organizations including McKinsey & Company, Deloitte US, EY, Adobe, SAP Labs, Urban Company, Udaan, Amazon, Delivery, Ninjacart, Accenture etc.
  • Wear the Gobillion badge with pride - We are looking for owners with a founder’s mindset - not just employees. If you are passionate about our mission about making e-commerce social for the next 400M customers in India and serve as culture carriers - we are the right place for you!


Key Responsibilities of this Role:

  • Experience with DevOps and writing REST APIs & Micro services architecture
  • Strong programming expertise in Node js, Nest Js
  • Good understanding of Mongo databases and other NoSql Databases and SQL Database
  • Solid hold on Data structures and Algorithm
  • Good understanding of System Design
  • Development expertise in AWS services like Lambda, SQS, SNS
  • Good understanding of DevOps and Server security
  • Exposure to Cloud Platforms like AWS (preferred), Azure or Google Cloud
  • Unix command line experience
  • Well-versed with Software Development Life Cycle
  • Demonstrate the ability to be a self-starter and learn quickly
  • Excellent analytical and problem-solving skills
  • Passion for learning and implementing new technologies
  • Excellent understanding of software Architectures
Read more
Abservetech
at Abservetech
1 video
1 recruiter
Abservetech Private Limited
Posted by Abservetech Private Limited
Madurai, Tirunelveli, Tiruchirappalli, Nagarcoil
2 - 6 yrs
₹5L - ₹8L / yr
skill iconReact.js
skill iconAmazon Web Services (AWS)
skill iconJavascript
skill iconHTML/CSS
Immediately Hiring

2-5 years of experience in React.JS, Redux, Rx.js and Material.UI REQUIRED

Experience using React.js with PostgreSQL.

Experience with HTML5, JavaScript and CSS3, as well as Strong knowledge in advanced HTML5 features such as Web Worker, Caching and Browser storages
etc.

Complete understanding of ReactJS and its main fundamentals like JSX, Virtual DOM, component lifecycle, React hooks etc.

Mobile friendly experience a plus.

Version control experience (GIT,TFS,VSTS, etc).

Experience in integrating web application with APIs.
Read more
US Based MNC
US Based MNC
Agency job
via Kavayah People Consulting by Kavita Singh
Pune
2 - 9 yrs
₹8L - ₹20L / yr
Mendix
Mendix Mobile Development
Bachelor’s Degree in Computer Science or equivalent
·       2 - 8 years’ of industry experience in programming web applications, mobile and/or large scale enterprise products
·       Strong experience on Mendix and knowledge of Mendix Mobile Development using native features
·       Design and Develop integrations with external systems leveraging the REST APIs
·       Worked extensively in Mendix domain modelling, Forms, complex Microflow logic building
·       Good knowledge on installation and configuration of application in Mendix public/private cloud
·       Webpage designing using HTML5, CSS3, Bootstrap, jQuery
·       Extended knowledge with postgre/sql and Git/TFS is required
·       Experience with Agile methodology
·       Skilled at reviewing new feature impact on an application and recognizing potential risks
·       Uses time effectively and efficiently
·       Quickly learns new technologies
·       Detailed oriented, professional and possesses a positive work attitude
·       Communicate professionally both verbally and in writing
·       Effective time management skills
Read more
ConneXTech
at ConneXTech
1 recruiter
Bimlesh Anand
Posted by Bimlesh Anand
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹3L - ₹5L / yr
Digital Marketing
Google Adwords
Web Analytics
Facebook Marketing
Search Engine Optimization (SEO)
+3 more
Undertake digital marketing initiatives and campaigns for captive and third-party client projects. Lead the process from inception to execution.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos