Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

a digital first, multi-brand consumer goods company
a digital first, multi-brand consumer goods company
Agency job
via Qrata by Prajakta Kulkarni
Mumbai
4 - 10 yrs
₹15L - ₹35L / yr
skill iconReact.js
skill iconNodeJS (Node.js)
Team Management
skill iconReact Native
About

We are a digital first, multi-brand consumer goods company owned and operated under one house, with each of its brands working together toward one mission: To help Indians lead more fulfilling lives surrounded by wellness and grace.

The founders of Mosaic, Revant and Dhyanesh have more than a decade of experience building, advising and investing in consumer brands. This has allowed them to understand the Indian consumer in a level of detail about their health, habits, and more.

The business is creating a family of purposeful brands with products that solve a particular
problem for a small segment of people. Each brand provides the essentials to make an individual segment of people lead a graceful life full of purpose and wellbeing. Each brand offers high quality, responsibly-made products that are inviting and easy to use, paired with access to ongoing guidance and support.

Role

As the lead for the frontend development team, you will be the sole owner of the
entire FE development cycle for our consumer facing web products in ReactJS. Also, you will be responsible for shaping up the entire system for scale and collaborating intensively with the backend and design teams to create the best consumer experiences. You would also need to control the mobile app development lifecycle on ReactNative.

Responsibilities

- Overlook development of all user-facing products in React
- Build reusable components and front-end libraries for future use
- Translate designs and wireframes into high quality code
- Optimize components for maximum performance across a vast array of web-capable devices and browsers
- Focus on code maintainability and performance of application
- Provide technical advice and assists in solving programming problems
- Use Server Side Rendering when applicable
- Enhance SEO, Analytics and overall frontend architecture for better performance

Requirements

- 4+ years ​of experience building frontend for ​consumer facing​ products
- 2+ years​ on ​ReactJS ​for consumer facing products
- 1+ years ​of ​Team Lead/Management ​experience
- Thorough understanding of ​architecting​ the frontend system with ​Server Side Rendering
- Good foundation in design and a knack for designing interactions and elegant interfaces
- Has led a ​mobile development ​effort on ​ReactNative
- Understands ​app development cycle
- Experience with ​NodeJS​ for Server Side Rendering/coordinating with the backend team for API requirements
- Must come up with caching solutions where required to speed up the website load speed and improve customer experience
Read more
P99soft
sravani chiruvolu
Posted by sravani chiruvolu
Hyderabad
5 - 10 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices

Position: Sr. Java Developer

Qualification: BE, B. Tech, MCA, M. Tech

Experience: 6+ Years

Skills:

Java 8+, Microservices, Spring Boot, Nosql, Kubernetes, AWS, REST

Job Role and Responsibilities:

  • Bachelor’s degree in Computer Science or equivalent
  • Min 6 years of development experience in Spring Boot & Microservices architecture
  • Working experience with Java, Spring Boot, Hibernate, MySQL, Spring Data JPA, AWS, Spring Cloud, Maven, GitHub, Swagger, Eureka, Zuul etc.
  • Strong understanding of API Security for Microservices (Spring Security, OAuth 2.0, JWT)
  • Strong understanding of web development cycle and programming techniques and tools
  • Ability to work independently or with group


  • Strong understanding of modern development methodologies and best industry standards
  • Experience working with APIs, RESTful APIs & Microservices
  • Experience building highly scalable applications using Redis, Kafka, Akka, gRPC
  • Mentor, Train 3-4 engineers 
  • AWS knowledge is a plus
  • Strong knowledge on SQL and NoSQL Databases
  • Should have worked on developing large scale products and services
  • Knowledge on Agile processes is a must
  • Able to work with multiple distributed teams


Read more
Cognologix Technologies
at Cognologix Technologies
14 recruiters
Priyal Wagh
Posted by Priyal Wagh
Remote, Pune
4 - 9 yrs
₹10L - ₹30L / yr
Spark
Hadoop
Big Data
Data engineering
PySpark
+1 more

You will work on: 

 

We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications. You will work on cutting-edge cloud-native technologies to crunch terabytes of data into meaningful insights. 

 

What you will do (Responsibilities):

 

Collaborate with product management & engineering to build highly efficient data pipelines. 

You will be responsible for:

 

  • Dealing with large customer data and building highly efficient pipelines
  • Building insights dashboards
  • Troubleshooting data loss, data inconsistency, and other data-related issues
  • Product development environment delivering stories in a scaled agile delivery methodology.

 

What you bring (Skills):

 

5+ years of experience in hands-on data engineering & large-scale distributed applications

 

  • Extensive experience in object-oriented programming languages such as Java or Scala
  • Extensive experience in RDBMS such as MySQL, Oracle, SQLServer, etc.
  • Experience in functional programming languages such as JavaScript, Scala, or Python
  • Experience in developing and deploying applications in Linux OS
  • Experience in big data processing technologies such as Hadoop, Spark, Kafka, Databricks, etc.
  • Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud Platform
  • Experience with Scrum and/or other Agile development processes
  • Strong analytical and problem-solving skills

 

Great if you know (Skills):

 

  • Some exposure to containerization technologies such as Docker, Kubernetes, or Amazon ECS/EKS
  • Some exposure to microservices frameworks such as Spring Boot, Eclipse Vert.x, etc.
  • Some exposure to NoSQL data stores such as Couchbase, Solr, etc.
  • Some exposure to Perl, or shell scripting.
  • Ability to lead R&D and POC efforts
  • Ability to learn new technologies on his/her own
  • Team player with self-drive to work independently
  • Strong communication and interpersonal skills

Advantage Cognologix:

  •  A higher degree of autonomy, startup culture & small teams
  •  Opportunities to become an expert in emerging technologies
  •  Remote working options for the right maturity level
  •  Competitive salary & family benefits
  •  Performance-based career advancement


About Cognologix: 

 

Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup. We are at the forefront of digital disruption and take a business-first approach to help meet our client’s strategic goals.

We are a Data focused organization helping our clients to deliver their next generation of products in the most efficient, modern, and cloud-native way.

Benefits Working With Us:

  • Health & Wellbeing
  • Learn & Grow
  • Evangelize 
  • Celebrate Achievements
  • Financial Wellbeing
  • Medical and Accidental cover.
  • Flexible Working Hours.
  • Sports Club & much more.
Read more
Hitbullseye
at Hitbullseye
1 recruiter
Simran Kaur
Posted by Simran Kaur
Yamunanagar
1 - 3 yrs
₹3L - ₹4.5L / yr
Teaching

Person should be having a minimum teaching experience of 2 years preferably in the same coaching industry. Should be well versed with Grammar Vocab.

QUALIFICATION:

 

  • Education: Bachelor s Degree / Master's degree in a field with relevance to the position.
  • Experience: 1-3 years of teaching experience in CAT / Bank Courses. Excellent academics and good communication skills may also apply.
  • Competencies: Professional Qualities
  • Acceptable level of speaking skills
  • Proficiency in the subject
  • Good class etiquette

Rolehttps://www.naukri.com/subject-specialization-teacher-other-jobs" target="_blank">Subject / Specialization Teacher - Other

Industry Typehttps://www.naukri.com/education-training-jobs" target="_blank">Education / Training

DepartmentTeaching & Training

Employment TypeFull Time, Permanent

Role CategorySubject / Specialization Teacher

Education

UG :Any Graduate

PG :Any Postgraduate

Industry

  • Education Management

Employment Type

Full-time

 
Read more
ZM Technologies
at ZM Technologies
1 recruiter
Ayushee Singh
Posted by Ayushee Singh
Pune
0 - 2 yrs
₹1.8L - ₹3L / yr
Telesales
Lead Generation
Sales
IT consulting
cold calling
Responsible for lead generation, cold calling, telesales
Responsible for selling software and hardware products.
Progress qualified opportunities to quotation and close sales
Order fulfilment, Payment follow up
Customer relationship management

Required Candidate profile

Good English communication required
Six months IT Industry experience is compulsory
MBA graduate fresher can also apply
Read more
Full-Stack Diagnostics Health-Tech
Full-Stack Diagnostics Health-Tech
Agency job
via Unnati by Samta Arora
Delhi, Gurugram, Noida
4 - 7 yrs
₹12L - ₹15L / yr
Business Development

With the ever-growing demand for healthcare services among the ever-increasing population, our client acts as a diagnostic laboratory providing various services such as routine testing, pathology services, radiology and genomic testing. They even provide various healthcare packages such as full body packages, fever packages, heart packages, etc.

 

Headquartered in Noida, our client works as a technology empowered, well-equipped and advanced testing lab, built in line with the globally recognized standards. They have their home sample-collection service in, approx., 120+ cities with 30+ laboratories and 700+ walk-in wellness & collection centres across India.

 

Our client aims for the accessibility of health tests to all Indians through a combination of well-equipped labs, technology and strong radiology network. They are backed by tier 1 VCs and have raised more than $60 million in funding this year.

 

As a Business Development Manager, you will be responsible for dealing and building strategic partnerships with corporates/ PSU and thus contributing towards business development.


What you will do:

  • Creating and managing new and follow-up accounts by mapping, engaging into corporates/ PSUs and focussing on business development
  • Meeting the senior leadership management team of public sector units to understand their professional requirements
  • Maintaining the highest client retention percentage year on year
  • Managing the entire sales cycle of a new corporate/ PSU client from lead qualification to invoicing and maintaining a healthy lead to closure ratio
  • Ensuring that the given sales target is achieved/ exceeded and thus contributing towards the business growth
  • Being updated with the latest changes and product/ service development in the business as well as the current requirements and trends in the market/ industry
  • Educating, updating, promoting, pitching and also clarifying any queries/ concerns of the clients with regards to the products/ services
  • Handling and solving client escalations, if any, in a professional manner and also efficiently on-time
  • Maintaining long-term and professional relationships with the existing as well as new clients
  • Handling and managing all the operational/ documentation processes involved throughout the BD cycle. Also, ensuring compliance of related rules, laws & regulations while doing so
  • Maintaining an updated and accurate record of all the account-related data and reporting the same to the management in regular intervals
  • Working in coordination with various stakeholders such as internal teams and external clients

 

Desired Candidate Profile

What you need to have:

  • Graduation is a must
  • Relevant work experience of 4 plus years in Business Development is required. Experience in dealing with corporate sales/ PSUs is a must
  • Previous work experience in healthcare, diagnostic, dealing with TPAs, healthcare policy is highly preferred
  • Outstanding communication and professional networking skills
  • Excellent presentation, negotiation and interpersonal skills are required    

 

Read more
Infonex Technologies
at Infonex Technologies
1 recruiter
Vinay Ramesh
Posted by Vinay Ramesh
Bengaluru (Bangalore)
4 - 7 yrs
₹6L - ₹30L / yr
Informatica
ETL
SQL
Linux/Unix
Oracle
+1 more
  • Experience implementing large-scale ETL processes using Informatica PowerCenter.
  • Design high-level ETL process and data flow from the source system to target databases.
  • Strong experience with Oracle databases and strong SQL.
  • Develop & unit test Informatica ETL processes for optimal performance utilizing best practices.
  • Performance tune Informatica ETL mappings and report queries.
  • Develop database objects like Stored Procedures, Functions, Packages, and Triggers using SQL and PL/SQL.
  • Hands-on Experience in Unix.
  • Experience in Informatica Cloud (IICS).
  • Work with appropriate leads and review high-level ETL design, source to target data mapping document, and be the point of contact for any ETL-related questions.
  • Good understanding of project life cycle, especially tasks within the ETL phase.
  • Ability to work independently and multi-task to meet critical deadlines in a rapidly changing environment.
  • Excellent communication and presentation skills.
  • Effectively worked on the Onsite and Offshore work model.
Read more
Electric vehicle charging infrastructure solutions. ( SC1)
Electric vehicle charging infrastructure solutions. ( SC1)
Agency job
via Multi Recruit by Ravish E
Bengaluru (Bangalore)
2 - 8 yrs
₹6L - ₹12L / yr
Hardware Design
Hardware
Hardware development
Circuit Design
Analog And Digital Circuits
+6 more
  • Circuit Design (Schematic Entry), Digital, Analog & Power.
  • High-speed PCB Layout Design, up to 8-Layer, routing high current tracks (up to 30A)
  • Experience on “Altium Designer” will be added advantage.
  • Experience with ARM processors & AVR Controllers will be preferred.
  • Preparing Design and test procedure documentation.
  • System integration and Testing.
  • Hardware Troubleshooting.
  • Awareness of PCB Fabrication & assembly Processes.
  • Awareness for component procurement, finding substitutes.
  • Design transfer to production by defining production processes.
  • Assist production for optimizing operations components sourcing, troubleshooting.
  • Interact with PCB Design team.
  • Interact with hardware team/consultants in India, USA
  • Should have leadership qualities for handling a team.
  • Communication with Component manufacturers/vendors for part choices & design support.
  • Preparing documentation for design, for design transfer to production, for submittal to various labs for certifications
  • B.E (Electronics and communication, Instrumentation and Electronics, E.E.E)

 

Read more
HippoCabs
at HippoCabs
3 recruiters
Asha Dayma
Posted by Asha Dayma
Jaipur
1 - 4 yrs
₹3L - ₹6L / yr
skill iconReact Native
skill iconRedux/Flux
skill iconHTML/CSS
Progressive Web Apps (PWA)
Requirements for React Developer : 1. Strong Knowledge of Javascript Ecosystem. 2. Must have knowledge of React, Redux, ES6, CSS, HTML, PWA. 3. 1+ year experience of building websites. 4. Passion for making beautiful, and delightful web experiences 5. Understanding of core CS concepts, such as, common data structures and algorithms 6. Ability to take on complex problems, learn quickly, and persist towards a good solution.
Read more
Optisol Business Solutions Pvt Ltd
Krishnaveni Hemanthkumar
Posted by Krishnaveni Hemanthkumar
Chennai
2 - 4 yrs
₹4L - ₹8L / yr
Hibernate (Java)
Spring
skill iconJava
J2EE
Struts
+3 more
1.Candidates should have experience in design and develop high-volume applications for delivering high-availability and performance. 2.Write Well designed, testable and efficient code. 3.Ensure designs are in compliance with specifications. 4.Prepare and produce releases of software components. 5.Support continuous improvement by investigating alternatives and technologies for the architectural review. 6.Should be highly motivated in both solo and team situations by contributing to a great team spirit. 7.Desire and drive to take an active role in improving the end product 8. should have strong knowledge of client server interaction, good understanding of REST architecture
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos