Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Talent Pro
Bengaluru (Bangalore)
4 - 7 yrs
₹30L - ₹35L / yr
Product design
Top Indian eCommerce & Quick-Commerce Companies: Swiggy, AJIO, Zomato, Zepto,...
Mandatory (Experience 1) - Must have a 4+ YOE in...

Strong Product, UI/UX Designer with focus on eCommerce / Quick Commerce

Mandatory (Experience 1) - Must have a 4+ YOE in Product Design, with atleast 2+ years in a early-stage / mid-sized B2C Product startup

Mandatory (Experience 2) - Should have 2+ YOE in an eCommerce / Quick Commerce Company (Past experience considered)

Mandatory (Experience 2) - Expertise in tools like Figma, Sketch, Adobe XD, and others to create high-fidelity wireframes and prototypes

Mandatory (Portfolio) - Strong portfolio of UI + UX Designs (Both needed) for Top B2C eCommerce / Quick Commerce (Including case studies, Wireframing, prototypes, Research etc)

Mandatory (Company) - Good eCommerce / Quick-Commerce Company or Top B2C Fin-Tech Products

Read more
Clickretinacom
at Clickretinacom
2 candid answers
Pooja Yadav
Posted by Pooja Yadav
Remote only
1 - 2 yrs
₹1.8L - ₹2.4L / yr
On-page Optimization
Search Engine Optimization (SEO)

Job Description:

Your responsibilities will include:

  • Conducting comprehensive keyword research to identify target keywords and opportunities for website optimization.
  • Optimizing on-page elements such as meta tags, headings, and content to improve search engine visibility and user experience.
  • Implementing off-page optimization strategies, including link building, content promotion, and outreach efforts.
  • Monitoring website performance using Google Analytics and other SEO tools, and providing regular reports on key metrics and performance indicators.
  • Conducting website audits and identifying technical issues that may impact SEO performance, and collaborating with the development team to implement solutions.
  • Staying updated with industry trends and best practices in SEO, and proactively suggesting new ideas and strategies to improve campaign performance.
  • Collaborating with other members of the digital marketing team to integrate SEO strategies with overall marketing initiatives and campaigns.

We look forward to reviewing your application.

Requirements:

  • Bachelor’s degree in Marketing, Communications, Business, or related field.
  • Proven track record of improving search engine rankings and driving organic traffic to websites.
  • Strong understanding of search engine algorithms and ranking factors.
  • Proficiency in SEO tools such as Google Analytics, Google Search Console, SEMrush, Moz, etc.
  • Excellent analytical skills and ability to interpret data to make informed decisions.
  • Strong communication skills, both written and verbal.
  • Ability to work independently and manage multiple projects simultaneously.
  • Certification in Google Analytics or other relevant certifications is a plus.

Benefits:

  • Competitive salary based on experience and performance.
  • Opportunity to work with a dynamic and talented team in a collaborative environment.
  • Career growth and development opportunities within the company.
  • Access to training and resources to enhance skills and stay updated with industry trends.

Job Types: Full-time, Permanent, Fresher

Education:

  • Bachelor's (Preferred)

Experience:

  • SEO: 1 year (Preferred)
Read more
Conviva
at Conviva
1 recruiter
Anusha Bondada
Posted by Anusha Bondada
Bengaluru (Bangalore)
3 - 15 yrs
₹25L - ₹70L / yr
skill iconScala
Akka
Algorithms
Data Structures
Functional programming
+6 more

Have you streamed a program on Disney+, watched your favorite binge-worthy series on Peacock or cheered your favorite team on during the World Cup from one of the 20 top streaming platforms around the globe? If the answer is yes, you’ve already benefitted from Conviva technology, helping the world’s leading streaming publishers deliver exceptional streaming experiences and grow their businesses. 

 

Conviva is the only global streaming analytics platform for big data that collects, standardizes, and puts trillions of cross-screen, streaming data points in context, in real time. The Conviva platform provides comprehensive, continuous, census-level measurement through real-time, server side sessionization at unprecedented scale. If this sounds important, it is! We measure a global footprint of more than 500 million unique viewers in 180 countries watching 220 billion streams per year across 3 billion applications streaming on devices. With Conviva, customers get a unique level of actionability and scale from continuous streaming measurement insights and benchmarking across every stream, every screen, every second.

 

As Conviva is expanding, we are building products providing deep insights into end user experience for our customers.

 

Platform and TLB Team

The vision for the TLB team is to build data processing software that works on terabytes of streaming data in real time. Engineer the next-gen Spark-like system for in-memory computation of large time-series dataset’s – both Spark-like backend infra and library based programming model. Build horizontally and vertically scalable system that analyses trillions of events per day within sub second latencies. Utilize the latest and greatest of big data technologies to build solutions for use-cases across multiple verticals. Lead technology innovation and advancement that will have big business impact for years to come. Be part of a worldwide team building software using the latest technologies and the best of software development tools and processes.

 

What You’ll Do

This is an individual contributor position. Expectations will be on the below lines:

  • Design, build and maintain the stream processing, and time-series analysis system which is at the heart of Conviva's products
  • Responsible for the architecture of the Conviva platform
  • Build features, enhancements, new services, and bug fixing in Scala and Java on a Jenkins-based pipeline to be deployed as Docker containers on Kubernetes
  • Own the entire lifecycle of your microservice including early specs, design, technology choice, development, unit-testing, integration-testing, documentation, deployment, troubleshooting, enhancements etc.
  • Lead a team to develop a feature or parts of the product
  • Adhere to the Agile model of software development to plan, estimate, and ship per business priority

 

What you need to succeed

  • 9+ years of work experience in software development of data processing products.
  • Engineering degree in software or equivalent from a premier institute.
  • Excellent knowledge of fundamentals of Computer Science like algorithms and data structures. Hands-on with functional programming and know-how of its concepts
  • Excellent programming and debugging skills on the JVM. Proficient in writing code in Scala/Java/Rust/Haskell/Erlang that is reliable, maintainable, secure, and performant
  • Experience with big data technologies like Spark, Flink, Kafka, Druid, HDFS, etc.
  • Deep understanding of distributed systems concepts and scalability challenges including multi-threading, concurrency, sharding, partitioning, etc.
  • Experience/knowledge of Akka/Lagom framework and/or stream processing technologies like RxJava or Project Reactor will be a big plus. Knowledge of design patterns like event-streaming, CQRS and DDD to build large microservice architectures will be a big plus
  • Excellent communication skills. Willingness to work under pressure. Hunger to learn and succeed. Comfortable with ambiguity. Comfortable with complexity

 

Underpinning the Conviva platform is a rich history of innovation. More than 60 patents represent award-winning technologies and standards, including first-of-its kind-innovations like time-state analytics and AI-automated data modeling, that surfaces actionable insights. By understanding real-world human experiences and having the ability to act within seconds of observation, our customers can solve business-critical issues and focus on growing their businesses ahead of the competition. Examples of the brands Conviva has helped fuel streaming growth for include DAZN, Disney+, HBO, Hulu, NBCUniversal, Paramount+, Peacock, Sky, Sling TV, Univision, and Warner Bros Discovery.  

Privately held, Conviva is headquartered in Silicon Valley, California with offices and people around the globe. For more information, visit us at www.conviva.com. Join us to help extend our leadership position in big data streaming analytics to new audiences and markets! 



Read more
GDRB Technologies
Janardhan reddy
Posted by Janardhan reddy
Hyderabad, Kompally
1 - 3 yrs
₹2L - ₹3L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
Model-View-View-Model (MVVM)
skill iconJavascript
+2 more

  1. Proven working experience in Android app development and published at least one original Android app.
  2. 1-3 years of experience in Android using the java language 
    Familiarity with architecture styles/APIs.
  3. Solid understanding of the full mobile development life cycle.
  4. Knowledge of MVVM and other Mobile design patterns and best practices.
  5. Ensure the performance, quality, and responsiveness of applications
  6. Work in Agile, cross-functional teams and taking responsibility for deliverables
  7. Excellent communication skills in both technical and non-technical discussions
Read more
Genius Placement Services
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
3 - 5 yrs
₹3L - ₹5L / yr
skill iconiOS App Development
skill iconSwift
skill iconObjective C
Xcode
SQLite
iOS Developer 

Skills : Swift Language , Sqlite Database , iOS App Development, Objective C , Xcode

Experience : 3 to 5 years 



 
Read more
Halodoc
Halodoc
Agency job
via Success Pact by Vineeta Karki
Bengaluru (Bangalore)
10 - 18 yrs
₹50L - ₹60L / yr
skill iconJava
Spring
Hibernate (Java)
J2EE
Java Server Faces (JSF)
+9 more
Key Job Responsibilities:
● He/She is a responsive team player who can proactively contribute for building technical
strategies for applications and systems by promoting an understanding of the technology and
business roadmap.
● He /she is someone who thrives in a fun, fast-paced, dynamic, startup-like environment.
● Work very closely with various business stakeholders to drive the execution of multiple
business plans and technologies .
● Work closely with Product, Design, and Marketing to conceive features, plan projects, and
build roadmaps
● Prior experience with scalable Architecture managing team of minimum 5 engineers and
coaching, mentoring while maintaining a role with code development.
● Proven history of contributing to product strategy and shipping products with multi-functional
teams.
● Highly involved in recruitment while building team also leading app development for both
platforms
● Promote and support company policies, procedures, mission, values, and standards of ethics
and integrity.

Minimum Qualification:
● Hands-on working on Java ( {Language understanding - Java 8, Lambdas, Collections,
popular frameworks & libraries}, JVM, GC tuning, performance tuning)
● Worked on REST frameworks/libraries like Spring MVC, Spring Boot, Dropwizard, REST
Express etc
● Worked on Relational data stores viz. MySQL, Oracle or Postgres
● Worked on Non-relational data stores viz. Cassandra, HBase, Couchbase, MongoDB etc
● Worked on caching infra viz. Redis, Memcached, Aerospike, Riak etc
● Worked on Queueing infra viz. Kafka, RabbitMQ, ActiveMQ et
Read more
ELCARREIRA TECHNOLOGIES (SOCIAL.HR)
Remote, Bengaluru (Bangalore)
8 - 15 yrs
₹10L - ₹25L / yr
Fullstack Developer
MERN Stack
skill iconAmazon Web Services (AWS)
Amazon S3
Infrastructure architecture
+2 more
Hello,

We are SOCIAL.HR

          An early-stage HR-Tech (SaaS) company. We aspire to be the leading self-driven career platform with intelligence. We are putting together a strong founding team of Chief Technical Officer. The founders have about a decade of experience in Sales, Marketing, HR & mobile application development.

Who is?

A Co-Creator/Co-Founder/Chief Technology Officer will be our first technology go-to expert who can own product development, technology for the scratch and scale it along the journey. You are a tech hack who can [Alt+f9] layers of complex computing problems. You have built amazing products and enterprise systems in the past and looking for the next big challenge? 

Do you have it?

  1. 6-12 years of experience in building a product from the ground up to scale
  2. You are hands-on with codes, active portfolio, and contribution
  3. You have built enterprise-level products
  4. You have explored and played around building great team culture
  5. You have the ability to attract and retain talent

We Look for?

  1. In it for a long term
  2. Thinking outside the box
  3. Not afraid to challenge the conventional wisdom
  4. Moving decisively towards business goals
  5. Flexible managing work-life balance

Are you the right fit?

  1. If you are a get my hands dirty kind of leader with deep experience in building and scaling large enterprise-grade product
  2. The latest tech stacks are just walk in the park
  3. You have Identified, compared, selected, and implemented technology solutions to meet current and future needs
  4. You have built end to the end cloud platform on AWS and are aware of best practices followed
  5. You are a flawless executor with an entrepreneurial spirit
  6. You have a keen eye for maintaining exceptional coding practices
  7. You have assembled and lead a team of highly motivated engineers
  8. Prior experience in data science and deep learning is a plus but not mandatory

We offer

Chief technology officer is a complex role that lies at the intersection of business and technology with true upside potential. Initially, the compensation will primarily be in the form of equity with increasing salary as we hit our business milestones and bring in institutional funding.

Look forward to talk. 

Adarsh.HM
Co-Founder
Read more
Uber
at Uber
1 video
10 recruiters
Thejaswi Bollineni
Posted by Thejaswi Bollineni
Remote, Bengaluru (Bangalore), Hyderabad
4 - 15 yrs
₹30L - ₹60L / yr
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
  • software engineering experience focused on web development.
  • Hands on experience in architecting large scale frontend applications.
  • Have detailed hands-on experience of cutting edge web technologies (HTML5, CSS, Javascript, TypeScript), Application Servers, Web Applications 
  • Experience developing UI with JavaScript development frameworks (e.g. React, Angular, Vue, Bootstrap, etc)
Read more
November First
at November First
1 video
2 recruiters
Pradeep Gururani
Posted by Pradeep Gururani
Bengaluru (Bangalore)
2 - 5 yrs
₹5L - ₹12L / yr
Selenium
Software Testing (QA)
Automation
TypeScript

We are seeking a skilled QA engineer who has experience in automation. Candidates from startup eco-system will be preferred.

 

Requirements:

  • Have worked on JS based automation framework i.e. Protractor or Puppeteer.
  • Have minimum of 2 years of strong experience in front-end automation.
  • Understand how Single Page Apps work.
  • Experience of automating API tests (our current automation is via C#).
  • Understand how CI/CD works.
  • Learn-ability and a good team player.
Read more
Valuefy
at Valuefy
2 recruiters
Aditya Barve
Posted by Aditya Barve
Thane, Mumbai
2 - 7 yrs
₹4L - ₹9L / yr
skill iconMongoDB
skill iconExpress
skill iconJavascript
skill iconNodeJS (Node.js)
Responsibilities: ● Build reusable code and libraries for future use. ● Own & build new modules/features end-to-end independently. ● Collaborate with other team members and stakeholders. Required Experience, skills and abilities: ●Thorough understanding of Node.js, JavaScript, its quirks, and workarounds. ● Excellence in at least one framework like strongloop loopback, express.js, sail.js etc. ● Excellence in at least one Javascript framework like Angular, vue.js, Ember, React or Backbone. ● Basic architectural understanding of modern day web applications ● Diligence for coding standards ● Must be good with git and git workflow ● Experience of external integrations is a plus ● Working knowledge of AWS, GCC, Azure ● Expertise with linux based systems ● Experience with CI/CD tools like jenkins is a plus. ● Experience with testing and automation frameworks. ● Extensive understanding of RDBMS systems Interpersonal Go-getter attitude and a passion for making killer web applications Good communication and interpersonal skills. Ability to work in a high pressure environment Ability to quickly understand complex problems and devise effective solutions Extra plusses(Optional) Knowledge of D3/NodeJS/AngularJS/lodash etc. Experience on Cloud as a platform or Infrastructure. Inclination to application design standards Other Details Salary: Market standard with performance linked benefits Depending upon the candidates Industry: Financial Technology Functional Area: BFSI
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos