Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Bengaluru (Bangalore), Pune, Chennai
1 - 3 yrs
₹3L - ₹4L / yr
cctv
IP address management
skill iconPython
Shell Scripting
IP Networking
+1 more

Application Deployment Engineers / Deployment Engineer – Video Analytics / CCTV Solutions / Application Implementation Engineer


Company Name

Paralaxiom Technologies Private Limited

Company Website

https://www.vast.vision/

https://www.linkedin.com/company/paralaxiom


Company details

Paralaxiom Technologies is involved in deep learning algorithms to develop video analytics-based security and compliance applications. They offer OCR products and image classification tools enhanced by machine learning algorithms and robust statistical analysis. We are among the earliest practitioners of AI software and we have world-class credentials in these technologies. They offer products like Paralaxiom VAST(Video Analytics and Surveillance Toolkit) and Paralaxiom AMPLE(Paralaxiom natural language processing platform).


In today's world, all premises be it manufacturing, hospitals, offices, hotels, cities, airports, shops, warehouses etc. are covered with CCTV Cameras. Continuous monitoring through dedicated command center or e-surveillance is proving to be ineffective as well as costly to manage.

We have pioneered the use of AI / ML technologies to headlessly live monitor CCTV cameras to generate very accurate alerts, alarms & insights and deliver them directly to the right stakeholders for quick, proactive action.

We have worked closely with hundreds of customers from diverse industries, AI Hardware Partners, CCTV OEMs, VMSs, System Integrators & Consultants to bring to the world VAST, an enterprise-ready Video Surveillance as a Service (VSaaS) solution.


Location: Pune / Bangalore / Chennai

Mode of Working: Work From Office 

Days of Working: 5 Days a week


Responsibilities

Position Overview:

Paralaxiom is a video analytics and machine vision company with its VAST product line a path-breaking product for safety, security, and operations for CCTV operations.

We are looking for application engineers for this product line.

Experience: 1 -2 years

Key Responsibilities:

1) Gathering information from customers on their needs and understanding how VAST software matches their desires

2) Design the solution and installation of the software

3 ) Making sure the VAST software continues to work properly after maintenance and testing

4) Take notes of all aspects of the application for future upgrades and maintenance

5) Troubleshooting the software

6) Training the end users

7) Excellent Knowledge of Python and shell scripting

8) Working knowledge of IP networking and troubleshooting

We need someone with 1-2 years of experience with the following skillset:

Great communication skills

Debugging and analytical skills

Knowledge of hardware and software integration will be a plus

Knowledge of Camera NVR will be a plus

Hands-on system and functional testing will be a plus


Interview process: 3 Video + Final Discussion - F2F

Read more
hirist
Shreya Jain
Posted by Shreya Jain
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹5L - ₹9L / yr
Technology Marketing
Viral Marketing
Social Media Marketing (SMM)
mmkmkmjbvgcxdcfghjklkjhgvcxdfghjkmnbv cgbhnmn vbn
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Bengaluru (Bangalore)
3 - 15 yrs
Best in industry
skill iconJava
06692
Microservices
SQL

  Minimum 3+ Years of Core Java Programming with Collections Framework, Concurrent Programming, Multi-threading (Good knowledge in Executor service, Fork joins pool and other threading concepts)

 

·       Good knowledge of the JVM with an understanding of performance and memory optimization.

 

·       Extensive and expert programming experience in JAVA programming language (strong OO skills preferred).

 

·       Excellent knowledge on collections like, Array List, Vector, LinkedList, HashMap, Hash Table, HashSet is mandate.

 

·       Exercised exemplary development practices including design specification, coding standards, unit testing, and code-reviews.

 

·       Expert level understanding of Object-Oriented Concepts and Data Structures

 

·       Good experience in Database (Sybase, Oracle or SQL Server) like indexing (clustered, non-clustered), hashing, segmenting, data types like clob / blob, views (materialized), replication, constraints, functions, triggers, procedures etc.


Read more
Brilworks Software
Brilworks Software
Posted by Brilworks Software
Ahmedabad
4 - 7 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Job Title: Senior Java Developer - Experience: 4.5 + years

Roles and Responsibilities:

·     Translate application storyboards and use cases into high-quality, efficient code.

·     Design, develop, and maintain clean, reusable Java code.

·     Take full ownership of modules, ensuring timely deployment to production.

·     Optimize application performance, quality, and responsiveness.

·     Identify and resolve bottlenecks, bugs, and technical issues.

·     Maintain high standards of code quality, organization, and automation.

·     Write well-structured, testable, and efficient code.

·     Investigate new technologies and approaches, presenting them for architectural review.

·     Participate in code reviews and provide constructive feedback to peers.

·     Stay current with the latest technologies and trends.

Desired Candidate Profile:

·     Strong proficiency in Core Java (OOP, Collections, Threads, Regular Expressions, Exception Handling).

·     Solid understanding of object-oriented programming.

·     Ability to write clean, readable Java code.

·     Knowledge of scalable application design principles.

·     Strong experience with Relational Databases, SQL, and ORM technologies (e.g., MySQL, Hibernate).

·     Proficiency in software design and development using Java, J2EE, Spring Boot, Spring Security, and Hibernate.

·     Experience with test-driven development.

·     Familiarity with CI/CD processes for build and deployment.

Must-Have:

·     Java 8/Java 11 experience.

·     Expertise in the Spring Framework.

·     Hands-on experience with relational databases (Oracle/MySQL/PostgreSQL/SQLServer).

·     Proficiency in building scalable REST APIs (capable of handling 20k+ simultaneous users).

·     Willingness to work with new technologies.

·     Strong communication skills.

Nice to Have:

·     Experience with React JS, and JavaScript framework.

·     Microservices architecture knowledge.

·     Familiarity with Redis, AWS S3, AWS Lambda, and NoSQL databases.

·     CI/CD experience.

Brilworks will support your growth in these areas where necessary! :)

 

Read more
Quoality
at Quoality
1 video
3 recruiters
Akshay Dekate
Posted by Akshay Dekate
Remote only
0 - 1 yrs
₹5000 - ₹12000 / mo
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
RESTful APIs
+2 more
We’re looking for Backend Developer(NodeJs) interns to work on

Quoality- A Modern Operating Infrastructure for Hospitality Businesses to help them improve the guest experience and generate additional revenue.

Launched in 2021, Quoality is a Hospitality Tech company backed by a US-based Newchip Accelerator. Our mission is to equip businesses with the tools they need to grow. 

By providing tools, insights, and education with minimal effort on the business's part, the barrier to making actionable business decisions is lowered dramatically. Everything we do is driven by this mission. Everything we do needs to positively answer the question, "Does this help businesses grow?"


Product Demo
: https://www.youtube.com/watch?v=gKklkRYKkC4&;t" target="_blank">https://www.youtube.com/watch?v=gKklkRYKkC4

Quoality Blogosphere: https://medium.com/quoality" target="_blank">https://medium.com/quoality

 


🙋‍♀️ The role & what we are looking for?

Oh, this is our favorite part. We’ve seen companies that write 'templatized' BS for this section; stuff that’s never followed in reality.

Not us. Here are some of our core values to give you a sense of who we are as a team:

  • First and foremost, we’re super transparent. We all know what everyone’s working on, how’s the company doing, and the whole shebang.
  • We’re all super chill. 
  • Work time ain’t playtime. We take our work very seriously. We’re a small bunch on a mission to change the guest experience in the hospitality industry, once and for all.
  • Deadlines are a thing for us. We are super punctual.
  • We know what we are working on and aren’t clueless.
  • We’re more friends than colleagues.
  • Monthly 1:1s with the founders where you can directly share & receive feedback.

Not convinced yet? Okay, here’s the fun stuff:

  • Flexible leave policy. Yeah, it’s truly flexible. We trust you.
  • We have a flexible remote work policy in India.  Work from the beautiful beaches of Goa or the stunning mountains of Manali, we’re all good.
  • Annual workstations at exotic destinations. Subject to change and hitting milestones.
  • Allowances to choose your coworking space (if you want), courses & any tool that you think is beneficial to succeed in this role.

📄 The role & what we are looking for:

🧑‍💻 Responsibilities:
  • Write code that will impact the businesses of thousands of hotels, hostels, and vacation homes across the globe.
  • Collaborate with Frontend to spec, write, test, and deploy API endpoints.
  • Implementation of a robust set of services and APIs that work on our data pipelines.
  • Build all support infrastructure to scale our data delivery pipelines - endpoints, security, logging, messaging.
  • Product development activity includes data querying from our various stores, real-time analytics, ML algorithms.
  • Developing & Integrating of the front-end and back-end aspects of the web application
  • Optimization of the application for maximum speed and scalability.
  • Brainstorm features with the product team and guides decisions based on your knowledge of the codebase.
  • Take full ownership of the module starting from architectural and design decisions to shipping.
  • Like the work you do, enjoy collaborating with your coworkers, communicate as much as you can, and have fun. 

Must Haves:
  • Upto years of relevant work experience.
  • Understanding the nature of asynchronous programming and its quirks and workarounds.
  • You possess strong computer science fundamentals: data structures, algorithms, distributed systems, and information retrieval.
  • You have a good understanding of multi-process architecture and the threading limitations of NodeJs and Express frameworks.
  • Understanding of fundamental design principles behind a scalable application.
  • You have basic understanding of relational databases as well as key-value databases and are capable of designing scalable database models based on the product requirements.
  • Familiarity with REST API development standards, protocols (HTTP, WebSockets and more)
  • You’re comfortable picking up new stacks and choosing the right tool to get the job done.
  • You are open to learning new stuff and avoid internal politics. (super important).
  • You are humble, kind, and are open to feedback.(super duper important).

❕Bonus:

  • Entrepreneurial spirit, Product Thinker, and ‘Can-Do' attitude.
  • Passionate about leveraging technology for supporting product delivery in the Hospitality space.
  • Operating style suited to working in a startup environment, where teamwork and resourcefulness are highly valued.
  • Excellent leadership skills, including the ability to manage multiple assignments at a time.

🤙 What's the interview process like?

Yes, we do have a process, and it’s simple.

  • Step 1: You apply for the job.
  • Step 2: Quick intro call with the founders.
  • Step 3: Solve an assignment.
  • Step 4: A round where we evaluate your assignment along with you.
  • Step 5: One round of interviews to gauge if you are a good culture fit.
  • Step 6: Job Offer (contingent on the above steps).
  • Step 7: Welcome to the Quoality! 🙂

So, think we’re a good fit? Then let’s roll.🤘
Read more
Bengaluru (Bangalore)
4 - 6 yrs
₹10L - ₹15L / yr
Network Security
Firewall
Implementation
  • Minimum of 5+ years of experience in IT industry at VMware NSX Design/Implementation Projects.
  • Minimum 3+ years of experience in industry leading load balancer and security products (Mandatory)
  • Should have solid hands-on experience in VMware Avi, NSX V and/or NSX-T.
  • Hands on installation and configuration experience with Base NSX-V & NSX-T Components, VTEP's, Load Balancer, LB Rules, Security components, etc.
  • Strong understanding of and experience in TCP/IP, DNS, Http, SSL, DHCP.
  • Proficiency in vSphere products and technologies like HA, vMotion, DRS, and Update Manager, Administration, etc would be a plus.
  • Exposure to enterprise class architecture or implementation with suite of VMware products including vCenter, vSphere, SAN, RAID, Clustering, Consolidation, Load Balancing, etc.
  • Troubleshooting and Debugging of VMware Architecture related issues.
  • Strong understanding of Linux/Windows servers.
  • Good to have some knowledge in vRA/vRO.
  • Good to have Any Automation Experience with PowerShell/Python/Bash/Ansible and basic knowledge of VMware API’s.
  • Good to have some knowledge of Kubernetes and Dockers.
  • Succeed in a team environment.
Academic background in MS/BE/B-Tech/ IT/CS/ECE/EE would be preferred
Read more
Amazon India
at Amazon India
1 video
58 recruiters
Srilalitha K
Posted by Srilalitha K
Hyderabad, Bengaluru (Bangalore), Delhi, Gurugram, Pune, Chennai
3 - 9 yrs
₹2L - ₹15L / yr
skill iconC
skill iconC++
skill iconC#
skill iconPython
skill icon.NET
+14 more

Software Development Engineer – SDE 2.            

 

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

 

 Top Skills

You write high quality, maintainable, and robust code, often in Java or C++ or C#

You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.

You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

You solve problems at their root, stepping back to understand the broader context.

You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.

You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.

You recognize and use design patterns to solve business problems.

You understand how operating systems work, perform and scale.

You continually align your work with Amazon’s business objectives and seek to deliver business value.

You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.

You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.

You communicate clearly with your team and with other groups and listen effectively.

 

Skills & Experience

Bachelors or Masters in Computer Science or relevant technical field.

Experience in software development and full product life-cycle.

Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.

Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.

Proficiency in SQL and data modeling.

Read more
Remote only
1 - 2 yrs
₹1.3L - ₹1.5L / yr
Customer Service
Customer Support
Communication Skills
Sales
Customer Retention
+1 more
  •      Job Responsibilities:
    • Handling inbound and outbound call
    • Ability to assess customer needs and respond to them.
    • Match customer needs with vendor availabilty
    • payment assistance to cutomer
    • Proficient with Microsoft Office. Word, excel
    • Key Skills:
      • Great command over English and Hindi
      • Comfort with medical and fitness terminology
      • Ability to work in tight schedules
      • Ability to work independently
      • Experience in customer service or call centre background preferrred
Read more
Xome
at Xome
1 recruiter
Uma P
Posted by Uma P
Chennai
4 - 7 yrs
₹10L - ₹20L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Internal Title/Job Req Title: Senior Software Engineer /Lead Engineer Job Profile: Senior Software Engineer II Job Description Summary: Design, develop, build, implement, document, deploy, operate, analyze, and deliver large-scale, multi-threaded, high-throughput, highly reliable, distributed software applications, tools, systems and services with multiple interacting processes using Object Oriented design, Java, Perl, C++, .Net or any open Source Technologies. Job Description: • Education: Bachelor's degree or higher in Computer Science or related field (BE/BTech/ME/MTech/MS in computer science etc). • Experience : 4 to 8 • Strong Data structure, Algorithm and Problem solving skills. • Experience in seeing through a complete software life cycle and showing ownership on building components in them • Hands on experience in any of the technologies like Java,.Net, C#, ASP.Net, Nodejs, Ember.js, Python, PostgreSQL, Reactjs or open source. etc • Good Problem Solving skills to be able to work independently without guidance • Strong in design patterns • Responsible for development of enhancements to the product and design. • Passion for building scalable, global, complex systems to solve problems with proven ability to deliver high quality software. Preferred Qualifications • Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment. • Solid understanding of Object-Oriented design and concepts • Hard core Engineer with passion for learning new technologies • Expertise in delivering high quality and innovative applications. • Strong desire to build, sense of ownership, urgency, and drive. • Excellent written communication and verbal agility are strong assets.
Read more
Garbethe Infotech Pvt Ltd
Umang Garg
Posted by Umang Garg
Patiala, Chandigarh
3 - 7 yrs
₹2L - ₹10L / yr
skill iconJava
skill iconAndroid Development
Mobile Payments
skill iconXML
we are running eCommerce company . like to develop android app
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos