
Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
· You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
· You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
· You will collaborate with Data Scientists in order to design scalable implementations of their models
· You will pair to write clean and iterative code based on TDD
· Leverage various continuous delivery practices to deploy, support and operate data pipelines
· Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
· Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
· Create data models and speak to the tradeoffs of different modeling approaches
· On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
· Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
· Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
· You are equally happy coding and leading a team to implement a solution
· You have a track record of innovation and expertise in Data Engineering
· You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
· You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
· You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
· Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
· You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
· You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
· Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
· Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
· You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
· An interest in coaching others, sharing your experience and knowledge with teammates
· You enjoy influencing others and always advocate for technical excellence while being open to change when needed

About Thoughtworks
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Company video


Connect with the team
Similar jobs
Application Deployment Engineers / Deployment Engineer – Video Analytics / CCTV Solutions / Application Implementation Engineer
Company Name
Paralaxiom Technologies Private Limited
Company Website
https://www.linkedin.com/company/paralaxiom
Company details
Paralaxiom Technologies is involved in deep learning algorithms to develop video analytics-based security and compliance applications. They offer OCR products and image classification tools enhanced by machine learning algorithms and robust statistical analysis. We are among the earliest practitioners of AI software and we have world-class credentials in these technologies. They offer products like Paralaxiom VAST(Video Analytics and Surveillance Toolkit) and Paralaxiom AMPLE(Paralaxiom natural language processing platform).
In today's world, all premises be it manufacturing, hospitals, offices, hotels, cities, airports, shops, warehouses etc. are covered with CCTV Cameras. Continuous monitoring through dedicated command center or e-surveillance is proving to be ineffective as well as costly to manage.
We have pioneered the use of AI / ML technologies to headlessly live monitor CCTV cameras to generate very accurate alerts, alarms & insights and deliver them directly to the right stakeholders for quick, proactive action.
We have worked closely with hundreds of customers from diverse industries, AI Hardware Partners, CCTV OEMs, VMSs, System Integrators & Consultants to bring to the world VAST, an enterprise-ready Video Surveillance as a Service (VSaaS) solution.
Location: Pune / Bangalore / Chennai
Mode of Working: Work From Office
Days of Working: 5 Days a week
Responsibilities
Position Overview:
Paralaxiom is a video analytics and machine vision company with its VAST product line a path-breaking product for safety, security, and operations for CCTV operations.
We are looking for application engineers for this product line.
Experience: 1 -2 years
Key Responsibilities:
1) Gathering information from customers on their needs and understanding how VAST software matches their desires
2) Design the solution and installation of the software
3 ) Making sure the VAST software continues to work properly after maintenance and testing
4) Take notes of all aspects of the application for future upgrades and maintenance
5) Troubleshooting the software
6) Training the end users
7) Excellent Knowledge of Python and shell scripting
8) Working knowledge of IP networking and troubleshooting
We need someone with 1-2 years of experience with the following skillset:
Great communication skills
Debugging and analytical skills
Knowledge of hardware and software integration will be a plus
Knowledge of Camera NVR will be a plus
Hands-on system and functional testing will be a plus
Interview process: 3 Video + Final Discussion - F2F
Minimum 3+ Years of Core Java Programming with Collections Framework, Concurrent Programming, Multi-threading (Good knowledge in Executor service, Fork joins pool and other threading concepts)
· Good knowledge of the JVM with an understanding of performance and memory optimization.
· Extensive and expert programming experience in JAVA programming language (strong OO skills preferred).
· Excellent knowledge on collections like, Array List, Vector, LinkedList, HashMap, Hash Table, HashSet is mandate.
· Exercised exemplary development practices including design specification, coding standards, unit testing, and code-reviews.
· Expert level understanding of Object-Oriented Concepts and Data Structures
· Good experience in Database (Sybase, Oracle or SQL Server) like indexing (clustered, non-clustered), hashing, segmenting, data types like clob / blob, views (materialized), replication, constraints, functions, triggers, procedures etc.
Job Title: Senior Java Developer - Experience: 4.5 + years
Roles and Responsibilities:
· Translate application storyboards and use cases into high-quality, efficient code.
· Design, develop, and maintain clean, reusable Java code.
· Take full ownership of modules, ensuring timely deployment to production.
· Optimize application performance, quality, and responsiveness.
· Identify and resolve bottlenecks, bugs, and technical issues.
· Maintain high standards of code quality, organization, and automation.
· Write well-structured, testable, and efficient code.
· Investigate new technologies and approaches, presenting them for architectural review.
· Participate in code reviews and provide constructive feedback to peers.
· Stay current with the latest technologies and trends.
Desired Candidate Profile:
· Strong proficiency in Core Java (OOP, Collections, Threads, Regular Expressions, Exception Handling).
· Solid understanding of object-oriented programming.
· Ability to write clean, readable Java code.
· Knowledge of scalable application design principles.
· Strong experience with Relational Databases, SQL, and ORM technologies (e.g., MySQL, Hibernate).
· Proficiency in software design and development using Java, J2EE, Spring Boot, Spring Security, and Hibernate.
· Experience with test-driven development.
· Familiarity with CI/CD processes for build and deployment.
Must-Have:
· Java 8/Java 11 experience.
· Expertise in the Spring Framework.
· Hands-on experience with relational databases (Oracle/MySQL/PostgreSQL/SQLServer).
· Proficiency in building scalable REST APIs (capable of handling 20k+ simultaneous users).
· Willingness to work with new technologies.
· Strong communication skills.
Nice to Have:
· Experience with React JS, and JavaScript framework.
· Microservices architecture knowledge.
· Familiarity with Redis, AWS S3, AWS Lambda, and NoSQL databases.
· CI/CD experience.
Brilworks will support your growth in these areas where necessary! :)
Quoality- A Modern Operating Infrastructure for Hospitality Businesses to help them improve the guest experience and generate additional revenue.
Launched in 2021, Quoality is a Hospitality Tech company backed by a US-based Newchip Accelerator. Our mission is to equip businesses with the tools they need to grow.
By providing tools, insights, and education with minimal effort on the business's part, the barrier to making actionable business decisions is lowered dramatically. Everything we do is driven by this mission. Everything we do needs to positively answer the question, "Does this help businesses grow?"
Product Demo: https://www.youtube.com/watch?v=gKklkRYKkC4&t" target="_blank">https://www.youtube.com/watch?v=gKklkRYKkC4
Quoality Blogosphere: https://medium.com/quoality" target="_blank">https://medium.com/quoality
🙋♀️ The role & what we are looking for?
Oh, this is our favorite part. We’ve seen companies that write 'templatized' BS for this section; stuff that’s never followed in reality.
Not us. Here are some of our core values to give you a sense of who we are as a team:
- First and foremost, we’re super transparent. We all know what everyone’s working on, how’s the company doing, and the whole shebang.
- We’re all super chill.
- Work time ain’t playtime. We take our work very seriously. We’re a small bunch on a mission to change the guest experience in the hospitality industry, once and for all.
- Deadlines are a thing for us. We are super punctual.
- We know what we are working on and aren’t clueless.
- We’re more friends than colleagues.
- Monthly 1:1s with the founders where you can directly share & receive feedback.
Not convinced yet? Okay, here’s the fun stuff:
- Flexible leave policy. Yeah, it’s truly flexible. We trust you.
- We have a flexible remote work policy in India. Work from the beautiful beaches of Goa or the stunning mountains of Manali, we’re all good.
- Annual workstations at exotic destinations. Subject to change and hitting milestones.
- Allowances to choose your coworking space (if you want), courses & any tool that you think is beneficial to succeed in this role.
📄 The role & what we are looking for:
🧑💻 Responsibilities:
- Write code that will impact the businesses of thousands of hotels, hostels, and vacation homes across the globe.
- Collaborate with Frontend to spec, write, test, and deploy API endpoints.
- Implementation of a robust set of services and APIs that work on our data pipelines.
- Build all support infrastructure to scale our data delivery pipelines - endpoints, security, logging, messaging.
- Product development activity includes data querying from our various stores, real-time analytics, ML algorithms.
- Developing & Integrating of the front-end and back-end aspects of the web application
- Optimization of the application for maximum speed and scalability.
- Brainstorm features with the product team and guides decisions based on your knowledge of the codebase.
- Take full ownership of the module starting from architectural and design decisions to shipping.
- Like the work you do, enjoy collaborating with your coworkers, communicate as much as you can, and have fun.
- Upto years of relevant work experience.
- Understanding the nature of asynchronous programming and its quirks and workarounds.
- You possess strong computer science fundamentals: data structures, algorithms, distributed systems, and information retrieval.
- You have a good understanding of multi-process architecture and the threading limitations of NodeJs and Express frameworks.
- Understanding of fundamental design principles behind a scalable application.
- You have basic understanding of relational databases as well as key-value databases and are capable of designing scalable database models based on the product requirements.
- Familiarity with REST API development standards, protocols (HTTP, WebSockets and more)
- You’re comfortable picking up new stacks and choosing the right tool to get the job done.
- You are open to learning new stuff and avoid internal politics. (super important).
- You are humble, kind, and are open to feedback.(super duper important).
❕Bonus:
- Entrepreneurial spirit, Product Thinker, and ‘Can-Do' attitude.
- Passionate about leveraging technology for supporting product delivery in the Hospitality space.
- Operating style suited to working in a startup environment, where teamwork and resourcefulness are highly valued.
- Excellent leadership skills, including the ability to manage multiple assignments at a time.
🤙 What's the interview process like?
Yes, we do have a process, and it’s simple.
- Step 1: You apply for the job.
- Step 2: Quick intro call with the founders.
- Step 3: Solve an assignment.
- Step 4: A round where we evaluate your assignment along with you.
- Step 5: One round of interviews to gauge if you are a good culture fit.
- Step 6: Job Offer (contingent on the above steps).
- Step 7: Welcome to the Quoality! 🙂
So, think we’re a good fit? Then let’s roll.🤘

- Minimum of 5+ years of experience in IT industry at VMware NSX Design/Implementation Projects.
- Minimum 3+ years of experience in industry leading load balancer and security products (Mandatory)
- Should have solid hands-on experience in VMware Avi, NSX V and/or NSX-T.
- Hands on installation and configuration experience with Base NSX-V & NSX-T Components, VTEP's, Load Balancer, LB Rules, Security components, etc.
- Strong understanding of and experience in TCP/IP, DNS, Http, SSL, DHCP.
- Proficiency in vSphere products and technologies like HA, vMotion, DRS, and Update Manager, Administration, etc would be a plus.
- Exposure to enterprise class architecture or implementation with suite of VMware products including vCenter, vSphere, SAN, RAID, Clustering, Consolidation, Load Balancing, etc.
- Troubleshooting and Debugging of VMware Architecture related issues.
- Strong understanding of Linux/Windows servers.
- Good to have some knowledge in vRA/vRO.
- Good to have Any Automation Experience with PowerShell/Python/Bash/Ansible and basic knowledge of VMware API’s.
- Good to have some knowledge of Kubernetes and Dockers.
- Succeed in a team environment.
Software Development Engineer – SDE 2.
As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.
Top Skills
You write high quality, maintainable, and robust code, often in Java or C++ or C#
You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.
Roles & Responsibilities
You solve problems at their root, stepping back to understand the broader context.
You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
You recognize and use design patterns to solve business problems.
You understand how operating systems work, perform and scale.
You continually align your work with Amazon’s business objectives and seek to deliver business value.
You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
You communicate clearly with your team and with other groups and listen effectively.
Skills & Experience
Bachelors or Masters in Computer Science or relevant technical field.
Experience in software development and full product life-cycle.
Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
Proficiency in SQL and data modeling.
- Job Responsibilities:
- Handling inbound and outbound call
- Ability to assess customer needs and respond to them.
- Match customer needs with vendor availabilty
- payment assistance to cutomer
- Proficient with Microsoft Office. Word, excel
- Key Skills:
- Great command over English and Hindi
- Comfort with medical and fitness terminology
- Ability to work in tight schedules
- Ability to work independently
- Experience in customer service or call centre background preferrred










