
Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
· You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
· You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
· You will collaborate with Data Scientists in order to design scalable implementations of their models
· You will pair to write clean and iterative code based on TDD
· Leverage various continuous delivery practices to deploy, support and operate data pipelines
· Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
· Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
· Create data models and speak to the tradeoffs of different modeling approaches
· On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
· Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
· Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
· You are equally happy coding and leading a team to implement a solution
· You have a track record of innovation and expertise in Data Engineering
· You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
· You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
· You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
· Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
· You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
· You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
· Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
· Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
· You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
· An interest in coaching others, sharing your experience and knowledge with teammates
· You enjoy influencing others and always advocate for technical excellence while being open to change when needed

About Thoughtworks
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Company video


Connect with the team
Similar jobs
Skills
- Strong analytical thinking and problem-solving abilities.
- Solid understanding of system design, data structures, and algorithms.
- Proven experience in designing and implementing scalable architectures and robust design patterns.
- Ability to deliver end-to-end features and enhancements with minimal supervision.
- Proficient in debugging and resolving complex production issues and identifying root causes quickly.
- Ability to quickly learn and integrate new systems into existing platforms.
Programming Languages
- Strong expertise in Java or Python.
Database Skills
- Proficiency in SQL, with hands-on experience in PostgreSQL and MySQL.
Experience with NoSQL technologies, including MongoDB and Redis.
We’re looking for an experienced AI Developer to join our team and drive the design, development, and deployment of advanced computer-vision and LLM-based solutions. You’ll build real-time object detection & tracking pipelines (LLM, YOLOv8/11), develop face-recognition models on video feeds with LLM support, and manage GPU-powered server infrastructure end-to-end.
Key Responsibilities
- Model Development & Optimization
- Design, train, and fine-tune LLMs, YOLOv8/11 models for multi-class object detection.
- Implement face-recognition pipelines leveraging state-of-the-art LLMs and embedding techniques.
- Optimize inference speed and accuracy for real-time video processing on GPUs.
- Video Analytics & Tracking
- Develop multi-camera object-tracking algorithms across disparate video sources.
- Integrate OpenCV, DeepSORT (or similar), and custom tracking logic for robust performance.
- Infrastructure & Deployment
- Provision and maintain Linux servers with SSH, Docker, and GPU drivers (NVIDIA CUDA/cuDNN).
- Automate CI/CD pipelines for model training, evaluation, and deployment.
- Monitor GPU utilization, troubleshoot performance bottlenecks, and ensure high availability.
- Collaboration & Documentation
- Work closely with product managers, data engineers, and front-end teams to integrate AI services via REST/gRPC APIs.
- Write clear technical documentation, API specs, and best-practice guides.
Required Qualifications
- Bachelor’s or Master’s in Computer Science, Electrical Engineering, or related field.
- 2-3+ years hands-on experience with:
- YOLOv8 or YOLOv11 (training, inference, transfer learning)
- Face recognition frameworks (InsightFace, FaceNet, ArcFace) and LLM embeddings (e.g., Hugging Face Transformers)
- Python ecosystem: PyTorch/TensorFlow, OpenCV, NumPy, scikit-learn
- Strong Linux skills: server provisioning, SSH, shell scripting.
- Proficiency in managing GPU servers (NVIDIA CUDA, Docker GPU containers)
- Experience deploying models in production (AWS/GCP/Azure or on-prem clusters).
Preferred Qualifications
- Familiarity with video-streaming protocols (RTSP/WebRTC).
- Knowledge of microservices architecture and API gateways.
- Exposure to MLOps platforms (MLflow, Kubeflow).
- Strong debugging, profiling, and performance-tuning abilities.
About KAFQA
At Kafqa, we are building the next generation performing arts platform. Our mission is to transform how India learns, performs & watches performing arts. Our launch services consist of technology-enabled dance classes in our proprietary studios, production facilities, and social media broadcasting & competitions.
Founder & Team
The founder is Shariq Plasticwala. He is a graduate of IIT Bombay & Stanford GSB. He was part of the founding team of Amazon India where he played a key role for over 8 years. Among his roles at Amazon, he was the CEO of Amazon’s first joint venture in India and a Board Member of Amazon’s payments business. The other members of the founding team consisted of senior executives from Shiamak Davar & Byju’s.
Background
- At least 6+ years experience in back-end development in a fast-paced environment, working in Python & Django Framework
- Should Have experience leading a team.
- Deep understanding of technologies used in web products, including Rest APIs
- Sound understanding of SQL/NoSQL databases such as PostgreSQL and MongoDB.
- Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps.
- Understanding of databases, and related tools, paradigms.
Opportunity
Here are some of the things you might have to do on any given day:
- Developing APIs and endpoints for deployments of our product.
- Infrastructure Development such as building databases, creating and maintaining automated jobs.
- Build out the back-end to deploy and scale our product.
4 - 6years of experience in web and API development
4+ years experience with http://asp.net/MVC/C" target="_blank">ASP.NET/MVC/C#.
4+ years working with SQL Server (2012+).
Good Knowledge of scripting libraries like jQuery, Knockout, Angular JS
kindlife is the world's first well-being ecosystem that enables conscientious consumers with the largest community of well-being experts, brands, and content creators. kindlife platform houses more than 150+ kinder brands in beauty, nutrition, and home care and has a thriving community of well-being experts and enthusiasts. We believe it is essential to be kind and in that pursuit, we bring together all products that are kind to you, kind to those around you, and kind to the environment. For us, any move; big or small; on the well-being spectrum is a kindmove and must be celebrated.
About the role:
- Responsible for writing creative content for beauty brands and improving the quality of content on the website
- Writing blog posts and marketing copy to promote our products and service
- Update our website and social media pages with new content
- Proofread, re-structure, and edit articles by content writers
- Generate new ideas around industry-related topics
- Monitor web traffic and user engagement
- Hands-on experience with Content Management Systems
- Manage the editorial calendar and ensure timely publication
- Improve illustration in collaboration with marketing and design teams
- Proven work experience as a Content Editor, Web Editor, or similar role
- Excellent writing and editing skills in English
- Familiarity with SEO and keyword research
What We're Looking For:
- 2-4 years of significant knowledge across content, beauty, and lifestyle
- Critical thinking and the ability to quickly assess opportunities and challenges
- Ability to set long-term strategy, clear goals, and KPIs
- Excellent organization and communication skills
- Experience being a team player collaborating across departments
- Ability to manage multiple projects simultaneously and prioritize demands
- Strong people skills and ability to effectively manage a direct report
- Self-direction and an ability to manage ambiguity
- Experience managing and nurturing junior team members
What It's Like To Work Here:
kindlife is at its best when every member of our crew feels respected, included, and heard-when everyone can show up as themselves and do their best work every day.
We are a purpose-driven company and work towards empowering the crew to reach their full potential. We live up to our purpose by employing the following behaviors.
- We collaborate: Being a part of the kind crew means being part of one team with shared values and common goals.
- We innovate: At kindlife we always aim to find new and better ways to create innovative products and experiences. No matter where you work in the organization, you can always make a difference and have a real impact. We welcome new ideas and value new initiatives that challenge conventional thinking.
- We execute: We strive for excellence and are focused on pursuing best-in-class outcomes. We believe in accountability and ownership and know that our people are at their best when they are empowered to create and deliver results.
Visit us at: https://kindlife.in/ or join the conversation here :
- Instagram: https://www.instagram.com/kindlife.in/
- YouTube: https://www.youtube.com/channel/UCB2jIIGdFEhHKeoddqfP-Gg
Do a reference check with a crew member. We'll keep it anonymous, we promise!
Apply now!
Must have good hands on experience as a developer in any prog language.
Experience in any of our service offerings such as BI/AI/ML/QA/Microsoft Tech/Devops/UI/UX etc
Must have worked in US/Europe/ Australia etc
CSM/PSM Certification is mandatory
Developing and managing end-to-end project plans.
Ensure on-time delivery of projects.
Providing hands-on project management during analysis, design, development, testing, implementation and post implementation phases.
Assist with resource forecasting, delivery and change management of projects.
Assists with internal process improvements.
Interfacing with Business development for project requirements and scope.
Conduct project management duties in accordance with Agile/ Scrum methods; waterfall, hybrid and best practices.
Provide day-to-day interaction with clients and quality assurance for projects.
Ensure milestones are achieved on-time, on-budget and in scope.
Developing and monitoring risk and contingency plans.
Additional duties as assigned.
Must have excellent interpersonal skills in communications, client relations, people management and negotiation.
• Designing and building Likeminds iOS application.
• Collaborating with the design team to define app features and building a high quality
application
• Ensuring quality and performance of application to specifications.
• Identifying potential problems and resolving application bottlenecks.
• Fixing application bugs before final release
• Publishing application on App Store
• Maintaining the code and atomization of the application
• Designing and implementing application updates
Skills Required
• Proven experience as an app developer.
• Proficient in Objective-C, Swift, Xcode and Cocoa Touch
• Extensive experience with iOS Frameworks and strong understand of development lifecycle
• Knowledge of iOS back-end services.
• Knowledge of Apple’s design principles and application interface guidelines.
• Proficient in code versioning tools including Mercurial, Git, and SVN.
• Familiarity with push notifications, APIs and cloud messaging.
• Experience with continuous integration
Prior experience working in a startup is a plus.
Key Purpose
Responsible for direction, strategy, planning & execution for the company's human resources management and administration while also managing the industrial relations in a unionized environment which requires special attention.
Key Responsibilities :
1. Prepare the annual human resources budget based on strategic aims and specific business objectives of the company. Review and roll out action plans during quarterly, monthly forecasts to achieve the targets set.
2. Direct and coordinate human resources management operations which include recruitment, training & development, Industrial Relations, and personnel administration. This covers custody and maintenance of all human resource records and documentation and meeting all compliance requirements set by governmental authorities.
3. Develop, update, implement and maintain policies and processes for all human resource operations and ensure that they are clearly understood and followed.
4. Monitor and ensure the timely completion of the annual review of the performance management system in place. Continually revise and update the business objectives and key result areas in consultation with the functional heads to improve the contribution of individuals and teams to business performance thereby aligning with the company- s strategic aims and business objectives.
5. The management of recruitment processes to secure the right person and competencies to satisfy the organization's development/job needs.
6. The development and implementation of organizational group and individual learning processes that achieve the skills and knowledge development to fulfil current and future business success.
7. Managing the relationship with the union as a representative of the management to liaison between the management and the union. To investigate and resolve any complex or critical industrial relations issues in a timely and effective manner. Handling complaints, managing grievance procedures, and facilitating counseling in conjunction with the management.
8. Facility management will ensure a clean, hygienic, secure facility in good repair, running efficiently with processes/frequencies / performance measures in place. Printing and stationery stocking & issue and incoming mail distribution will be part of facility management.
Additional Responsibilities :
Travel Management - Ordering flight tickets based on approved travel requisitions, themost economic rates and efficient travel, turnaround times. The domestic & international travel policy ground rules will apply.
Profile :
- Right Organisation - Small or Midsized engineering company in a professional, process-driven manufacturing environment.
- Right Qualification - Graduate/Engineer, Masters in Human Resource Management Right Experience - +12 years experience, 5 years minimum relevant experience,
- Competence - Excellent verbal and written business communication skills including the Capabilities ability to communicate with all levels of management and workmen in the organization.
- Strategic analytical capability, attention to detail and presentation skills
- Empathy and ability to understand the development needs of all employees
- Managing administrative work with a high degree of perfection
- Proficient with computers particularly with MS office and ability to utilize various software applications
- ERP functional knowledge, strong business, and quality management process understanding.
- Using considerable independent judgment and initiative to make recommendations to the management on all human resource related matters.
1 to 3 years of experience in digital marketing - Highly conversant with Google Analytics and other similar tools - Basic programming ability(preferably R or Python)
- Manage sales operations in assigned district to achieve revenue goals.
- Supervise sales team members; the BSMs, on daily basis and provide guidance whenever needed.
- Identify skill gaps and conduct trainings to sales team.
- Work with team to implement new sales techniques to obtain profits.
- Assist in employee recruitment, promotion, retention and termination activities.
- Conduct employee performance evaluation and provide feedback for improvements.
- Contact potential customers and identify new business opportunities.
- Stay abreast with customer needs, market trends and competitors.
- Maintain clear and complete sales reports for management review.
- Build strong relationships with customers for business growth.
- Analyze sales performances and recommend improvements.
- Ensure that sales team follows company policies and procedures at all times.
- Develop promotional programs to increase sales and revenue.
- Plan and coordinate sales activities for assigned projects.








