
š Hiring: Data Engineer | GCP + Spark + Python + .NET |
| 6ā10 Yrs | Gurugram (Hybrid)
Weāre looking for a skilled Data Engineer with strong hands-on experience in GCP, Spark-Scala, Python, and .NET.
š Location: Suncity, Sector 54, Gurugram (Hybrid ā 3 days onsite)
š¼ Experience: 6ā10 Years
ā±ļø Notice Period :- Immediate Joiner
Required Skills:
- 5+ years of experience in distributed computing (Spark) and software development.
- 3+ years of experience in Spark-Scala
- 5+ years of experience in Data Engineering.
- 5+ years of experience in Python.
- Fluency in working with databases (preferably Postgres).
- Have a sound understanding of object-oriented programming and development principles.
- Experience working in an Agile Scrum or Kanban development environment.
- Experience working with version control software (preferably Git).
- Experience with CI/CD pipelines.
- Experience with automated testing, including integration/delta, Load, and Performance

Similar jobs (10)
Role & Responsibilities
We are looking for a hands-on Camunda Developer with strong experience in workflow orchestration and backend development. The ideal candidate should be able to design, build, and optimize end-to-end business processes using Camunda (preferably Camunda 8) and work closely with engineering and business teams to implement scalable and resilient workflows.
Key Responsibilities:
- Translate business requirements into BPMN workflows using Camunda (preferably Camunda 8)
- Design and implement end-to-end process orchestration across systems
- Build and manage service integrations (REST APIs, event-driven systems)
- Develop and maintain Zeebe workers / microservices (Python)
- Collaborate with stakeholders to refine workflows and handle edge cases
- Implement error handling, retries, and compensation mechanisms
- Analyse and improve workflows for scalability, reliability, and performance
- Ensure data consistency and idempotent process execution
- Work with cross-functional teams including data and analytics for process observability
Ideal Candidate
- Strong Senior Camunda Developer / Workflow Orchestration Engineer Profiles
- Mandatory (Experience 1) ā Must have 4+years of hands-on experience in backend development and workflow systems, demonstrable through production-grade work on business process automation or backend service development.
- Mandatory (Experience 2) ā Must have strong hands-on experience with Camunda and BPMN 2.0, including designing, building, and deploying end-to-end business process workflows in production.
- Mandatory (Experience 3) ā Must have hands-on experience with Zeebe workers and the Camunda 8 stack, built and maintained as part of real orchestration systems.
- Mandatory (Experience 4) ā Must have strong production-level coding skills in Python, used for building and maintaining Zeebe workers and microservices.
- Mandatory (Experience 5) ā Must have experience designing and working within microservices architecture and distributed systems, with clear understanding of service decomposition, inter-service communication, and distributed system failure modes.
- Mandatory (Experience 6) ā Must have hands-on experience building and consuming REST APIs and working with event-driven systems (message brokers, pub/sub, event streams).
- Mandatory (Skills) ā Must have strong debugging and problem-solving skills in production workflow environments, with specific examples of resolving complex issues such as stuck processes, race conditions, or data inconsistency bugs.
- Preferred (Experience 1) ā Exposure to cloud platforms (AWS / GCP / Azure) and experience with data platforms (e.g., Snowflake).
- Preferred (Experience 2) ā Understanding of finance-related workflows (billing, reconciliation, etc.).
We are a San Francisco-based AI infrastructure company working with leading frontier AI labs to build post-training data and evaluation infrastructure for foundation models. We are hiring a Python Developer to create high-quality datasets, reinforcement learning environments, and benchmarking pipelines used to improve and evaluate state-of-the-art LLMs. This is a remote role with flexible working hours.
Responsibilities
* Create and curate datasets for LLM post-training (SFT, RLHF, RL, preference optimization).
* Build and maintain RL environments for agent evaluation.
* Develop Python tooling for dataset generation, validation, and transformation.
* Evaluate models on custom benchmarks and testing pipelines.
* Collaborate with research and engineering teams to deliver client-specific post-training datasets.
* Work with terminal-first development workflows and cloud infrastructure.
Required Skills
* Strong Python programming skills.
* Understanding of LLM fundamentals and post-training concepts (SFT, RLHF, RL).
* Experience working with structured data (JSON, CSV, YAML).
* Git, Linux/Unix command line, and solid software engineering fundamentals.
Good to Have
Experience with RAG, agentic AI systems, Hugging Face Transformers, LoRA/PEFT, LangChain or LlamaIndex, vector databases (FAISS, Qdrant, Milvus, Pinecone, Weaviate, ChromaDB), Docker, AWS/GCP, FastAPI/Flask, Bash, CLI tooling, model evaluation frameworks, benchmarking, and AI infrastructure.
Compensation
Base Salary: USD $1,250/month
Equity: ESOP/Equity package included.
Performance Bonuses: Up to USD $4,000/month (in addition to base salary).
Location
Remote (Worldwide)
Work Hours
Flexible, remote-first, asynchronous work environment.
How to Apply
Apply here: https://tally.so/r/wLReJG
Please complete the application form and submit the required details. Only shortlisted candidates will be contacted.
UKG is looking to hire a Lead Software Engineer to join our extremely talented Data Science team. As a Lead Software Engineer at UKG, youāll be embedded on the Data Science team where you can work on the next generation AI Platform. Youāll get to work directly with other Engineers, Software Testers, Business Analysts, Product Managers, and Directors, all of whom make up the team. In this highly collaborative environment, you will have the opportunity to grow as a software engineer, and even help mentor others.
This position requires excellent object-oriented programming skills and knowledge of design patterns. They will be involved in the deployment of our AI Platform/Services solution on the cloud. The job requires you to be able to design, develop, troubleshoot, and debug complex software applications at the enterprise level. We are looking for a software engineer who is passionate about programming and truly enjoys what they do. The ideal candidate for the Python Engineer position is someone who has a can-do attitude and is an innovative thinker.
UKG works in an agile environment where there are daily stand-ups, code reviews, and constant communication within each self-managed cross-functional team. The ability to communicate effectively with Business Analysts and Software Testers, as well as work closely with other team members are key components for success in this position.
Primary Responsibilities:
- Collaborate with members of the team to solve challenging engineering tasks on time and with high quality.
- Engage in code reviews and training of team members.
- Support continuous deployment pipeline code.
- Situationally troubleshoot production issues alongside the support team.
- Continually research and recommend product improvements.
- Create and integrate features for our enterprise software solution using the latest Python technologies.
- Write web services, business objects, and other middle-tier framework using Python
- Actively communicate with team members to clarify requirements and overcome obstacles to meet the team goals.
- Leverage open-source and other technologies and languages outside of the Python platform.
- Develop cutting-edge solutions to maximize the performance, scalability, and distributed processing capabilities of the system.
- Provide troubleshooting and root cause analysis for production issues that are escalated to the engineering team.
- Work with development teams in an agile context as it relates to software development, including Kanban, automated unit testing, test fixtures, and pair programming.
Qualifications
- 5-8 years experience as a Python developer on enterprise projects using Python, Flask, FastAPI, Django, PyTest, Celery and other Python frameworks.
- Software development experience including: object-oriented programming, concurrency programming, modern design patterns, RESTful service implementation, micro-service architecture, test-driven development, and acceptance testing.
- Familiarity with tools used to automate the deployment of an enterprise software solution to the cloud, Terraform, GitHub Actions, Concourse, Ansible, etc.
- Proficiency with Git as a version control system
- Experience with Docker and Kubernetes
- Experience with relational SQL and NoSQL databases, including MongoDB and MSSQL.
- Experience with object-oriented languages: Python, Java, Scala, C#, etc.
- Experience with testing tools such as PyTest, Wiremock, xUnit, mocking frameworks, etc.
- Experience with GCP technologies such as BigQuery, GKE, GCS, DataFlow, Kubeflow, and/or VertexAI
- Excellent problem solving and communication skills.
bout the Role
We are seeking an experienced Python Data Engineer with a strong foundation in API and basic UI development. This role is essential for advancing our analytics capabilities for AI products, helping us gain deeper insights into product performance and driving data-backed improvements. If you have a background in AI/ML, familiarity with large language models (LLMs), and a solid grasp of Python libraries for AI, weād like to connect!
Key Responsibilities
ā¢Ā Ā Ā Develop Analytics Framework: Build a comprehensive analytics framework to evaluate and monitor AI product performance and business value.
ā¢Ā Ā Ā Define KPIs with Stakeholders: Collaborate with key stakeholders to establish and measure KPIs that gauge AI product maturity and impact.
ā¢Ā Ā Ā Data Analysis for Actionable Insights: Dive into complex data sets to identify patterns and provide actionable insights to support product improvements.
ā¢Ā Ā Ā Data Collection & Processing: Lead data collection, cleaning, and processing to ensure high-quality, actionable data for analysis.
ā¢Ā Ā Ā Clear Reporting of Findings: Present findings to stakeholders in a clear, concise manner, emphasizing actionable insights.
Required Skills
ā¢Ā Ā Ā Technical Skills:
oĀ Ā Ā Proficiency in Python, including experience with key AI/ML libraries.
oĀ Ā Ā Basic knowledge of UI and API development.
oĀ Ā Ā Understanding of large language models (LLMs) and experience using them effectively.
ā¢Ā Ā Ā Analytical & Communication Skills:
oĀ Ā Ā Strong problem-solving skills to address complex, ambiguous challenges.
oĀ Ā Ā Ability to translate data insights into understandable reports for non-technical stakeholders.
oĀ Ā Ā Knowledge of machine learning algorithms and frameworks to assess AI product effectiveness.
oĀ Ā Ā Experience in statistical methods to interpret data and build metrics frameworks.
oĀ Ā Ā Skilled in quantitative analysis to drive actionable insights.
Requirements:
⢠Should be a go-getter, ready to shoulder more responsibilities, and shows enthusiasm and interest in work.
⢠Excellent core Python skills including threading, dictionary, OOPS Concept, Data structure, and Web service.
⢠Should have work experience on the following stacks/libraries: Flask
⢠Familiarity with some ORM (Object Relational Mapper) libraries
⢠Able to integrate multiple data sources and databases into one system
⢠Understanding of the threading limitations of Python, and multi-process architecture Familiarity with event-driven programming in Python
⢠Basic understanding of front-end technologies, such as Angular, JavaScript, HTML5 and CSS3
⢠Writing reusable, testable, and efficient code
⢠Design and implementation of low-latency, high-availability, and performant applications
⢠Understanding of accessibility and security compliance
⢠Experience in both RDBMS(MySQL), NoSQL databases (MongoDB, HDFS, HIVE etc) or in-memory caching technologies such as ehcache etc is preferable.
About KAFQA
At Kafqa, we are building the next generation performing arts platform. Our mission is to transform how India learns, performs & watchers performing arts. We are currently in stealth mode with a target public launch date in April. Our launch services consist of technology enabled dance classes in our proprietary studios, production facilities and social media broadcasting & competitions.
Founder & Team
The founder is Shariq Plasticwala. He is a graduate of IIT Bombay & Stanford GSB. He was part of the founding team of Amazon India where he played a key role for over 8 years. Among his roles at Amazon, he was the CEO of Amazonās first joint venture in India and a Board Member of Amazonās payments business. The other members of the founding team consist of senior executives from Shiamak Davar & Byjuās.
Background
- At least 1+ yearsā experience in back-end development in a fast-paced environment, working in Python & Django Framework
- Deep understanding of technologies used in web-deployed SaaS products, including Rest APIs
- Exposure to AWS, Azure or other cloud providers
Ā
Opportunity
We will share our workload as a team and we expect you to work on a broad range of tasks. Hereās are some of the things you might have to do on any given day:
- Developing APIs and endpoints for deployments of our product
- Infrastructure Development such as building databases, creating and maintaining automated jobs
- Build out the back-end to deploy and scale our product
- Build POCs for client deployments
- Document your code, write test cases, etc.
Ā
Skills
- Hands-on experience with Python (1+ years)
- Sound understanding of Postgres and NoSQL databases such as MongoDB
- Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps
- Understanding of databases, and related tools, paradigms
Ā
Good experience in programming Microsoft C# (preferred) and/or Visual Basic.NET, ADO.Net, and ASP.Net 2.0, .Net 4.5 framework or .net core 2.1 and above
Must have experience In SQL and Agile/Scrum
Nice to have experience in AWS or Azure
The key aspects of this role include:
⢠Design, build, and maintain scalable applications using Python.
⢠Contribute to the entire implementation process including driving the definition of improvements
based on business need and architectural improvements.
⢠Act as a subject matter expert for Application Software developers and Engineers.
⢠Handle server-side code for a production platform and contribute to new features.
To be the right fit, you'll need:
⢠More than 4+ years of experience as a software developer in Python, with knowledge of at least one
Python web framework such as Django, Flask, etc.
⢠Good understanding of common design patterns and architecture principles to design reliable and
Scalable applications
⢠Strong communication skills
⢠Knowledge of databases line NoSQL or MongoDB
⢠Good to have AWS and Docker or Web services
⢠Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
Job Description
- Strong experience in .NET, C# Programming, SQL server,
- Strong Object Oriented design and analysis skills.
- Excellent debugging skills, able to debug complex technical issues involving multiple system
components. - Ability to design, develop and implement high-quality code in a timely manner.
- Excellent written and verbal communication skills are must.
- Experience in Onsite / offshore model.
- Prior experience in a technical leadership position.
- Experience with Agile methodology.
Job Responsibilities
- Understand and develop technical solutions for complex problems that require regular use ofĀ logical thinking, reasoning and ingenuity
- Participate in peer-reviews of solution designs, code review and analysis.
- Collaborate with both internal and external stakeholders.
- Develop high performance, reusable, and reliable DOT net and PL/SQL code.
- Create interface services in Dot Net.
- Ensure the best possible performance and quality of the application
- Help maintain code quality, organization, and automatization
- To set and maintain coding standards.
- Able to mentor junior developers to use new coding techniques.
- Should be process-oriented.
Skills:
-Programming experience on the .NET platform in MVC framework with C# language, creating Web
applications, Web APIs, Windows Service, with good PL/SQL experience.
- PL/SQL in SQL Server/ Oracle
- Skills in HTML, C#, MVC 4, JavaScript, JQuery, AJAX, TFS, IIS
- Visual Studio 2012
- Team player with good communication skills








