AI Runtime Lead (LLM DevOps pytorch

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

Solid product experience and an educational background from Tier‑1 universities are preferred.

As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities. 

In this role, you will: 

• Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance. 
• Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features. 
• Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability. 
• Work with SQL and NoSQL databases to implement efficient data models and service access patterns. 
• Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs). 
• Use AI powered engineering tools to improve development quality, speed, and productivity. 
• Mentor engineers, supporting them in technical planning, implementation, and best practices. 
• Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure. 
• Write unit and integration tests and participate in code reviews to uphold engineering excellence. 
• Investigate production issues, ensuring timely and effective solutions. 
• Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies. 

Who You’ll Work With 

You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction. 

What Makes You a Qualified Candidate 

(Nonnegotiable qualifications) 

• Bachelor’s degree in Computer Science or equivalent from a recognized institution. 
• 5+ years of experience in backend services, distributed systems, or data platform development. 
• Strong proficiency in Java, Go, or Python for service development. 
• Good understanding of design principles, distributed system patterns, and service framework. 
• Hands-on experience designing and developing RESTful APIs. 
• Experience with SQL and NoSQL databases and data modelling. 
• Strong debugging, problem solving, and troubleshooting skills. 
• Experience with modern containerization and orchestration tools such as Kubernetes. 
• Knowledge of public cloud platforms. 
• Experience with AI productivity tools (e.g., GitHub Copilot). 
• Ability to work independently, drive workstreams, and deliver high quality outcomes. 
• Strong communication and collaboration skills. 

What You’ll Bring 

(Preferred qualifications) 

• Familiarity with messaging systems such as Kafka. 
• Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs. 
• A track record of influencing design decisions and driving engineering best practices. 
• The ability to mentor engineers and guide them through design, planning, and execution. 
• A proactive mindset and comfort working in fast paced, dynamic environments. 
• Curiosity, adaptability, and a passion for building impactful AI-driven products. 

About the Role

We are hiring Staff / Principal Engineers to take full, hands-on ownership of Blitzy's most critical production-grade systems and to deliver high-leverage features that materially improve customer outcomes and engineering velocity. This is the most senior individual contributor role at the company today.

This is not a Senior-plus role, an architecture-only role, or a promotion-track role. We are looking for someone who has already operated at Principal / Staff+ scope in a highly technical environment and expects to spend their time writing, reviewing, and shipping production code.

This role is 100% hands-on. Leverage comes from system ownership, execution quality, and durable technical decisions — not people management or process.

Responsibilities

• Own mission-critical production systems end-to-end, ensuring correctness, scalability, performance, reliability, and operational excellence.
• Design, build, and ship high-impact backend systems and features that improve product reliability, performance, and customer value.
• Architect scalable services and cloud infrastructure using technologies such as Python, REST, gRPC, Kubernetes, and Terraform.
• Identify and resolve complex technical bottlenecks that limit engineering quality, system performance, or organizational velocity.
• Build and operate LLM-powered systems and validation loops that evaluate correctness, consistency, durability, and production performance.
• Design and evolve data architectures incorporating relational, NoSQL, graph, and vector databases to support complex enterprise applications and semantic retrieval.
• Modernize and improve complex enterprise systems while balancing reliability, maintainability, scalability, and delivery speed.
• Set and uphold engineering quality standards through hands-on technical leadership, sound technical judgment, and ownership of long-term technical decisions.

Qualifications

• Direct experience with Python as a primary programming language, backend frameworks, and microservices architectures.
• Expertise in REST and gRPC, with proficiency in Node.js and JavaScript.
• Proficiency in GCP, along with experience using at least one additional cloud platform such as AWS or Azure.
• Advanced knowledge of Kubernetes and Terraform in production environments.
• Experience operating highly available production systems, including monitoring, scalability, reliability, performance optimization, and operational tooling.
• Strong knowledge of SQL and NoSQL databases, including PostgreSQL, MySQL, MongoDB, Cassandra, or DynamoDB.
• Familiarity with graph databases such as Neo4j and vector databases or embedding infrastructure for semantic search and retrieval.
• Hands-on experience building and operating LLM-powered systems in production, including evaluation, validation, regression testing, tracing, and failure analysis.
• Working knowledge of LangSmith or comparable LLM observability and evaluation tools; familiarity with OpenAI, Anthropic, or similar model providers is a plus.
• Ability to contribute across the full stack, with a strong understanding of frontend architecture and the ability to debug, design, and ship across frontend, backend, infrastructure, and AI systems.
• Understanding of large-scale enterprise software systems, including architecture, integration, deployment, modernization, and long-term maintainability.
• Proven track record of operating at Staff+, Principal Engineer, or equivalent level, independently driving complex technical initiatives and delivering high-impact outcomes with minimal supervision.

Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into enterprise grade code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups.

Our Culture

Who we are:

Led by two pioneering co-founders we are one of the fastest growing companies in the U.S., creating our own category of enterprise autonomous software development. We automate thousands of hours of software development for our customers, which includes strong representation within the Fortune 500.

How we work:

• We move Blitzy Fast: Time is both our company’s and our clients’ most precious asset. We move quickly and decisively to innovate internally and deliver exceptional software externally.
• Championship Mindset: We operate like a professional sports team. We win as a team by holding ourselves and each other to high standards, collaborating in-person, and remaining focused on the mission.
• Passion for Invention: We’re pushing the frontier of what’s possible, requiring constant innovation and iteration.
• We Work for the Customer: We focus on delivering outsized value to the customers we work with and expanding those relationships into deep, meaningful partnerships.
• We believe in being ‘everyday athletes’: taking care of ourselves so we can bring our best minds to work. We promote great sleep, movement, and restorative activities for 

Blitzy is an equal opportunity employer committed to building a diverse and inclusive team. We believe different perspectives make us stronger.

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

• Senior Machine Learning Engineer – Vertex AI
• Senior Generative AI Engineer – GCP
• Google Cloud AI/ML Engineer
• MLOps Engineer – Vertex AI
• LLM Engineer – RAG, Gemini, and Vertex AI

Strong AI Engineer / Machine Learning Engineer profiles.

2

Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

3

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

4

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

5

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

6

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

7

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

8

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Experience Level

This role is ideal for engineers with total 3+ years of experience with a proven track record of shipping complex projects successfully.

An experienced individual contributor and leader who thrives in large, complex projects with widespread impact.

What You’ll Do as a Software Craftsperson 

• Design and build high-quality, maintainable systems using disciplined engineering practices such as TDD, continuous refactoring, and pair programming 
• Operate in an AI-native development model, using AI as a collaborator to explore architecture and design, accelerate development, and continuously improve systems while applying strong judgment to ensure that speed never compromises quality 
• Take end-to-end ownership of outcomes from problem understanding and system design to implementation, deployment, and operation in production 
• Make thoughtful design decisions that balance simplicity, scalability, and long-term maintainability in real-world systems 
• Maintain a high bar for engineering quality through rigorous testing, code reviews, and continuous feedback 
• Investigate and resolve production issues, and implement systemic improvements to prevent recurrence 
• Work directly with clients, navigate ambiguity, and translate business problems into well-designed technical solutions 
• Contribute to improving team practices, tooling, and systems to raise the overall quality and effectiveness of engineering 

Requirements

What You’ll Bring 

• 3+ years of experience building high-quality, production systems (flexible based on demonstrated capability) 
• Strong fundamentals in software engineering, including object-oriented design, system design, and testing practices such as TDD 
• Demonstrated ability to build simple, maintainable, and scalable systems with a focus on long-term reliability 
• Proficiency in one or more modern technologies, Python, PHP, JavaScript, or TypeScript, with the ability to learn new technologies quickly 
• Deep experience working with Git in collaborative environments, including managing shared codebases, conducting code reviews, and maintaining a high bar for quality 
• Ability to operate effectively in an AI-native workflow using AI as a collaborator to explore solutions and accelerate development, while applying strong judgment to ensure correctness, quality, and maintainability 
• Clear thinking and strong problem-solving ability, with the capacity to break down complex problems into simple, well-structured solutions 
• A strong sense of ownership — you take responsibility for outcomes, care deeply about quality, and are not comfortable shipping work that does not meet your standards.

Benefits

Life at Incubyte 

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance. 
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

JOB DESCRIPTION

Lead Engineer

Ahmedabad, India | Around 5 years of experience

Salary is open for the right candidate.

About the role

A growing healthcare technology startup is building AI-native hospital management systems and

healthcare products for emerging markets. You’ll set technical direction, lead the engineering team, and

stay hands-on with the code that ships.

What you’ll do

Set technical direction. Make architecture decisions, weigh trade-offs, and build systems that stay

reliable as requirements evolve.

Ship production software. Write, review, test, and debug code, and own the quality of what ships.

Lead the team. Break complex problems into deliverable work, mentor engineers, and take responsibility

for delivery.

Use AI coding agents. Give agents the context to tackle substantial engineering work, then critically

review, test, and debug their output.

Work with healthcare teams. Learn their workflows and turn complex requirements into dependable

software.

What you’ll bring

Production ownership. Around five years of experience, including meaningful ownership of complex

systems or products in production. Experience can be flexible for exceptional candidates.

Technical depth. Strong ability in mathematics, algorithms, or machine learning, demonstrated through

competitions, research, or demanding systems you’ve built and deployed.

Engineering leadership. Examples of architecture decisions you owned, engineers you mentored, and

work your team delivered.

AI-assisted development skills. A workflow you can demonstrate, including how you spot incorrect

assumptions, test changes, and debug failures.

Initiative and judgment. You learn quickly, tackle unfamiliar problems independently, and get working

software into users’ hands.

How to apply

Send your CV or LinkedIn profile to the recruiter who shared this brief. Include one or two examples of

your strongest technical work, a team leadership example, and an example of your AI coding workflow.

Highlight your own contribution and share only material you’re permitted to disclose.

Please include your salary expectations, notice period, and availability to work in Ahmedabad.

Pncpl Software Engineer

Position Responsibilities :

• Lead the architecture and development of AI-powered, distributed systems that meet enterprise-grade performance and security standards.
• Leverage AI tools for code generation, architectural design, and documentation to accelerate delivery and improve quality.
• Design, build, and maintain services using Java following clean-code and secure design principles.
• Develop agentic AI-based tools, domain-specific copilots, and developer productivity enhancements.
• Collaborate with cross-functional teams to define modular, scalable, and compliant architecture patterns.
• Conduct technical design reviews and produce detailed documentation, including system specifications, API docs, and architecture diagrams.
• Integrate AI solutions into CI/CD pipelines, ensuring observability, automated testing, and deployment standards are met.
• Implement robust monitoring and performance engineering practices to maintain high-quality deployments.
• Continuously evaluate emerging AI technologies and integrate them into development workflows for maximum impact.
• Champion best practices in security, automation, and performance optimization across the organization.

Qualifications :

• 6+ years in software engineering with backend development in Java.
• 3+ years with AI tools for development, prototyping, or documentation tasks.
• Experience with cloud-native development and containerized deployment (Docker, Kubernetes).
• Knowledge of AI integration patterns, vector stores, prompt engineering, and RAG pipelines.
• Ability to design software architecture using sequence diagrams, ERDs, data models, and threat models.
• Comfortable with Gen AI-first environments and working with remote Agile teams.

Preferred Qualifications

• Experience building AI copilots or developer tools using OpenAI/Claude SDKs, LangChain, or similar frameworks.
• Experience working in a fast-paced, AIDLC environment, with a strong understanding of CI/CD practices.
• Familiarity with GitHub Actions, Argo Workflows, Terraform, and monitoring/observability tools.
• Containerization and Orchestration: Proficiency in Docker and Kubernetes for containerization and orchestration.
• Cloud Platforms: Experience with cloud computing platforms such as AWS, Azure, or OCI Cloud.

Job Summary

We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.

Key Responsibilities

• Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
• Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
• Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
• Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
• Integrate AI/ML models with enterprise applications and APIs.
• Fine-tune and evaluate ML/LLM models based on business requirements.
• Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
• Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
• Conduct model performance evaluation, optimization, and troubleshooting.
• Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
• Stay current with emerging AI/ML technologies, frameworks, and industry best practices.

Required Skills

• Strong programming experience in Python.
• Strong understanding of Machine Learning algorithms, statistics, and data structures.
• Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
• Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
• Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
• Experience with NLP, deep learning, or computer vision is an advantage.
• Experience developing and consuming REST APIs and microservices.
• Working knowledge of SQL and NoSQL databases.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Understanding of Docker, Kubernetes, CI/CD, and MLOps.
• Familiarity with Git and modern software development practices.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
• 4 years of relevant experience in AI/ML engineering or a related field.
• Experience building and deploying production-grade AI/ML solutions.
• Enterprise application development experience.
• Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
• Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
• Experience with AI/ML model monitoring, evaluation, and optimization.

What You Bring

• Strong problem-solving and analytical skills.
• Ability to translate business requirements into practical AI/ML solutions.
• Strong software engineering and debugging capabilities.
• Ability to work independently as well as collaboratively in a cross-functional environment.
• Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.

Keywords

AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI

Location: Gurugram

Work mode: Hybrid