AI Infrastructure Architecture at NeoGenCode Technologies Pvt Ltd · Remote only · 8 - 14 years · ₹25L - ₹35L / yr · Raised funding · Remote only · Posted 25 Jun 2025

Education:
•Bachelor’s degree in Computer Science, IT Infrastructure Engineering, or a related field
•Certifications in cloud computing (AWS, Azure, GCP), MLOps, or DevOps (preferred)
Experience:
•8+ years of experience in IT Infrastructure, Cloud Computing, or AI Systems Architecture
•Hands on experience in AI infrastructure design, cloud-based AI solutions, or MLOps
•Expertise in managing AI workloads across cloud and hybrid environments.
•Proven track record in scaling AI infrastructure for large enterprises
•Strong experience in Kubernetes, containerization, and orchestration tools
•Experience in optimizing AI workloads for performance and cost efficiency
Skills :
•Expertise in AI Infrastructure & Cloud Architecture
•Strong Understanding of AI Model Deployment & MLOps
•Advanced Proficiency in Kubernetes & AI Workload Orchestration
•Hands-on Experience with Cloud Platforms (AWS, Azure, GCP)
•Proficiency in Infrastructure as Code (Terraform, Ansible)
•AI Security & Compliance Knowledge
•AI Infrastructure Cost Optimization Strategies
•Performance Tuning for AI Systems & Workloads

About NeoGenCode Technologies Pvt Ltd
About
Welcome to Neogencode Technologies, an IT services and consulting firm that provides innovative solutions to help businesses achieve their goals. Our team of experienced professionals is committed to providing tailored services to meet the specific needs of each client. Our comprehensive range of services includes software development, web design and development, mobile app development, cloud computing, cybersecurity, digital marketing, and skilled resource acquisition. We specialize in helping our clients find the right skilled resources to meet their unique business needs. At Neogencode Technologies, we prioritize communication and collaboration with our clients, striving to understand their unique challenges and provide customized solutions that exceed their expectations. We value long-term partnerships with our clients and are committed to delivering exceptional service at every stage of the engagement. Whether you are a small business looking to improve your processes or a large enterprise seeking to stay ahead of the competition, Neogencode Technologies has the expertise and experience to help you succeed. Contact us today to learn more about how we can support your business growth and provide skilled resources to meet your business needs.
Candid answers by the company
IT & Engineering Talent Staffing
- Provides full-time and contract-based hiring, delivering handpicked, pre‑screened developers across tech stacks—ranging from web, mobile, AI/ML, Web3/blockchain.
- Maintains a bench o vetted candidates, offering fast delivery of interview-ready profiles—often within 24 hours.
- Offers payroll management, handling compliance, tax, attendance, and documentation for both contractors and full-time employees.
2. End-to-End Project Delivery
- Delivers full-stack development solutions: web, mobile, cloud, AI/ML, Blockchain/Web3.
- Manages entire project lifecycle—requirements gathering, design (UI/UX), development, deployment, and ongoing support .
3. Additional Offerings
- Expands into cybersecurity consulting, digital marketing, and cloud platform services (like AWS, GCP, Azure) .
- Provides strategic IT consulting to align technology solutions with business objectives
Similar jobs (10)
Job Title : Senior AWS DevSecOps & AI Platform Engineer
Experience Required : 5+ Years in AWS / Cloud Engineering
Terraform Experience : 4+ Years
Location : Gurugram
Work Mode : Onsite
Employment Type : Full-time
About the Role :
We are looking for an experienced Senior AWS DevSecOps & AI Platform Engineer with strong expertise in AWS cloud infrastructure, Kubernetes, Infrastructure as Code (IaC), CI/CD automation, cloud security, and database administration.
The ideal candidate will be responsible for designing and maintaining secure, scalable, reliable, and cost-efficient cloud environments while supporting microservices-based applications and implementing DevSecOps best practices. The role also involves building and deploying AI agents using Amazon Bedrock and Bedrock AgentCore, along with managing enterprise development and collaboration tools.
Mandatory Skills :
AWS (EC2, EKS, ECS, Lambda, S3, CloudWatch), Kubernetes, Terraform, Jenkins, Bitbucket Pipelines, CI/CD, DevSecOps, AWS Security Services (IAM, WAF, GuardDuty, Security Hub, KMS, Secrets Manager), Microservices, Helm, PostgreSQL, Oracle SQL, RDS, Jira, Confluence, Amazon Bedrock, Bedrock AgentCore, AWS Networking, and Cloud Cost Optimization.
Key Responsibilities :
- AWS Cloud Infrastructure : Design, implement, and maintain AWS infrastructure with a focus on scalability, availability, security, reliability, and cost optimization.
- Microservices & Containerization : Manage and support distributed microservices architectures, including deployment, monitoring, troubleshooting, performance optimization, service meshes, and API gateways.
- Kubernetes Administration : Administer and optimize Kubernetes clusters, including Amazon EKS and self-managed environments, covering upgrades, networking, workload management, scaling, and resource optimization.
- Cloud Security & Compliance : Implement and manage AWS security services, including IAM, GuardDuty, Security Hub, WAF, KMS, Secrets Manager, AWS Config, and CloudTrail.
- DevSecOps Implementation : Integrate security testing, vulnerability scanning, container security, and compliance-as-code tools into CI/CD pipelines.
- CI/CD & Source Control : Manage Bitbucket repositories, branching strategies, permissions, and Bitbucket Pipelines. Build and optimize Jenkins pipelines using declarative and scripted approaches.
- Infrastructure as Code : Develop and maintain Terraform modules, manage remote state and workspaces, detect infrastructure drift, and implement reusable infrastructure provisioning practices.
- Database Administration : Provision, manage, secure, and optimize AWS RDS databases, particularly PostgreSQL and Oracle, including backups, replication, patching, performance tuning, and migrations.
- Jira & Confluence Administration : Manage projects, workflows, automation rules, permissions, user access, spaces, schemes, and plugins.
- Monitoring & Reliability : Define and monitor SLIs, SLOs, and SLAs; implement observability best practices; and participate in incident management, root cause analysis, and post-incident reviews.
- AI Agent Development : Design, build, and deploy AI agents using Amazon Bedrock and Bedrock AgentCore, including agent runtime, memory, tools, gateway integration, identity and access management, guardrails, and lifecycle management across environments.
- Cloud Connectivity : Support hybrid cloud connectivity using AWS Direct Connect, VPN, and Transit Gateway.
- Cost Optimization : Apply FinOps practices to monitor cloud expenditure, optimize resource utilization, and improve infrastructure efficiency.
- API Integrations : Integrate third-party APIs while implementing authentication, rate limiting, error handling, and webhook management.
Required Skills & Qualifications :
- 5+ years of hands-on experience with AWS cloud services, including EC2, ECS, EKS, Lambda, ALB, CDN, S3, CloudWatch, Amazon Bedrock, and Bedrock AgentCore.
- Strong understanding of AWS networking, multi-account strategies, landing zone architecture, and hybrid connectivity.
- 4+ years of practical experience with Terraform, including module development, remote state management, workspaces, drift detection, and state operations.
- Extensive experience administering Kubernetes, preferably Amazon EKS, including Helm, Kustomize, operators, RBAC, network policies, autoscaling, and multi-tenancy.
- Proven experience managing distributed microservices, service meshes, API gateways, and inter-service communication.
- Strong knowledge of AWS security services, including IAM, Service Control Policies (SCPs), WAF, KMS, Secrets Manager, AWS Config, and CloudTrail.
- Experience implementing least-privilege access, zero-trust principles, and cloud security compliance controls.
- Hands-on experience integrating DevSecOps tools such as Snyk, Trivy, Checkov, and SonarQube into CI/CD pipelines.
- Understanding of OWASP security principles, CIS benchmarks, vulnerability management, and container security.
- Proficiency in Bitbucket repository administration, branch permissions, and YAML-based Bitbucket Pipelines.
- Strong experience developing and maintaining Jenkins CI/CD pipelines, shared libraries, plugins, and build agents.
- Experience administering AWS RDS databases, particularly PostgreSQL and Oracle SQL, including backup, replication, performance tuning, and migration activities.
- Experience administering Jira and Confluence, including workflows, permissions, automation, and plugin management.
- Working knowledge of Azure services, particularly Web Apps and Logic Apps/Workflows.
- Practical experience with Amazon Bedrock, including model invocation, guardrails, and AI agent development and deployment using Bedrock AgentCore.
- Understanding of third-party API integration, authentication mechanisms, rate limiting, error handling, and webhook management.
- Familiarity with FinOps practices and cloud cost optimization.
Good-to-Have Skills :
- Additional Azure experience, including networking, Azure SQL Managed Instance, and Azure Kubernetes Service (AKS).
- Hands-on experience with AI-driven Development Lifecycle (AI-DLC) methodologies and tools such as Kiro.
Relevant certifications, such as :
- AWS Certified Solutions Architect
- AWS Certified DevOps Engineer – Professional
- AWS Machine Learning or Generative AI certifications
- Certified Kubernetes Administrator (CKA)
- HashiCorp Terraform certifications
Ideal Candidate Profile :
The ideal candidate is a hands-on cloud and DevSecOps professional who can manage enterprise-scale AWS infrastructure, automate deployments, strengthen security controls, troubleshoot complex distributed systems, and support AI agent development. Strong problem-solving skills, an automation-first mindset, and the ability to collaborate across development, security, and infrastructure teams are essential.

AI Architect – Enterprise AI & Generative AI ( Remote) - Contractual
Experience: 8+ years
Location: Remote, India
Employment Type: Contractual
Working Hours: 3:00 PM – 12:00 AM IST
Client Engagement: US-based client
About the Role
We are looking for a hands-on, client-facing AI Architect to lead the architecture, technical direction, and production implementation of enterprise AI and Generative AI solutions for a US-based client.
You should combine strong software engineering and cloud architecture fundamentals with practical experience building secure, scalable, and reliable AI applications. This role involves end-to-end technical ownership, from solution design and prototyping to production deployment and optimization. It is not a research-only, advisory-only, or prompt-writing position.
Key Responsibilities
- Lead end-to-end architecture and delivery of AI/ML and Generative AI solutions, from discovery and proof of concept to production rollout.
- Design LLM-powered applications using Retrieval-Augmented Generation (RAG), embeddings, vector databases, AI agents, and orchestration frameworks.
- Define data ingestion, chunking, retrieval, grounding, evaluation, and knowledge-refresh strategies.
- Select appropriate AI models and platforms based on quality, latency, cost, security, and operational requirements.
- Design cloud-native architectures, APIs, integrations, identity controls, monitoring, and resilient deployment patterns.
- Create architecture diagrams, technical designs, implementation roadmaps, and technical standards.
- Implement AI quality and safety measures, including hallucination mitigation, guardrails, access controls, and prompt-injection defenses.
- Guide engineering, data, ML, and DevOps teams through implementation, code reviews, troubleshooting, and go-live readiness.
- Lead technical discussions and design reviews with US client stakeholders.
- Establish production monitoring, CI/CD, versioning, incident handling, and performance and cost optimization practices.
Required Skills & Qualifications
- 8+ years of relevant experience in software engineering, AI/ML engineering, data engineering, or technology architecture.
- Proven experience personally architecting and deploying at least one enterprise-grade AI or Generative AI solution into production.
- Strong practical knowledge of LLMs, RAG, embeddings, vector databases, orchestration frameworks, and model evaluation.
- Hands-on experience with Python and APIs, including prototyping, code review, and troubleshooting.
- Experience with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud Platform (GCP).
- Understanding of data pipelines, SQL/NoSQL databases, containers, CI/CD, MLOps, and LLMOps.
- Knowledge of enterprise security, privacy, identity and access management, and responsible AI practices.
- Experience independently leading architecture workshops, design reviews, and technical discussions with US clients.
- Excellent written and spoken English, documentation, and stakeholder management skills.
- Availability to work from 3:00 PM to 12:00 AM IST and willingness to accept a contractual engagement.
Preferred Experience
- Azure AI Foundry, Azure OpenAI, Amazon Bedrock, or Google Vertex AI.
- Azure AI Search or equivalent retrieval tools.
- LangChain, LangGraph, Semantic Kernel, and agent/tool orchestration.
- Model fine-tuning, predictive ML, document intelligence, multimodal AI, or real-time AI applications.
- Experience in cloud modernization, enterprise integrations, data analytics, or technology consulting.
- Relevant AI/cloud architecture certifications and experience mentoring technical teams.
What Success Looks Like
- Designing secure, scalable, production-ready AI solutions rather than demos or conceptual presentations.
- Making sound technical decisions around feasibility, performance, reliability, cost, and AI risks.
- Taking ownership of architecture decisions and resolving technical blockers with limited supervision.
- Building trust with senior US stakeholders and collaborating effectively with India-based delivery teams.
Contract Details
- Initial engagement: Minimum 3 months, with extension subject to project requirements and performance.
- Working schedule: 3:00 PM – 12:00 AM IST.
- Potential permanent employment: After 18 months, the client may consider direct permanent employment at its sole discretion. Conversion is not guaranteed.
Mandatory Screening Criteria
Candidates should be able to:
- Explain an enterprise AI/GenAI solution they personally architected and deployed, including architecture, scale, evaluation, and business impact.
- Whiteboard an enterprise RAG or agentic solution covering data flow, security, authentication, authorization, monitoring, and cost controls.
- Discuss real-world model-quality issues, hallucinations, privacy risks, incidents, and architectural trade-offs.
- Lead a technical design review with US client stakeholders.
- Confirm acceptance of the working hours and contractual engagement.
Apply only if you have hands-on experience architecting and deploying enterprise AI/GenAI solutions in production.
Title : Senior AI Platform / MLOps Engineer
Experience : 6+ years
Work type : Chennai - Work from Office/other locations - Remote
Employment Type : Full Time
Notice Period : Immediate
Work Day :Mon to Fri
Key Responsibilities:
- Install, configure and operate OpenShift, NVIDIA GPU operator, OpenShift AI, and NIM microservices on 12× RTX PRO 6000 across two servers; single-node and HA control-plane topologies
- Serving configuration and tuning: quantized model deployment (FP8/FP4), replica balancing, batching, KV-cache and context management
- Azure GPU build environments: provisioning, cost control, parity with the on-prem stack via pinned container/model versions; cloud-to-factory migration with parity regression
- GitOps CI/CD, container registry, artifact/model versioning, environment promotion; observability and audit wiring (Splunk, Prometheus/Grafana)
- Benchmark automation: load harness, p50/p95/p99 latency, tokens/sec, GPU utilization; the capacity report data pipeline
- Platform upgrade procedure with evaluation-regression gates; deployment runbook as a first-class deliverable
Technical Skills:
- 6+ years infrastructure/platform engineering with 3+ years production Kubernetes; OpenShift experience strongly preferred
- Hands-on GPU inference serving in production: NIM, Triton, vLLM, or TensorRT-LLM — you have sized, deployed, and tuned LLM serving on real GPUs and can talk memory-bandwidth trade-offs
- GitOps fluency (ArgoCD/Flux), infrastructure-as-code, container internals; comfortable in air-gapped/proxy-restricted enterprise networks
- Observability depth: metrics, traces, log pipelines; has built performance test harnesses, not just run them
- Azure or AWS GPU compute operations experience
Strongly preferred
- NVIDIA GPU operator and AI Enterprise stack specifics; KServe; Milvus or pgvector operations; VAST/NFS/S3 storage integration; banking or other regulated-environment delivery
About Ampera:
Ampera Technologies, a purpose driven Digital IT Services with primary focus on supporting our client with their Data, AI / ML, Accessibility and other Digital IT needs. We also ensure that equal opportunities are provided to Persons with Disabilities Talent. Ampera Technologies has its Global Headquarters in Chicago, USA and its Global Delivery Center is based out of Chennai, India. We are actively expanding our Tech Delivery team in Chennai and across India. We offer exciting benefits for our teams, such as 1) Hybrid and Remote work options available, 2) Opportunity to work directly with our Global Enterprise Clients, 3) Opportunity to learn and implement evolving Technologies, 4) Comprehensive healthcare, and 5) Conducive environment for Persons with Disability Talent meeting Physical and Digital Accessibility standards
Job Title: Senior AI Engineer
Experience: 5–10 years in software engineering, with 3+ years in AI/ML engineering preferred
Employment Type: Full-time
Department: Artificial Intelligence / Engineering
Location: Bangalore
We are looking for a highly skilled Senior AI Engineer to design, develop, deploy, and scale intelligent AI-powered applications and solutions. The ideal candidate will have strong expertise in machine learning, Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and production-grade software engineering.
The candidate will work closely with product managers, data scientists, software engineers, and business stakeholders to translate complex business requirements into scalable, reliable, secure, and cost-effective AI solutions.
Key Responsibilities
1. AI Solution Design and Development
- Design, develop, and deploy end-to-end AI and machine learning solutions.
- Build intelligent applications using LLMs, Generative AI, NLP, and deep learning techniques.
- Develop scalable AI architectures and reusable components for enterprise applications.
- Evaluate AI models and select appropriate approaches based on accuracy, latency, cost, and business requirements.
2. Generative AI and LLM Engineering
- Develop LLM-powered applications using models from providers such as OpenAI, Anthropic, Google, or open-source ecosystems.
- Design and implement RAG pipelines, document processing workflows, semantic search, and knowledge retrieval systems.
- Build AI agents and multi-step workflows using appropriate orchestration frameworks.
- Implement prompt engineering, structured outputs, tool calling, and context management.
- Optimize model performance through evaluation, fine-tuning where appropriate, and inference optimization.
3. Machine Learning and Data Engineering
- Develop and operationalize machine learning models for classification, prediction, recommendation, and other business use cases.
- Work with structured, unstructured, and multimodal data.
- Build data preprocessing, feature engineering, model training, and validation pipelines.
- Apply appropriate model evaluation techniques and statistical methods.
4. Production Deployment and MLOps / LLMOps
- Deploy AI solutions using cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Build automated CI/CD pipelines for AI applications and model deployment.
- Implement model versioning, experiment tracking, monitoring, and performance evaluation.
- Optimize inference latency, throughput, infrastructure utilization, and operating costs.
- Establish observability for AI applications, including token usage, retrieval quality, latency, failures, and model behavior.
5. Software Engineering and System Architecture
- Develop production-quality applications and APIs using Python and modern backend frameworks.
- Design RESTful APIs, asynchronous processing systems, and microservices where appropriate.
- Integrate AI services with enterprise applications, databases, and third-party systems.
- Use relational databases, vector databases, caching, and distributed systems effectively.
- Apply software engineering best practices, including testing, code reviews, documentation, and design patterns.
6. Security, Quality, and Responsible AI
- Implement safeguards against prompt injection, data leakage, insecure tool execution, and unauthorized access.
- Apply appropriate privacy, security, and compliance controls to AI systems.
- Evaluate hallucinations, bias, reliability, and failure modes.
- Design human-in-the-loop workflows and fallback mechanisms for critical use cases.
7. Technical Leadership and Collaboration
- Lead technical design discussions and mentor junior AI engineers.
- Define engineering standards, coding practices, and AI development guidelines.
- Collaborate with cross-functional teams to deliver measurable business outcomes.
- Conduct code reviews, evaluate emerging technologies, and recommend practical innovations.
- Communicate technical trade-offs and solution architecture to both technical and non-technical stakeholders.
Required Technical Skills
Programming and Backend Development
- Strong proficiency in Python.
- Experience with FastAPI, Flask, or Django.
- Knowledge of REST APIs, asynchronous programming, data structures, algorithms, and software design principles.
- Experience with Git, automated testing, and CI/CD.
AI and Machine Learning
- Strong understanding of supervised and unsupervised learning, model evaluation, and statistical concepts.
- Hands-on experience with PyTorch, TensorFlow, or scikit-learn.
- Knowledge of NLP, embeddings, transformers, and deep learning fundamentals.
Generative AI and LLMs
- Hands-on experience building production applications using LLM APIs or open-source models.
- Strong understanding of RAG architecture, embeddings, chunking, reranking, and retrieval evaluation.
- Experience with vector databases such as Pinecone, Weaviate, Qdrant, Milvus, or pgvector.
- Familiarity with orchestration frameworks such as LangChain, LangChain, or comparable tools.
- Experience with tool calling, structured generation, agent workflows, and LLM evaluation.
Cloud and Infrastructure
- Experience with AWS, Azure, or Google Cloud.
- Working knowledge of Docker and Kubernetes.
- Familiarity with model serving, scalable APIs, monitoring, and production deployments.
- Experience with MLOps or LLMOps practices.
Databases and Data Processing
- Strong SQL skills and experience with relational databases.
- Familiarity with NoSQL databases, data pipelines, and distributed processing.
- Experience working with unstructured data, document ingestion, and retrieval systems.
Preferred Qualifications
- Experience with fine-tuning, quantization, or serving open-source LLMs.
- Experience with multimodal AI, including text, image, audio, or video.
- Knowledge of agent evaluation, workflow orchestration, and multi-agent systems.
- Experience with AI security, guardrails, governance, and responsible AI.
- Experience optimizing AI workloads for latency, scalability, and cost.
- Contributions to open-source AI projects, research, or technical publications.
Education
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Equivalent practical experience and demonstrated engineering expertise may be considered.
Key Success Metrics
- Quality, accuracy, and reliability of deployed AI solutions.
- Production adoption and measurable business impact.
- Reduction in inference costs and response latency.
- RAG retrieval quality and reduction in unsupported or incorrect responses.
- System availability, scalability, and operational stability.
- Delivery timelines, code quality, and technical mentoring effectiveness.
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI
- Strong hands-on experience in Microsoft Azure Cloud.
- Good understanding of Azure services such as Compute, Storage, Event Hub, Event Subscription, Storage Queue, and PaaS services.
- Basic understanding of Azure AI Foundry and AI-related Azure service setup.
- Good Azure networking basics: VNet, subnet, routing, and basic troubleshooting.
- Strong knowledge of Terraform, especially:
- Terraform state
- plan / apply
- troubleshooting failures
- migration risks
- Terraform Enterprise concepts
- Strong Python coding capability, not just basic scripting.
- Experience using Python for API integration, automation, JSON/YAML handling, and internal tooling.
- Good understanding of CI/CD pipelines.
- Ability to troubleshoot pipeline failures.
- Comfortable with YAML and JSON.
- Ability to troubleshoot Azure infrastructure/platform issues.
- Ability to collect logs/evidence and coordinate with network/app/Microsoft support teams.
- Basic awareness of agentic AI / LLM concepts.
- Awareness of security and cost best practices.
Good to Have Skills
- Hands-on experience with Harness.
- Hands-on experience with Terraform Enterprise.
- Exposure to LangGraph / LangChain.
- Exposure to agentic AI workflows or skill creation.
- Exposure to Claude or enterprise LLM integrations.
- Knowledge of Azure ML Workspace, model registry, and managed endpoints.
- MLOps / LLMOps knowledge.
- FinOps / Azure cost optimization experience.
- Azure certifications: AZ-104, AZ-305, AZ-400, AZ-500.
Screening Priority:
Azure Cloud + Terraform + Python Coding + CI/CD Troubleshooting + YAML/JSON + Basic Agentic AI Awareness
Solid product experience and an educational background from Tier‑1 universities are preferred.
As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities.
In this role, you will:
- Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance.
- Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features.
- Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability.
- Work with SQL and NoSQL databases to implement efficient data models and service access patterns.
- Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs).
- Use AI powered engineering tools to improve development quality, speed, and productivity.
- Mentor engineers, supporting them in technical planning, implementation, and best practices.
- Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure.
- Write unit and integration tests and participate in code reviews to uphold engineering excellence.
- Investigate production issues, ensuring timely and effective solutions.
- Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies.
Who You’ll Work With
You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction.
What Makes You a Qualified Candidate
(Nonnegotiable qualifications)
- Bachelor’s degree in Computer Science or equivalent from a recognized institution.
- 5+ years of experience in backend services, distributed systems, or data platform development.
- Strong proficiency in Java, Go, or Python for service development.
- Good understanding of design principles, distributed system patterns, and service framework.
- Hands-on experience designing and developing RESTful APIs.
- Experience with SQL and NoSQL databases and data modelling.
- Strong debugging, problem solving, and troubleshooting skills.
- Experience with modern containerization and orchestration tools such as Kubernetes.
- Knowledge of public cloud platforms.
- Experience with AI productivity tools (e.g., GitHub Copilot).
- Ability to work independently, drive workstreams, and deliver high quality outcomes.
- Strong communication and collaboration skills.
What You’ll Bring
(Preferred qualifications)
- Familiarity with messaging systems such as Kafka.
- Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs.
- A track record of influencing design decisions and driving engineering best practices.
- The ability to mentor engineers and guide them through design, planning, and execution.
- A proactive mindset and comfort working in fast paced, dynamic environments.
- Curiosity, adaptability, and a passion for building impactful AI-driven products.
Required Skills & Qualifications
- Experience: 10+ years in Cloud Engineering, Infrastructure, or DevOps, with strong hands-on GCP experience.
- GCP Expertise: GKE, Compute Engine, IAM, VPC, Cloud Storage, Cloud SQL, Cloud Run, Cloud Functions, and Load Balancing.
- Kubernetes & Containers: GKE, Docker, Kubernetes networking, Helm, and troubleshooting.
- DevOps & IaC: Azure DevOps, Terraform, CI/CD pipelines, and infrastructure automation.
- Scripting: Python, Bash, or PowerShell.
- Security & Operations: Cloud security, IAM, monitoring, incident management, and cost optimization.
- Leadership & Ownership: Proven experience in team leadership, cross-functional collaboration, stakeholder management, managing multiple product-line deliverables, and handling competing priorities and ad hoc requests.
- Additional Advantage: Experience with Microsoft Azure.

Job Summary
We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.
Key Responsibilities
- Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
- Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
- Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
- Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
- Integrate AI/ML models with enterprise applications and APIs.
- Fine-tune and evaluate ML/LLM models based on business requirements.
- Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
- Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
- Conduct model performance evaluation, optimization, and troubleshooting.
- Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
- Stay current with emerging AI/ML technologies, frameworks, and industry best practices.
Required Skills
- Strong programming experience in Python.
- Strong understanding of Machine Learning algorithms, statistics, and data structures.
- Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
- Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
- Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
- Experience with NLP, deep learning, or computer vision is an advantage.
- Experience developing and consuming REST APIs and microservices.
- Working knowledge of SQL and NoSQL databases.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Understanding of Docker, Kubernetes, CI/CD, and MLOps.
- Familiarity with Git and modern software development practices.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
- 4 years of relevant experience in AI/ML engineering or a related field.
- Experience building and deploying production-grade AI/ML solutions.
- Enterprise application development experience.
- Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
- Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
- Experience with AI/ML model monitoring, evaluation, and optimization.
What You Bring
- Strong problem-solving and analytical skills.
- Ability to translate business requirements into practical AI/ML solutions.
- Strong software engineering and debugging capabilities.
- Ability to work independently as well as collaboratively in a cross-functional environment.
- Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.
Keywords
AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI
Location: Gurugram
Work mode: Hybrid
Hiring for AI Engineer
Exp: 5 - 8 yrs
Edu : BE/B.Tech/MCA
Work Location : Pune
Skill Set:
Total experience ranging from 5 - 8 years in software engineering/AI roles
Min 5 years strong programming experience in Python or Typescript is a MUST
Min 2.5 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks
Experience with cloud platforms (AWS/Azure/GCP)









