AppSec/ AI Engineer

Responsibilities

• Execute and support application vulnerability assessments (SAST, DAST, SCA, and manual code review), ensuring findings are accurate, actionable, and relevant to application risk.
• Validate scanner results, perform false-positive analysis, and track findings through remediation, including retesting to confirm effective fixes.
• Manage multiple application security initiatives concurrently while meeting strict timelines in a fast‑paced environment.
• Prioritize vulnerabilities based on business impact, exploitability, exposure, and likelihood, using industry best practices (e.g., CVSS scoring).
• Develop and maintain dashboards and reports tracking vulnerability metrics such as severity distribution, remediation SLAs, and mean time to remediation (MTTR).
• Support the integration of security scanning and vulnerability workflows into CI/CD pipelines, leveraging existing tooling and automation.
• Facilitate remediation planning by providing actionable recommendations and coordinating root cause analysis.
• Support threat modeling and application risk assessments, with a focus on discovering insecure design patterns.
• Participate in high‑severity or zero‑day vulnerability response activities, including impact analysis and coordinated remediation efforts, as needed.
• Provide input into policies and standards related to application and cloud security controls.

Qualifications and Education Requirements

• Bachelor’s degree in information technology, Cybersecurity, Computer Science, or related discipline—or equivalent professional experience.
• 5-7 years of relevant experience in application security and/or vulnerability management.
• Solid understanding of common vulnerability classes (e.g., OWASP Top 10) and secure architecture principles.
• Proficiency in using Burp Suite for manual security testing of web applications and APIs, including validation of automated findings and identification of complex authentication, authorization, and business‑logic vulnerabilities.
• Hands-on experience with tools such as Burp Suite, Fortify, Checkmarx, SonarQube, Black Duck, Tenable, and common network discovery tools (e.g., Nmap).
• Familiarity with NIST, MITRE ATT&CK, and CIS benchmarks.
• Programming/scripting proficiency in languages such as Python, Java, .NET, or similar.
• Excellent documentation, communication, and stakeholder engagement skills.

Desired Skills

• Professional certifications (e.g., Security+, SSCP, GWAPT, or pursuing CISSP, OSCP).
• Experience using the ServiceNow platform for vulnerability or incident tracking.
• Proficiency in Azure cloud and Azure DevOps environments.
• Experience using Power BI or similar tools to visualize vulnerability metrics and remediation trends for technical and non-technical stakeholders.

Cybersecurity Engineer – AI Training Project

About the Opportunity

We’re looking for experienced Cybersecurity Engineers to contribute technical expertise to a customer project focused on improving the capabilities of next-generation AI systems.

In this role, you’ll use your real-world experience in cybersecurity, software engineering, vulnerability assessment, and secure development to create high-quality technical inputs that help AI systems better understand, debug, secure, and reason about complex software.

What You’ll Do

• Analyze, debug, and resolve software bugs, vulnerabilities, and security issues across complex codebases.
• Review source code and identify potential security weaknesses, vulnerabilities, and attack vectors.
• Perform security assessments, vulnerability assessments, penetration testing, and codebase audits.
• Develop and modify software using languages such as Python, Java, Rust, Go, C++, or TypeScript.
• Implement new features and fix existing functionality while maintaining strong security and engineering standards.
• Refactor legacy code to improve security, maintainability, reliability, and performance.
• Work on backend systems and help optimize applications for scalability, performance, and security.
• Analyze real-world security scenarios and translate your expertise into high-quality technical examples and problem-solving tasks.
• Document technical findings, vulnerabilities, debugging approaches, and recommended solutions.
• Provide domain expertise that helps improve how AI systems reason about software engineering and cybersecurity problems.

What We’re Looking For

• Strong professional experience in Cybersecurity / Application Security / Product Security / DevSecOps / Penetration Testing / Vulnerability Management.
• Strong programming experience in one or more of:
• Python
• Java
• Rust
• Go
• C++
• TypeScript
• Proven experience with debugging, troubleshooting, and fixing complex software issues.
• Hands-on experience with penetration testing, vulnerability assessment, security auditing, or application security.
• Understanding of secure software development practices and modern security threats.
• Strong knowledge of data structures, algorithms, software architecture, and code quality.
• Ability to review unfamiliar codebases and quickly understand how systems work.
• Strong written communication and the ability to explain complex technical findings clearly.

Nice to Have

• Experience with OWASP, API security, cloud security, DevSecOps, or threat modeling.
• Experience performing security assessments on production applications or enterprise systems.
• Experience with tools such as Burp Suite, Metasploit, Nmap, Wireshark, SAST/DAST tools, or vulnerability scanners.
• Contributions to open-source security or software projects.
• Experience working with AI/ML systems, LLMs, data annotation, or AI training projects.
• Relevant security certifications such as OSCP, OSWE, CEH, CISSP, Security+, or equivalent practical experience.

Engagement

• Role: Cybersecurity Engineer
• Work: Remote(Contract)
• Experience: Mid-level to Senior
• Programming: Required
• Cybersecurity expertise: Required

Why Join?

This is an opportunity to apply your existing cybersecurity expertise to an emerging area of technology. Your practical experience debugging software, identifying vulnerabilities, securing applications, and solving complex engineering problems will directly contribute to improving the capabilities of next-generation AI systems.

If you enjoy breaking down complex technical problems, finding vulnerabilities, fixing software, and thinking deeply about how systems work, this project could be a strong fit.

Cyber Security Expert

We are seeking a highly skilled Cyber Security Expert with strong expertise in AI-driven

security tools and ethical hacking techniques. The ideal candidate will safeguard our digital

infrastructure, proactively identify vulnerabilities, and design intelligent defense mechanisms

against evolving cyber threats.

Key Responsibilities

• Threat Analysis: Identify, assess, and mitigate potential risks across systems and

networks.

• AI Security Tools: Deploy and manage AI-based solutions for intrusion detection,

anomaly monitoring, and predictive threat modelling.

• Ethical Hacking: Conduct penetration testing, simulate cyber-attacks, and recommend

remediation strategies.

• Incident Response: Lead investigations, contain breaches, and implement recovery

measures.

• Compliance & Governance: Ensure adherence to data protection laws, industry

standards, and organizational policies.

• Training & Awareness: Educate employees on best practices and emerging threats.

Required Skills & Qualifications

• Proven hands-on experience with AI-powered security platforms (e.g., SIEM, SOAR,

ML-based anomaly detection).

• Strong knowledge of ethical hacking tools (Metasploit, Burp Suite, Kali Linux, etc.).

• Expertise in network security, firewalls, IDS/IPS, and endpoint protection.

• Familiarity with cloud security (AWS, cloud platform).

• Proficiency in scripting languages (Python, Bash, PowerShell) for automation.

• Solid understanding of cryptography, authentication protocols, and secure coding

practices.

Job Title : Senior AWS DevSecOps & AI Platform Engineer

Experience Required : 5+ Years in AWS / Cloud Engineering

Terraform Experience : 4+ Years

Location : Gurugram

Work Mode : Onsite

Employment Type : Full-time

About the Role :

We are looking for an experienced Senior AWS DevSecOps & AI Platform Engineer with strong expertise in AWS cloud infrastructure, Kubernetes, Infrastructure as Code (IaC), CI/CD automation, cloud security, and database administration.

The ideal candidate will be responsible for designing and maintaining secure, scalable, reliable, and cost-efficient cloud environments while supporting microservices-based applications and implementing DevSecOps best practices. The role also involves building and deploying AI agents using Amazon Bedrock and Bedrock AgentCore, along with managing enterprise development and collaboration tools.

Mandatory Skills :

AWS (EC2, EKS, ECS, Lambda, S3, CloudWatch), Kubernetes, Terraform, Jenkins, Bitbucket Pipelines, CI/CD, DevSecOps, AWS Security Services (IAM, WAF, GuardDuty, Security Hub, KMS, Secrets Manager), Microservices, Helm, PostgreSQL, Oracle SQL, RDS, Jira, Confluence, Amazon Bedrock, Bedrock AgentCore, AWS Networking, and Cloud Cost Optimization.

Key Responsibilities :

• AWS Cloud Infrastructure : Design, implement, and maintain AWS infrastructure with a focus on scalability, availability, security, reliability, and cost optimization.
• Microservices & Containerization : Manage and support distributed microservices architectures, including deployment, monitoring, troubleshooting, performance optimization, service meshes, and API gateways.
• Kubernetes Administration : Administer and optimize Kubernetes clusters, including Amazon EKS and self-managed environments, covering upgrades, networking, workload management, scaling, and resource optimization.
• Cloud Security & Compliance : Implement and manage AWS security services, including IAM, GuardDuty, Security Hub, WAF, KMS, Secrets Manager, AWS Config, and CloudTrail.
• DevSecOps Implementation : Integrate security testing, vulnerability scanning, container security, and compliance-as-code tools into CI/CD pipelines.
• CI/CD & Source Control : Manage Bitbucket repositories, branching strategies, permissions, and Bitbucket Pipelines. Build and optimize Jenkins pipelines using declarative and scripted approaches.
• Infrastructure as Code : Develop and maintain Terraform modules, manage remote state and workspaces, detect infrastructure drift, and implement reusable infrastructure provisioning practices.
• Database Administration : Provision, manage, secure, and optimize AWS RDS databases, particularly PostgreSQL and Oracle, including backups, replication, patching, performance tuning, and migrations.
• Jira & Confluence Administration : Manage projects, workflows, automation rules, permissions, user access, spaces, schemes, and plugins.
• Monitoring & Reliability : Define and monitor SLIs, SLOs, and SLAs; implement observability best practices; and participate in incident management, root cause analysis, and post-incident reviews.
• AI Agent Development : Design, build, and deploy AI agents using Amazon Bedrock and Bedrock AgentCore, including agent runtime, memory, tools, gateway integration, identity and access management, guardrails, and lifecycle management across environments.
• Cloud Connectivity : Support hybrid cloud connectivity using AWS Direct Connect, VPN, and Transit Gateway.
• Cost Optimization : Apply FinOps practices to monitor cloud expenditure, optimize resource utilization, and improve infrastructure efficiency.
• API Integrations : Integrate third-party APIs while implementing authentication, rate limiting, error handling, and webhook management.

Required Skills & Qualifications :

• 5+ years of hands-on experience with AWS cloud services, including EC2, ECS, EKS, Lambda, ALB, CDN, S3, CloudWatch, Amazon Bedrock, and Bedrock AgentCore.
• Strong understanding of AWS networking, multi-account strategies, landing zone architecture, and hybrid connectivity.
• 4+ years of practical experience with Terraform, including module development, remote state management, workspaces, drift detection, and state operations.
• Extensive experience administering Kubernetes, preferably Amazon EKS, including Helm, Kustomize, operators, RBAC, network policies, autoscaling, and multi-tenancy.
• Proven experience managing distributed microservices, service meshes, API gateways, and inter-service communication.
• Strong knowledge of AWS security services, including IAM, Service Control Policies (SCPs), WAF, KMS, Secrets Manager, AWS Config, and CloudTrail.
• Experience implementing least-privilege access, zero-trust principles, and cloud security compliance controls.
• Hands-on experience integrating DevSecOps tools such as Snyk, Trivy, Checkov, and SonarQube into CI/CD pipelines.
• Understanding of OWASP security principles, CIS benchmarks, vulnerability management, and container security.
• Proficiency in Bitbucket repository administration, branch permissions, and YAML-based Bitbucket Pipelines.
• Strong experience developing and maintaining Jenkins CI/CD pipelines, shared libraries, plugins, and build agents.
• Experience administering AWS RDS databases, particularly PostgreSQL and Oracle SQL, including backup, replication, performance tuning, and migration activities.
• Experience administering Jira and Confluence, including workflows, permissions, automation, and plugin management.
• Working knowledge of Azure services, particularly Web Apps and Logic Apps/Workflows.
• Practical experience with Amazon Bedrock, including model invocation, guardrails, and AI agent development and deployment using Bedrock AgentCore.
• Understanding of third-party API integration, authentication mechanisms, rate limiting, error handling, and webhook management.
• Familiarity with FinOps practices and cloud cost optimization.

Good-to-Have Skills :

• Additional Azure experience, including networking, Azure SQL Managed Instance, and Azure Kubernetes Service (AKS).
• Hands-on experience with AI-driven Development Lifecycle (AI-DLC) methodologies and tools such as Kiro.

Relevant certifications, such as :

• AWS Certified Solutions Architect
• AWS Certified DevOps Engineer – Professional
• AWS Machine Learning or Generative AI certifications
• Certified Kubernetes Administrator (CKA)
• HashiCorp Terraform certifications

Ideal Candidate Profile :

The ideal candidate is a hands-on cloud and DevSecOps professional who can manage enterprise-scale AWS infrastructure, automate deployments, strengthen security controls, troubleshoot complex distributed systems, and support AI agent development. Strong problem-solving skills, an automation-first mindset, and the ability to collaborate across development, security, and infrastructure teams are essential.

A BIT ABOUT US

Appknox is one of the top Mobile Application security companies recognized by Gartner and G2. A profitable B2B SaaS startup headquartered in Singapore & working from Bengaluru.

The primary goal of Appknox is to help businesses and mobile developers secure their mobile applications with a focus on delivery speed and high-quality security audits.

Appknox has helped secure mobile apps at Fortune 500 companies with major brands spread across regions like India, South-East Asia, Middle-East, US, and expanding rapidly. We have secured 300+ Enterprises globally.

We are a 65+ incredibly passionate team working to make an impact and helping some of the biggest companies globally. We work in a highly collaborative, very fast-paced work environment. If you have what it takes to be part of the team, we are excited and let’s speak further.

The Opportunity

To join the security team engaging with multiple clients, helping them with end to end security audits, also research about new topics and vulnerabilities to be added to the scanner, present it in conferences.

What An Ideal Candidate Would Look Like: 

• Skills - Application Penetration Testing (Web, iOS and Android), experience with IoT testing, source code audits.
• Technology Stack: AWS, GCP, Objective C, Java, Python
• Responsibilities: Engage with clients for scoping call, perform security audits, remediation call with clients to patch the issues, research on new technologies/vulnerabilities

Minimum Requirements

• 2-4+ years of experience in application security and vulnerability research
• Strong foundation in mobile app security - Android or Ios
• Proven track record of discovering and disclosing CVEs in mobile platforms or popular applications (provide - github/bug bounty profiles)
• Strong understanding of exploit mitigations and proven ability to bypass them
• Should be able to architect automated detection logic for new vulnerabilities and integrate them into our security products
• Develop AI-driven agents to automate dynamic analysis
• Should be able to Leverage AI/LLMs to augment Pentesting efforts
• Ability to work independently in a fast-paced environment, balancing deep research with practical deliverables

Good to have Requirements

• Understanding of AI/ML security risks

Responsibilities

• Security assessment of web/mobile applications on various platforms
• Focusing on Mobile Application Security Research for new vulnerabilities
• Static and Dynamic Code Analysis
• Develop and interpret security standards and guides
• Automation of exploit development 
• Understand and explain the results with impact on business and compliance status
• Continuously learning and training on latest tools and technique

Work Expectations

Within 1 month

Training on processes, security workflows and develop understanding on internal tools.

Within 3 months

Actively contributing in exploit development and automation of it with the team.

Within 6 months

Expected to achieve Subject Matter Expert status on our core security products. We expect you to validate your findings against real-world conditions, with a strong emphasis on translating internal discoveries into actionable bug bounty submissions and earned CVEs to benchmark your impact against the external security community.

Within 1 Year

By the end of your first year, you will be expected to produce and submit a piece of novel, peer-reviewed security research. This deliverable must be of a quality suitable for top-tier industry conferences.

Personality traits we really admire

• A confident and dynamic working persona, which can bring fun to the team, and a sense of humour, is an added advantage.
• Great attitude to ask questions, learn and suggest process improvements.
• Has attention to details and helps identify edge cases.
• Highly motivated and coming up with fresh ideas and perspectives to help us move towards our goals faster.
• Follow timelines and absolute commitment to deadlines.

Interview Process - would be team specific

• Round 1- CTF round 
• Round 2 -Profile Evaluation; HR
• Round 3 -Technical Interview with security team members
• Round 4 -Technical Interview with the Hiring Manager
• Round 5 -Technical round with CTO
• Round 6 -HR Round

Compensation

• As per Industry Standards

Why Join Us

• Freedom & Responsibility: If you are a person who enjoys challenging work & pushing your boundaries, then this is the right place for you. We appreciate new ideas & ownership as well as flexibility with working hours.
• Great Salary & Equity: We keep up with the market standards & provide pay packages considering updated standards. Also as Appknox continues to grow, you’ll have a great opportunity to earn more & grow with us. Moreover, we also provide equity options for our top performers.
• Holistic Growth: We foster a culture of continuous learning and take a much more holistic approach to train and develop our assets: the employees. We shall also support you all on that journey of yours.
• Transparency: Being a part of a start-up is an amazing experience, one of the reasons being open communication & transparency at multiple levels. Working with Appknox will give you the opportunity to experience it all first-hand.

About the team

SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.

About the Role

We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.

You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.

What You’ll Do

●    Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.

●    Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.

●    Performing functional, regression, performance, scalability and security testing to identify bugs or defects.

●    Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.

●    Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.

●    Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.

●    Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.

●    Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.

●    Ensuring the software meets customer and business requirements by validating the functionality and performance.

●    Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.

●    Supporting user acceptance testing (UAT) and assisting clients with product validation.

●    Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.

Required Experience

●    A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.

●    8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.

●    Expertise in manual and automated testing.

●    Deep domain expertise in complex system validation and advanced automation practices at scale.

●    Proficiency in programming languages like Python to build and run automated test scripts.

●    "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."

●    Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.

●    Strong communication skills for documenting test results and interacting with cross-functional teams.

●    Excellent analytical skills, attention to detail, and problem-solving ability.

●    Ability to work independently as well as collaboratively in a team environment.

●    A curious mindset with a willingness to quickly learn new technologies and testing tools.

Required Skills & Qualifications

●    Familiarity with cloud-based testing environments (GCP, AWS, Azure).

●    Experience with cybersecurity products or cloud services or IDP or Web UI

The Mindset

●    Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.

●    Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.

●    Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.

●    Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.

At Shipthis, we are building a better future for freight forwarders by evolving traditional operations into fully digital, efficient, and scalable systems. We’re a fast-growing product company where every individual has the opportunity to take ownership, move fast, and create real impact. If you enjoy solving complex problems, shaping products from the ground up, and influencing technical direction, Shipthis is the place for you.

Learn more at www.shipthis.co

Role Overview

We are looking for an associate-level SecOps Engineer to support security operations, compliance, endpoint management, cloud infrastructure, and DevOps engineering. The role will work closely with the CTO/CISO and engineering team. Security and compliance are core responsibilities; when those priorities are lighter, the engineer will focus on CI/CD, infrastructure automation, reliability, monitoring, performance, and cloud cost optimization.

What You’ll be Doing

Security Operations

• Monitor infrastructure, application, and security alerts and assist with incident investigation.
• Review access controls, privileged accounts, service accounts, permissions, and periodic access reviews.
• Support infrastructure hardening, logging, monitoring, backup, recovery, and other security controls.
• Track security issues and corrective actions through closure.

Vulnerability Management

• Run and review application and infrastructure vulnerability scans.
• Maintain a vulnerability register and coordinate remediation with engineering teams.
• Support VAPT and penetration-testing exercises and validate closure of findings.
• Monitor dependencies, containers, operating systems, and cloud infrastructure for known vulnerabilities and patching needs.

Compliance & Governance

• Support ongoing ISO/IEC 27001, SOC 2, GDPR, customer-security, and internal-policy requirements.
• Maintain audit evidence, control registers, security policies, procedures, risk items, and remediation records.
• Assist with internal/external audits, vendor assessments, customer security questionnaires, and asset inventories.
• Maintain evidence for access reviews, vulnerability management, incidents, onboarding/offboarding, backups, and infrastructure changes.

MDM & Endpoint Security

• Administer the company MDM platform and enroll/manage company laptops, desktops, and mobile devices.
• Maintain device inventory and monitor endpoint compliance.
• Enforce approved controls such as disk encryption, screen locks, password requirements, patching, and endpoint protection.
• Support employee device onboarding/offboarding, approved application deployment, lost/stolen-device procedures, and remote wipe where authorized.
• Maintain endpoint security and MDM evidence required for audits and troubleshoot enrollment or policy issues.

DevOps, CI/CD & Cloud

• Maintain and improve CI/CD pipelines, deployment workflows, build times, caching, and rollback processes.
• Support production and non-production cloud infrastructure, networking, DNS, TLS certificates, IAM, and secrets.
• Automate repetitive deployment, infrastructure, security, and compliance tasks.
• Improve monitoring, logging, alerting, reliability, resource utilization, and cloud costs.
• Troubleshoot pipeline, deployment, and infrastructure issues and participate in root-cause analysis.

Required Fundamentals

• Basic knowledge of Linux, networking, HTTP/HTTPS, DNS, TLS, Git, Docker, cloud computing, APIs, and web applications.
• Understanding of IAM, MFA, least privilege, vulnerabilities/CVEs, encryption, logging, patching, and secrets management.
• Strong troubleshooting, ownership, attention to detail, and willingness to learn.

Desired Qualifications

• 1–2 years of experience with strong fundamentals are welcome.
• Basic scripting knowledge in Python, Bash, or similar.
• Interest in cybersecurity, cloud infrastructure, automation, and troubleshooting.
• Exposure to AWS/GCP/Azure, Terraform, GitHub Actions, Cloudflare, OWASP, vulnerability scanners, MDM, ISO 27001, or SOC 2 is a plus, not mandatory.

We Welcome Candidates:

• Who can join immediately
• Female candidates returning to work after a career break are strongly encouraged.

We are an equal opportunity employer and are committed to fostering diversity and inclusivity. We do not discriminate based on race, religion, color, gender, sexual orientation, age, marital status, or disability status.

Job Synopsys

Location: Bangalore

Job Type: Full-time, Permanent

Experience: 1-2 years

Industry: Software Product

Key Responsibilities

• Automate application deployments from Bitbucket to servers using CI/CD pipelines.
• Design and manage scalable, highly available AWS infrastructure.
• Implement Auto Scaling, ELB, and Route 53 for traffic management and high availability.
• Work with AWS services including IAM, RDS, DynamoDB, EC2, and other cloud services.
• Build and manage Docker containers and server images.
• Deploy and manage applications using Kubernetes.
• Implement Infrastructure as Code using Terraform, CloudFormation, or Ansible.
• Develop automation scripts using Python and Bash.
• Implement monitoring and logging using tools such as Prometheus, Grafana, and ELK.
• Integrate security and compliance practices into CI/CD pipelines.
• Optimize infrastructure for security, scalability, performance, and cost.

Required Skills

• 3+ years of experience in DevOps or a similar role.
• Strong knowledge of AWS beyond EC2.
• Hands-on experience with Jenkins or similar CI/CD tools.
• Experience with Docker and Kubernetes.
• Good understanding of Terraform/IaC and automation.
• Proficiency in Python and/or Bash scripting.
• Knowledge of DevSecOps, security, and compliance best practices.
• Strong troubleshooting and problem-solving skills.

Principal Software Engineer

Location: Bangalore India

Department: AI Engineering / Quality Assurance

Experience Level: Mid to Senior

We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.

Key Responsibilities

• Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
• Develop comprehensive test suites, including:
• Unit, integration, and end-to-end (E2E)
• Functional, regression, performance, and safety testing
• Validate AI system behavior, including:
• Non-deterministic LLM outputs
• Hallucinations and edge cases
• Multi-step agent decision-making
• Design and manage evaluation systems:
• Golden datasets
• Benchmarking pipelines (accuracy, latency, reliability)
• Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
• Implement observability and telemetry to enable traceability, monitoring, and audit readiness
• Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
• Track and report quality KPIs, including test coverage, defect leakage, and system reliability
• Drive root-cause analysis and continuous improvement across the AI testing lifecycle

Required Skills

Core Engineering

• Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
• Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
• Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
• Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)

AI / ML & Agentic Systems

• Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
• Familiarity with:
• RAG architectures and vector databases (Pinecone, Weaviate)
• Agent frameworks (LangChain, LlamaIndex, AutoGen)

AI Testing Techniques

• Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
• Knowledge of evaluation methods:
• LLM-as-a-judge
• BLEU, ROUGE, semantic similarity scoring
• Experience with prompt and agent regression testing
• Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection

Tooling (Preferred)

• AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
• Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
• Monitoring: Prometheus, Grafana, OpenTelemetry

Soft Skills

• Strong analytical and problem-solving skills
• Excellent communication and cross-functional collaboration
• Data-driven mindset with focus on quality KPIs
• Detail-oriented with a strong bias toward automation and scalability

Experience Requirements

• 7+ years in QA, SDET, or test automation engineering
• Proven experience building and scaling automation frameworks
• Hands-on experience with AI/ML systems or LLM-based applications
• Experience testing RAG pipelines or agentic workflows
• Owned end-to-end AI test strategy and architecture
• Defined quality metrics and release gates
• Delivered scalable validation pipelines for production AI systems
• Supported audit and compliance readiness

Preferred

• Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
• Exposure to:
• Shift-left testing practices
• Production observability and monitoring
• Chaos or resilience testing

Senior-Level Differentiators

Education

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field

Nice-to-have:

• ISTQB certification
• Cloud/ML certifications (AWS, Azure, GCP)
• AI testing certifications

What Success Looks Like

• AI systems that are accurate, reliable, and safe
• Fully automated test pipelines integrated into CI/CD
• Measurable improvements in defect leakage and model quality
• Strong observability and auditability across AI systems
• Scalable validation frameworks supporting rapid AI innovation

• Strong hands-on experience in Microsoft Azure Cloud.
• Good understanding of Azure services such as Compute, Storage, Event Hub, Event Subscription, Storage Queue, and PaaS services.
• Basic understanding of Azure AI Foundry and AI-related Azure service setup.
• Good Azure networking basics: VNet, subnet, routing, and basic troubleshooting.
• Strong knowledge of Terraform, especially:
• Terraform state
• plan / apply
• troubleshooting failures
• migration risks
• Terraform Enterprise concepts
• Strong Python coding capability, not just basic scripting.
• Experience using Python for API integration, automation, JSON/YAML handling, and internal tooling.
• Good understanding of CI/CD pipelines.
• Ability to troubleshoot pipeline failures.
• Comfortable with YAML and JSON.
• Ability to troubleshoot Azure infrastructure/platform issues.
• Ability to collect logs/evidence and coordinate with network/app/Microsoft support teams.
• Basic awareness of agentic AI / LLM concepts.
• Awareness of security and cost best practices.

Good to Have Skills

• Hands-on experience with Harness.
• Hands-on experience with Terraform Enterprise.
• Exposure to LangGraph / LangChain.
• Exposure to agentic AI workflows or skill creation.
• Exposure to Claude or enterprise LLM integrations.
• Knowledge of Azure ML Workspace, model registry, and managed endpoints.
• MLOps / LLMOps knowledge.
• FinOps / Azure cost optimization experience.
• Azure certifications: AZ-104, AZ-305, AZ-400, AZ-500.

Screening Priority:

Azure Cloud + Terraform + Python Coding + CI/CD Troubleshooting + YAML/JSON + Basic Agentic AI Awareness