AI Red-Teamer — Adversarial AI Testing (Advanced); English & Hindi

Job Title: AppSec / AI Security Engineer

Employment Type: Full-time/ Permanent

Location: Indore (Work from Office)

About the Role

We're embedding security and AI governance into the core of our software development lifecycle. This role owns the design and implementation of automated security scanning, code provenance, and governance processes to ensure AI-generated code meets the highest security and compliance standards.

If you're a self-driven engineer who enjoys building security automation from the ground up and weaving security seamlessly into development pipelines, this role is for you.

Key Responsibilities

• Build and integrate security controls into CI/CD pipelines — including automated scanning for source code, dependencies, secrets, and Infrastructure as Code (IaC) — with enforcement gates on every merge.
• Design and implement code provenance tracking to capture AI-generated code, the AI models used, and reviewer approvals as part of the development pipeline.
• Develop structured code review workflows incorporating specifications, scan results, and code provenance.
• Optimize security scanning tools to reduce false positives and drive developer adoption.
• Investigate and manage security findings using established remediation and documentation processes.
• Contribute to AI governance standards, including secure usage of AI tools and governance of AI-generated code.
• Conduct independent security reviews of internally developed, third-party, and vendor-supplied code to ensure compliance with security standards.

Required Skills & Experience

• Strong hands-on experience in Application Security, with proven expertise securing CI/CD pipelines.
• Experience implementing automated security scanning and enforcement — not just operating existing tools.
• Strong knowledge of SAST, SCA, secret scanning, DAST, and IaC security scanning.
• Strong understanding of cloud infrastructure, with hands-on or working knowledge of AWS and Azure, is preferred.
• Ability to design, build, and own security automation and governance solutions from the ground up.
• Strong judgment in balancing security with developer productivity by minimizing unnecessary alerts.
• Excellent communication skills, with the ability to explain security risks in clear, business-friendly language.
• Strong analytical mindset and ability to independently assess security risk across internal and external codebases.

Preferred Qualifications

• ~4+ years of experience in Application Security, Security Engineering, DevSecOps, or a related field.
• Experience with AI-generated code security, LLM security risks, prompt injection, code provenance, or AI governance.
• Hands-on experience with tools such as Semgrep, CodeQL, Snyk, Gitleaks, TruffleHog, Prowler, Trivy, or similar.
• AWS certification (Solutions Architect Associate preferred), or willingness to obtain one within 90 days.
• Security certifications such as OSCP, GWAPT, CSSLP, or equivalent.
• Experience writing custom detection rules or security policies (e.g., custom Semgrep rules).

About Company:

Five Exceptions Software Solutions Private Limited is an offshore software development company run by a 15+ year experience team. We are a software development team with extensive experience in developing amazing products, websites, and mobile apps. The company has expertise in different technology spectrums. We provide a better work environment to grow technically and professionally.

For more info, please visit our website:  https://5exceptions.com

About Us

We’re building the next generation of AI-powered business software, and we’re looking for people who want to shape that future with us. With Lumen, we’re reimagining how users interact with CRM — moving beyond screens, menus and dashboards to an intelligent interface where users can simply ask AI to take actions, retrieve knowledge, generate insights and get work done. With Agent Studio, we’re enabling businesses to build, test and deploy their own AI agents for real-world workflows. And with Invorto, we’re bringing AI to voice, allowing businesses to create intelligent voice agents tailored to their customer and operational use cases.

What makes this especially exciting is the stage and scale of the opportunity. You’ll get to work on genuinely hard problems across LLMs, agents, reasoning, orchestration, voice AI, evaluation, reliability and enterprise security — not as isolated experiments, but as products used in real business workflows. You’ll have the opportunity to build zero-to-one, own meaningful parts of the product end-to-end, work closely with customers, experiment rapidly, and see your work reach production at scale.

Why join now? Because the playbook for enterprise AI is still being written. You won’t just be implementing someone else’s roadmap — you’ll help define the product, architecture and experiences that become that playbook. Expect high ownership, fast iteration, hard technical and product problems, direct customer impact, and the chance to build AI systems that have to work reliably in the real world — not just in a demo.

About the Role

We are looking for a QA Engineer who specializes in testing agentic AI platforms. You will design and automate quality processes for systems that involve LLMs, autonomous agents, tool use and orchestration across Lumen and Agent Studio — ensuring that AI-driven workflows behave reliably, safely and predictably in production, not just in a demo.

What You’ll Do

• Design and build automated test suites and evaluation frameworks for agentic AI workflows, including multi-step and tool-calling behaviors.
• Use AI/LLM-based QA tools and evaluation frameworks to test model outputs, agent decisions and end-to-end task completion at scale.
• Define quality metrics and benchmarks for agent reliability, correctness, latency and safety, and track them over releases.
• Identify edge cases, failure modes and regressions specific to non-deterministic AI systems, and build automated checks to catch them early.
• Integrate automated agent/LLM testing into CI/CD pipelines to support fast, reliable iteration.
• Partner closely with AI/ML and backend engineers to reproduce issues, root-cause failures and validate fixes.
• Work with customers and customer-facing teams to understand real-world usage patterns and translate them into test scenarios.

What We’re Looking For

• 2–4 years of QA/test automation experience, including hands-on work testing agentic AI or LLM-based platforms.
• Practical experience using AI-focused QA/evaluation tools to test agent behavior, prompts and model outputs.
• Strong scripting/automation skills (Python preferred) to build and maintain test frameworks.
• Understanding of how LLM-based agents work — tool calling, orchestration, memory, reasoning chains — well enough to design meaningful test cases.
• Comfort working with non-deterministic systems and designing evaluation approaches beyond traditional pass/fail testing.
• Strong communication skills — this is a customer-facing role, and you will be expected to clearly articulate technical concepts, decisions and trade-offs to both technical and non-technical stakeholders, including customers.

Good to Have

• Experience testing voice AI or real-time conversational systems.
• Familiarity with CRM or enterprise SaaS platforms.
• Exposure to enterprise security or compliance testing for AI systems.

* Strong practical knowledge and interest in modern AI tools.

* Genuine curiosity and willingness to continuously learn.

* Ability to research, experiment, implement, troubleshoot and improve independently.

* Good understanding of prompting and AI workflows.

* Strong problem-solving mindset.

* Basic understanding of APIs, integrations and automation.

* Ability to explain technology clearly to non-technical people.

* Comfortable using AI to solve real-world business problems.

About the team

SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.

About the Role

We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.

You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.

What You’ll Do

●    Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.

●    Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.

●    Performing functional, regression, performance, scalability and security testing to identify bugs or defects.

●    Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.

●    Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.

●    Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.

●    Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.

●    Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.

●    Ensuring the software meets customer and business requirements by validating the functionality and performance.

●    Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.

●    Supporting user acceptance testing (UAT) and assisting clients with product validation.

●    Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.

Required Experience

●    A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.

●    8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.

●    Expertise in manual and automated testing.

●    Deep domain expertise in complex system validation and advanced automation practices at scale.

●    Proficiency in programming languages like Python to build and run automated test scripts.

●    "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."

●    Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.

●    Strong communication skills for documenting test results and interacting with cross-functional teams.

●    Excellent analytical skills, attention to detail, and problem-solving ability.

●    Ability to work independently as well as collaboratively in a team environment.

●    A curious mindset with a willingness to quickly learn new technologies and testing tools.

Required Skills & Qualifications

●    Familiarity with cloud-based testing environments (GCP, AWS, Azure).

●    Experience with cybersecurity products or cloud services or IDP or Web UI

The Mindset

●    Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.

●    Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.

●    Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.

●    Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.

Location: Hyderabad, India (home base), deployed at client sites in India. Occasional Middle East exposure possible.

About the Role

You will work as a senior AI consultant who embeds inside a customer's business. Your job is to learn how the business makes money, find the highest value problem, and build a working system that solves it.

You will not hand over a document and walk away. You will show working software early, own the roadmap, own the client relationship, and stay after go-live to run and improve the system.

Four behaviors define this role:

1. Go where the work happens. You work onsite with the customer, in the room where decisions are made.
2. Show working software early. You build a prototype in days, not a document in weeks.
3. One person owns the outcome. You are the single point of accountability for the result.
4. Stay after go-live. You keep running and improving the system after launch.

You are the single point of accountability. You are not a solo builder. A full KnackLabs engineering team in Hyderabad builds and runs the production systems behind you.

This role involves extended onsite deployments at client locations in other cities, sometimes up to six months at a stretch. Please apply only if you are ready for this way of working.

What you'll own

1. Discovery - Learn how the customer makes money. Find the highest value problem to solve first.
2. The prototype - Build a working prototype fast, using real or sample data, to prove the idea.
3. The roadmap - Decide what to build, in what order, and set clear success measures tied to business outcomes.
4. The build - Design and ship the production system with the Hyderabad engineering team. This includes data integration, agents, retrieval, and evaluations.
5. The client relationship - Be the trusted technical contact for the customer, from engineers to senior leaders.
6. Go live and after - Deploy the system, watch how it performs, fix problems, and improve it over time.
7. Feedback to the product - Share what you learn in the field so our platform and internal tools get better.

What we are looking for

1. Around 7 or more years of software engineering experience, including customer-facing or client delivery work.
2. Experience working at a consulting or professional services firm in a client-facing delivery role.
3. A full-stack development experience with strength in backend technologies.
4. Strong programming skills in Python. Working knowledge of TypeScript or JavaScript.
5. Production experience with large language models, including prompt engineering and agent development.
6. You build with AI coding tools like Claude Code as your default way of working. You have built real apps and agents this way, not just used it for document generation or review.
7. Experience building retrieval-augmented generation (RAG) systems: chunking, embeddings, vector databases, retrieval, and reranking.
8. Experience building and deploying AI systems.
9. Experience integrating with APIs and enterprise systems.
10. Experience with at least one cloud platform (AWS, Azure, or GCP).
11. Experience building evaluations to measure accuracy, safety, latency, and cost.
12. Clear communication. You can explain a technical choice to an engineer and to a business leader.
13. High ownership and comfort with ambiguity. You can take an unclear problem and turn it into a plan.
14. Willingness to work onsite at client locations in India for extended periods, and to travel as the work needs.

Nice to have

1. Experience deploying AI systems in regulated industries such as insurance, banking, or the public sector.
2. Experience with on-premises or private cloud (VPC) deployments.
3. Experience with observability and tracing tools such as LangSmith or Braintrust.
4. Experience with data engineering and pipelines.
5. A history of side projects, open source contributions, or products you shipped end-to-end.
6. Experience in embedded or forward-deployed roles before.

Stack and tools

1. Languages: Python and TypeScript.
2. Models: Claude and other frontier or open source models, chosen to fit the customer.
3. AI patterns: RAG, agents, prompt engineering, and evaluations.
4. Vector and retrieval: vector databases and retrieval pipelines.
5. Cloud: AWS, Azure, or GCP, on public or private cloud.
6. Integration: REST APIs and enterprise system connectors.

A BIT ABOUT US

Appknox is one of the top Mobile Application security companies recognized by Gartner and G2. A profitable B2B SaaS startup headquartered in Singapore & working from Bengaluru.

The primary goal of Appknox is to help businesses and mobile developers secure their mobile applications with a focus on delivery speed and high-quality security audits.

Appknox has helped secure mobile apps at Fortune 500 companies with major brands spread across regions like India, South-East Asia, Middle-East, US, and expanding rapidly. We have secured 300+ Enterprises globally.

We are a 65+ incredibly passionate team working to make an impact and helping some of the biggest companies globally. We work in a highly collaborative, very fast-paced work environment. If you have what it takes to be part of the team, we are excited and let’s speak further.

The Opportunity

To join the security team engaging with multiple clients, helping them with end to end security audits, also research about new topics and vulnerabilities to be added to the scanner, present it in conferences.

What An Ideal Candidate Would Look Like: 

• Skills - Application Penetration Testing (Web, iOS and Android), experience with IoT testing, source code audits.
• Technology Stack: AWS, GCP, Objective C, Java, Python
• Responsibilities: Engage with clients for scoping call, perform security audits, remediation call with clients to patch the issues, research on new technologies/vulnerabilities

Minimum Requirements

• 2-4+ years of experience in application security and vulnerability research
• Strong foundation in mobile app security - Android or Ios
• Proven track record of discovering and disclosing CVEs in mobile platforms or popular applications (provide - github/bug bounty profiles)
• Strong understanding of exploit mitigations and proven ability to bypass them
• Should be able to architect automated detection logic for new vulnerabilities and integrate them into our security products
• Develop AI-driven agents to automate dynamic analysis
• Should be able to Leverage AI/LLMs to augment Pentesting efforts
• Ability to work independently in a fast-paced environment, balancing deep research with practical deliverables

Good to have Requirements

• Understanding of AI/ML security risks

Responsibilities

• Security assessment of web/mobile applications on various platforms
• Focusing on Mobile Application Security Research for new vulnerabilities
• Static and Dynamic Code Analysis
• Develop and interpret security standards and guides
• Automation of exploit development 
• Understand and explain the results with impact on business and compliance status
• Continuously learning and training on latest tools and technique

Work Expectations

Within 1 month

Training on processes, security workflows and develop understanding on internal tools.

Within 3 months

Actively contributing in exploit development and automation of it with the team.

Within 6 months

Expected to achieve Subject Matter Expert status on our core security products. We expect you to validate your findings against real-world conditions, with a strong emphasis on translating internal discoveries into actionable bug bounty submissions and earned CVEs to benchmark your impact against the external security community.

Within 1 Year

By the end of your first year, you will be expected to produce and submit a piece of novel, peer-reviewed security research. This deliverable must be of a quality suitable for top-tier industry conferences.

Personality traits we really admire

• A confident and dynamic working persona, which can bring fun to the team, and a sense of humour, is an added advantage.
• Great attitude to ask questions, learn and suggest process improvements.
• Has attention to details and helps identify edge cases.
• Highly motivated and coming up with fresh ideas and perspectives to help us move towards our goals faster.
• Follow timelines and absolute commitment to deadlines.

Interview Process - would be team specific

• Round 1- CTF round 
• Round 2 -Profile Evaluation; HR
• Round 3 -Technical Interview with security team members
• Round 4 -Technical Interview with the Hiring Manager
• Round 5 -Technical round with CTO
• Round 6 -HR Round

Compensation

• As per Industry Standards

Why Join Us

• Freedom & Responsibility: If you are a person who enjoys challenging work & pushing your boundaries, then this is the right place for you. We appreciate new ideas & ownership as well as flexibility with working hours.
• Great Salary & Equity: We keep up with the market standards & provide pay packages considering updated standards. Also as Appknox continues to grow, you’ll have a great opportunity to earn more & grow with us. Moreover, we also provide equity options for our top performers.
• Holistic Growth: We foster a culture of continuous learning and take a much more holistic approach to train and develop our assets: the employees. We shall also support you all on that journey of yours.
• Transparency: Being a part of a start-up is an amazing experience, one of the reasons being open communication & transparency at multiple levels. Working with Appknox will give you the opportunity to experience it all first-hand.

Title: AI/ML Test Engineer – GenAI

Location - Mumbai

Technical Skills

• Strong experience in Generative AI, LLMs, and Agentic AI systems

• Hands-on expertise with AI evaluation frameworks (RAGAS, DeepEval, TruLens, LangSmith, Promptfoo, etc.)

• Proficiency in Python and AI/ML development libraries

• Knowledge of Prompt Engineering, prompt testing, and optimization

Ability to define and track evaluation metrics such as accuracy, relevance, groundedness, hallucination rate, latency, and user satisfaction

• Experience in creating automated evaluation pipelines and benchmarking frameworks

• Strong understanding of AI safety, guardrails, bias testing, and responsible AI practices

• Familiarity with REST APIs, JSON, vector databases, and knowledge retrieval systems

• Experience in A/B testing, human-in-the-loop evaluation, and red teaming

• Strong experience in Manual Testing of AI/GenAI applications, including functional, exploratory, UAT, regression, and end-to-end testing

• Expertise in validating Agent Reasoning, Tool Calling, Workflow Execution, and Response Quality

• Hands-on experience in Automation Testing using Python frameworks

Key Responsibilities

• Design, execute, and automate evaluation strategies for Agentic AI applications.
• Develop evaluation datasets, test cases, and benchmark suites.
• Measure and improve agent performance, reasoning quality, tool usage, and workflow effectiveness.
• Analyze model outputs and identify hallucinations, biases, safety risks, and failure patterns.
• Collaborate with AI Engineers, Product Teams, and Domain Experts to improve agent quality and reliability.
• Generate evaluation reports, dashboards, and actionable recommendations.

AI Engineer

We are seeking an AI Engineering specialist focused on AI evaluation, and continuous quality improvement for Ezra MetLife's employee-facing AI platform. This role will establish and scale the testing strategy for enterprise AI agents, ensuring high response quality, reliability, and production readiness. The engineer will build automated regression testing framework (preferred Playwright ), define AI evaluation methodologies, analyze AI performance metrics, and partner with engineering teams to continuously improve answer quality, grounding accuracy, and customer experience. This position is critical to enabling confidence as Ezra expands its AI agent portfolio and employee-facing capabilities.

Required Skills & Experience

• C# and .NET development experience

• Experience with at least one AI evaluation framework (e.g., prompt evaluation, RAG evaluation, LLM quality assessment)

• Microsoft Agent Framework (preferred) or similar enterprise agent frameworks

• Experience with Azure OpenAI / Azure AI Foundry

• Microsoft 365 Agent SDK

• Azure AI Search, RAG pipelines, and retrieval quality testing

• Infrastructure as Code using Terraform

• Experience building automated testing and AI quality validation processes

• Familiarity with telemetry analysis, AI observability, and performance measurement

• Strong analytical skills with a passion for improving AI response quality and reliability

Skills: AI Agents~Core .NET Technologies~C# 5.0

Experience Required: 10 & Above

Location: Hyderabad :5+ relevant exp in AI + .NET

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Experience Level

This role is ideal for engineers with total 3+ years of experience with a proven track record of shipping complex projects successfully.

An experienced individual contributor and leader who thrives in large, complex projects with widespread impact.

What You’ll Do as a Software Craftsperson 

• Design and build high-quality, maintainable systems using disciplined engineering practices such as TDD, continuous refactoring, and pair programming 
• Operate in an AI-native development model, using AI as a collaborator to explore architecture and design, accelerate development, and continuously improve systems while applying strong judgment to ensure that speed never compromises quality 
• Take end-to-end ownership of outcomes from problem understanding and system design to implementation, deployment, and operation in production 
• Make thoughtful design decisions that balance simplicity, scalability, and long-term maintainability in real-world systems 
• Maintain a high bar for engineering quality through rigorous testing, code reviews, and continuous feedback 
• Investigate and resolve production issues, and implement systemic improvements to prevent recurrence 
• Work directly with clients, navigate ambiguity, and translate business problems into well-designed technical solutions 
• Contribute to improving team practices, tooling, and systems to raise the overall quality and effectiveness of engineering 

Requirements

What You’ll Bring 

• 3+ years of experience building high-quality, production systems (flexible based on demonstrated capability) 
• Strong fundamentals in software engineering, including object-oriented design, system design, and testing practices such as TDD 
• Demonstrated ability to build simple, maintainable, and scalable systems with a focus on long-term reliability 
• Proficiency in one or more modern technologies, Python, PHP, JavaScript, or TypeScript, with the ability to learn new technologies quickly 
• Deep experience working with Git in collaborative environments, including managing shared codebases, conducting code reviews, and maintaining a high bar for quality 
• Ability to operate effectively in an AI-native workflow using AI as a collaborator to explore solutions and accelerate development, while applying strong judgment to ensure correctness, quality, and maintainability 
• Clear thinking and strong problem-solving ability, with the capacity to break down complex problems into simple, well-structured solutions 
• A strong sense of ownership — you take responsibility for outcomes, care deeply about quality, and are not comfortable shipping work that does not meet your standards.

Benefits

Life at Incubyte 

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance. 
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

Skill Set

Large language,Artificial Intelligence,Machine Learning

- 4–7 years of experience in software engineering/AI roles

- Strong programming skills in Python or TypeScript (Java/Go is a plus)

- Hands-on experience with LLMs, RAG pipelines, and AI frameworks

- Experience building APIs and working with distributed systems

- Familiarity with Kubernetes, Docker, and CI/CD pipelines

- Experience with cloud platforms (AWS/Azure/GCP)

Excellent communication