Cadence Design Systems
https://cadence.comAbout
Company social profiles
Jobs at Cadence Design Systems
Python
Principal Software Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.
Key Responsibilities
- Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
- Develop comprehensive test suites, including:
- Unit, integration, and end-to-end (E2E)
- Functional, regression, performance, and safety testing
- Validate AI system behavior, including:
- Non-deterministic LLM outputs
- Hallucinations and edge cases
- Multi-step agent decision-making
- Design and manage evaluation systems:
- Golden datasets
- Benchmarking pipelines (accuracy, latency, reliability)
- Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
- Implement observability and telemetry to enable traceability, monitoring, and audit readiness
- Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
- Track and report quality KPIs, including test coverage, defect leakage, and system reliability
- Drive root-cause analysis and continuous improvement across the AI testing lifecycle
Required Skills
Core Engineering
- Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
- Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
- Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
- Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)
AI / ML & Agentic Systems
- Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
- Familiarity with:
- RAG architectures and vector databases (Pinecone, Weaviate)
- Agent frameworks (LangChain, LlamaIndex, AutoGen)
AI Testing Techniques
- Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
- Knowledge of evaluation methods:
- LLM-as-a-judge
- BLEU, ROUGE, semantic similarity scoring
- Experience with prompt and agent regression testing
- Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection
Tooling (Preferred)
- AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
- Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
- Monitoring: Prometheus, Grafana, OpenTelemetry
Soft Skills
- Strong analytical and problem-solving skills
- Excellent communication and cross-functional collaboration
- Data-driven mindset with focus on quality KPIs
- Detail-oriented with a strong bias toward automation and scalability
Experience Requirements
- 7+ years in QA, SDET, or test automation engineering
- Proven experience building and scaling automation frameworks
- Hands-on experience with AI/ML systems or LLM-based applications
- Experience testing RAG pipelines or agentic workflows
- Owned end-to-end AI test strategy and architecture
- Defined quality metrics and release gates
- Delivered scalable validation pipelines for production AI systems
- Supported audit and compliance readiness
Preferred
- Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
- Exposure to:
- Shift-left testing practices
- Production observability and monitoring
- Chaos or resilience testing
Senior-Level Differentiators
Education
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field
Nice-to-have:
- ISTQB certification
- Cloud/ML certifications (AWS, Azure, GCP)
- AI testing certifications
What Success Looks Like
- AI systems that are accurate, reliable, and safe
- Fully automated test pipelines integrated into CI/CD
- Measurable improvements in defect leakage and model quality
- Strong observability and auditability across AI systems
- Scalable validation frameworks supporting rapid AI innovation
Similar companies
About the company
Jobs
13
About the company
We’re a UI/UX design company, super-powering businesses by crafting simple & delightful digital experiences.
We are designers, artists, creators, researchers, visualizers and observers; well a bunch of driven individuals with creative minds, working together as User Interface and User Experience Designers!
At Monsoonfish, we believe in working in an environment that suits each teammate, makes them feel comfortable and encourages them to become a better version of themselves at work and beyond. Our agency culture is open, liberal, accepting, outgoing, driven, focused, and the one that values work-life balance.
Jobs
8
About the company
About Us
Incubyte is an AI-first software development agency built on the principles of software craftsmanship—where how we build is just as important as what we build. We partner with organizations across stages, from enterprises looking to scale and modernize to early-stage founders bringing new ideas to life.
At Incubyte, AI is deeply integrated across the software development lifecycle to drive speed, efficiency, and smarter outcomes. Guided by Software Craftsmanship values and Extreme Programming practices, we combine high velocity with disciplined engineering to deliver reliable, high-impact solutions.
We don’t just build software—we incubate dedicated engineering teams. From designing systems to shaping team structures and organizational strategy, we enable our clients to launch and scale products that are relevant today and resilient for the future.
Whether you’re scaling an existing product, building from scratch, or optimizing manual processes, we help you move faster with confidence:
- Scale and modernize your product
- Launch quickly and iterate continuously
- Automate processes for non-linear growth
- Build systems that are stable, predictable, and measurable
Our approach is rooted in ownership. As a DevOps-driven organization, our engineers take responsibility for the entire lifecycle—from development to release—ensuring quality at every step.
Founded by product professionals, we bring a strong product mindset into services. We’re driven by curiosity, continuous learning, and a passion for building great software the right way.
We’re always looking for people who care deeply about code, craftsmanship, and growth. Join us if you’re excited to build, learn, and make an impact.
Jobs
16
About the company
Jobs
10
About the company
Welcome to Neogencode Technologies, an IT services and consulting firm that provides innovative solutions to help businesses achieve their goals. Our team of experienced professionals is committed to providing tailored services to meet the specific needs of each client. Our comprehensive range of services includes software development, web design and development, mobile app development, cloud computing, cybersecurity, digital marketing, and skilled resource acquisition. We specialize in helping our clients find the right skilled resources to meet their unique business needs. At Neogencode Technologies, we prioritize communication and collaboration with our clients, striving to understand their unique challenges and provide customized solutions that exceed their expectations. We value long-term partnerships with our clients and are committed to delivering exceptional service at every stage of the engagement. Whether you are a small business looking to improve your processes or a large enterprise seeking to stay ahead of the competition, Neogencode Technologies has the expertise and experience to help you succeed. Contact us today to learn more about how we can support your business growth and provide skilled resources to meet your business needs.
Jobs
475
About the company
Jobs
17
About the company
Alpha brings a new AI native environment to build effective and reliable AI agents with no code.
Jobs
3
About the company
SDS Softwares is a UK-based web development company, which has more than 10+ years of experience in its niche field. The company provides services for web development, web design, mobile app development, eLearning, digital marketing, etc. Our services are not restricted to any particular domain. We have served a large number of verticals, not only with the best quality services but with values as well. Major business domains, which we have targeted yet, include real estate, TTL, health care, logistics, and hospitality.
Jobs
1
About the company
Jobs
3
About the company
Jobs
2