Risk Analyst (Data Annotation)

Role Overview

We are looking for an experienced professional to evaluate AI-generated responses for conversational AI agents used in travel-related products. The role focuses on assessing response accuracy, relevance, completeness, and quality to improve AI performance.

Key Responsibilities

• Evaluate AI-generated responses against predefined guidelines and quality standards.
• Perform data annotation, labeling, classification, and quality reviews.
• Identify incorrect, misleading, irrelevant, or incomplete responses and potential AI hallucinations.
• Analyze evaluation data to identify recurring errors, quality gaps, and improvement opportunities.
• Track quality metrics, document findings, and recommend improvements.
• Use Excel/Google Sheets and basic SQL, where applicable, to analyze evaluation data.
• Collaborate with AI and Machine Learning teams to improve conversational AI performance.

Required Skills

• 5–8 years of experience in Data Annotation, AI Evaluation, Content Quality, Search Relevance, or Quality Assurance.
• Strong analytical, problem-solving, and attention-to-detail skills.
• Experience applying evaluation guidelines and quality standards consistently.
• Proficiency in Excel or Google Sheets.
• Good written communication and documentation skills.
• Understanding of quality metrics and data analysis.

Good to Have

• Exposure to Generative AI, LLMs, conversational AI, or AI response evaluation.
• Experience with Human-in-the-Loop (HITL), AI training data validation, or hallucination detection.
• Basic SQL knowledge.
• Experience in travel, hospitality, or search quality evaluation.

Role Overview 

As a Data Scientist, you will work with business stakeholders, AI engineers, and domain experts to transform data into actionable insights and intelligent solutions. You will develop machine learning models, perform statistical analysis, and contribute to AI-driven products that create measurable business impact. 

Key Responsibilities 

Data Science & Machine Learning 

• Analyze structured and unstructured data to identify patterns, trends, and business opportunities.  
• Perform exploratory data analysis (EDA), feature engineering, and data preparation.  
• Develop, evaluate, and optimize machine learning models for prediction, classification, clustering, and forecasting.  
• Apply statistical techniques to solve business problems and validate model performance.  
• Design and execute experiments to improve model accuracy and business outcomes.  

 AI Solution Development 

• Collaborate with AI Engineers, Data Engineers, and domain experts to build AI-powered solutions.  
• Translate business requirements into scalable data science approaches.  
• Contribute to Generative AI and advanced analytics initiatives where applicable.  
• Document methodologies, model performance, and key findings.  

 Required Technical Skills 

• Strong programming skills in Python and SQL for data analysis, feature engineering, and machine learning.  
• Strong understanding of Statistics, Probability, Linear Algebra, and Calculus as applied to machine learning and data science.  
• Experience with Exploratory Data Analysis (EDA), data preprocessing, feature engineering, feature selection, and handling missing or imbalanced data.  
• Good understanding of Supervised, Unsupervised, and Ensemble Machine Learning algorithms, including their assumptions, strengths, limitations, and appropriate use cases.  
• Strong knowledge of Regression, Classification, Clustering, Time Series Forecasting, Dimensionality Reduction, Recommendation Systems, and Anomaly Detection techniques.  
• Experience with Model Evaluation, Cross-Validation, Hyperparameter Optimization, Bias-Variance Trade-off, Feature Importance, Explainable AI (XAI), and Performance Metrics.  
• Understanding of Statistical Inference, Hypothesis Testing, Probability Distributions, Sampling Techniques, Confidence Intervals, and A/B Testing.  
• Experience translating business problems into analytical approaches and developing scalable, data-driven solutions.  
• Working knowledge of Generative AI, Large Language Models (LLMs), Prompt Engineering, and Retrieval-Augmented Generation (RAG) is preferred. 

Preferred Qualifications 

• Bachelor's or master's degree in computer science, Artificial Intelligence, Data Science, Statistics, Mathematics, Engineering, or a related field.  
• 2–4 years of experience developing machine learning or data science solutions.  
• Experience working on end-to-end data science projects in a business environment.  

 Nice to Have 

• Exposure to Generative AI, LLMs, RAG, or Agentic AI.  
• Experience with Computer Vision or Natural Language Processing (NLP).  
• Familiarity with cloud-based AI platforms.  
• Knowledge of construction, engineering, manufacturing, or industrial domains.  
• Participation in hackathons, research, Kaggle competitions, or open-source projects.  

 Soft Skills 

Strong analytical and problem-solving skills, effective communication and collaboration, ownership mindset, adaptability, continuous learning, and a passion for innovation.

About NonStop io Technologies

NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.

Brief Description:

We're seeking an AI/ML Engineer to join our team. As AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real-world business problems. You will work closely with engineering teams, including software engineers, domain experts, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms and data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.

Responsibilities

● Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI

● AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.

● Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data

● Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics

● Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behaviour, and performance metrics

● Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems

● Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes

● Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions

● Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference.

Qualifications & Skills

● Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus

● Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects

● Proficiency in programming languages commonly used for AI/ML. Preferably Python

● Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.

● Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.

● Strong understanding of machine learning algorithms, statistics, and data structures

● Experience with data preprocessing, data wrangling, and feature engineering

● Knowledge of deep learning architectures, neural networks, and transfer learning

● Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment

● Solid understanding of software engineering principles and best practices for writing maintainable and scalable code

● Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions

● Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders

Data Science Engineer – Python, SQL, Statistics & Machine Learning

Company: Talview

Experience: 3–5 years

Location: Bengaluru, Karnataka

Work Mode: Work from Office, with some flexibility

Work Week: 5 days

About Talview

Talview builds AI-powered hiring and assessment solutions for enterprise organisations. Our products support candidate screening, interview scheduling and online exam proctoring, helping teams improve efficiency and make better-informed decisions.

Role Overview

We are looking for a Data Science Engineer with strong hands-on experience in Python, SQL, statistics and classical machine learning, along with experience working on GenAI and Large Language Models (LLMs).

You will work across data processing, statistical analysis, experimentation, model development, evaluation and production AI/ML workflows. You will collaborate with Engineering and Product teams to translate business problems into measurable data science solutions.

This role requires practical experience in classical ML and statistics, beyond working only with LLM APIs or prompt engineering.

Roles and Responsibilities

• Develop complex SQL queries for data extraction, transformation, analysis and validation.
• Use Python for data processing, exploratory data analysis, automation and reusable experimentation utilities.
• Apply statistical analysis, hypothesis testing and experimental design to evaluate business and product outcomes.
• Develop and evaluate machine learning models using appropriate metrics and clearly defined success criteria.
• Build LLM workflows involving prompting, structured outputs and comparative evaluation of models and configurations.
• Create evaluation datasets, benchmarks, sampling strategies and ground-truth validation approaches.
• Perform error analysis and root-cause analysis to identify model failures, anomalies and performance degradation.
• Analyse production data and troubleshoot data, model and pipeline issues.
• Integrate data from APIs, databases and other structured and unstructured sources.
• Collaborate with Engineering and Product teams on ML pipelines, evaluation frameworks and inference workflows.
• Research and test techniques to improve AI/ML system performance.

Required Skills and Experience

• 3–5 years of relevant experience in Data Science, Machine Learning, AI or a related field.
• Strong hands-on Python programming skills.
• Strong SQL skills for complex querying, data transformation and analysis.
• Solid understanding of statistics, hypothesis testing, experiment design and performance measurement.
• Practical experience developing and evaluating classical machine learning models.
• Experience with LLMs, prompting, structured outputs and evaluation.
• Experience defining evaluation metrics, benchmarks and error-analysis approaches.
• Ability to work with APIs, databases and structured and unstructured datasets.
• Strong analytical and problem-solving skills.
• Ability to explain technical decisions, interpret results and communicate findings to stakeholders.

Preferred Skills

• Experience designing end-to-end ML or LLM workflows.
• Experience with dataset creation, sampling, annotation and ground-truth validation.
• Experience analysing production AI/ML systems and debugging model or pipeline issues.
• Experience building reusable experimentation and evaluation frameworks.

Key Skills

Python, SQL, Data Science, Statistics, Machine Learning, Classical ML, Hypothesis Testing, Experimental Design, Model Evaluation, Exploratory Data Analysis, GenAI, Large Language Models, LLM Evaluation, Error Analysis

We are looking for a hands-on Lead Data Scientist with strong analytical, machine learning, and problem-solving skills to work in a client-facing environment.

The role requires someone who can independently identify opportunities, formulate hypotheses, design solutions, and drive initiatives from analysis through experimentation and production implementation. The candidate should also be comfortable guiding team members and working closely with engineering and client stakeholders.

Responsibilities: 

• Analyse complex datasets to identify patterns, issues, and opportunities.
• Formulate and validate hypotheses through structured analysis and experimentation.
• Build and improve machine learning and anomaly detection solutions.
• Design end-to-end solutions considering data, modelling, engineering, and production constraints.
• Perform root cause analysis across models, data, and systems.
• Work with engineering teams on feature pipelines, model inference, and production deployment.
• Lead technical discussions with clients and communicate recommendations, trade-offs, and expected impact.
• Guide team members on analysis, modelling, and solution design.
• Proactively identify initiatives and roadmap items that can add value to the project.

Requirements: 

• Strong foundation in statistics and machine learning.
• Strong hands-on experience with Python and SQL.
• Hands-on experience with Python ML and data frameworks such as Pandas, NumPy, scikit-learn, TensorFlow/Keras, Dask, Matplotlib, Boto3 SageMaker Python SDK, and Horovod.
• Strong data analysis, hypothesis-generation, and problem-solving skills.
• Experience with standard supervised and unsupervised ML techniques.
• Experience with anomaly detection techniques such as Isolation Forest and Autoencoders.
• Experience building and deploying production ML solutions.
• Working knowledge of data engineering and real-time / batch inference environments.
• Strong communication and stakeholder-management skills.
• Ability to lead technical work and guide cross-functional teams.

Good to Have: 

• Experience in fraud detection or risk modelling.
• Experience with Graph Neural Networks.
• Exposure to real-time systems, streaming features, and low-latency data stores.
• Experience in AdTech, e-commerce, gaming, mobile applications, or similar high-volume consumer platforms.

Support with design and build to prove out agentic AI solution flow by working with other data 

scientists and engineers to build, train Large Language Model (LLM) architectures, RAG 

systems, and autonomous agentic workflows 

Key qualifications: 

>> AI solution design & Development: Design Agentic AI solutions using RAG (Retrieval-

Augmented Generation) and orchestration frameworks like LangGraph or LangChain. 

>> Model Fine-Tuning: Solid understanding and experience with Pre-train, fine-tune, and 

optimize open-source like BERT, LLama, and other proprietary foundation models for domain-

specific tasks 

>> Solid Stats and ML foundations and (vibe) coding skills with Python, PySpark 

>>  Implement validation frameworks and tracing practices (using tools like Arize) to monitor 

agent behavior, guard against model drift, and ensure compliance 

>> Collaborate with Engineering to deploy models securely on cloud and on-prem ecosystems 

Key Responsibilities

 Strong understanding of Machine Learning algorithms (supervised and unsupervised)

 Hands-on experience with Deep Learning frameworks (TensorFlow, PyTorch, or similar)

 Experience in NLP techniques and libraries (NLTK, spaCy, Hugging Face, etc.)

 Solid knowledge of Statistics, probability, and data analysis methods

 Proficiency in SQL for querying relational databases

 Strong programming skills in Python (or similar languages)

 Excellent communication skills with the ability to explain complex concepts simply

Required Qualifications

 3+ years of hands-on experience as a Data Scientist or in a similar role.

 Strong expertise in classical machine learning and regression modeling.

 Solid understanding of statistics, including probability, distributions, hypothesis testing,

and correlation analysis.

 Proficiency in Python with libraries such as: scikit-learn pandas NumPy

 Experience working with structured/tabular data.

 Strong problem-solving and analytical thinking skills.

 Ability to clearly explain models and results to non-technical stakeholders.

Principal Software Engineer

Location: Bangalore India

Department: AI Engineering / Quality Assurance

Experience Level: Mid to Senior

We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.

Key Responsibilities

• Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
• Develop comprehensive test suites, including:
• Unit, integration, and end-to-end (E2E)
• Functional, regression, performance, and safety testing
• Validate AI system behavior, including:
• Non-deterministic LLM outputs
• Hallucinations and edge cases
• Multi-step agent decision-making
• Design and manage evaluation systems:
• Golden datasets
• Benchmarking pipelines (accuracy, latency, reliability)
• Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
• Implement observability and telemetry to enable traceability, monitoring, and audit readiness
• Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
• Track and report quality KPIs, including test coverage, defect leakage, and system reliability
• Drive root-cause analysis and continuous improvement across the AI testing lifecycle

Required Skills

Core Engineering

• Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
• Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
• Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
• Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)

AI / ML & Agentic Systems

• Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
• Familiarity with:
• RAG architectures and vector databases (Pinecone, Weaviate)
• Agent frameworks (LangChain, LlamaIndex, AutoGen)

AI Testing Techniques

• Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
• Knowledge of evaluation methods:
• LLM-as-a-judge
• BLEU, ROUGE, semantic similarity scoring
• Experience with prompt and agent regression testing
• Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection

Tooling (Preferred)

• AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
• Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
• Monitoring: Prometheus, Grafana, OpenTelemetry

Soft Skills

• Strong analytical and problem-solving skills
• Excellent communication and cross-functional collaboration
• Data-driven mindset with focus on quality KPIs
• Detail-oriented with a strong bias toward automation and scalability

Experience Requirements

• 7+ years in QA, SDET, or test automation engineering
• Proven experience building and scaling automation frameworks
• Hands-on experience with AI/ML systems or LLM-based applications
• Experience testing RAG pipelines or agentic workflows
• Owned end-to-end AI test strategy and architecture
• Defined quality metrics and release gates
• Delivered scalable validation pipelines for production AI systems
• Supported audit and compliance readiness

Preferred

• Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
• Exposure to:
• Shift-left testing practices
• Production observability and monitoring
• Chaos or resilience testing

Senior-Level Differentiators

Education

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field

Nice-to-have:

• ISTQB certification
• Cloud/ML certifications (AWS, Azure, GCP)
• AI testing certifications

What Success Looks Like

• AI systems that are accurate, reliable, and safe
• Fully automated test pipelines integrated into CI/CD
• Measurable improvements in defect leakage and model quality
• Strong observability and auditability across AI systems
• Scalable validation frameworks supporting rapid AI innovation

Role Overview 

The Business Analyst for the CCX Customer Success AI Acceleration workstream partners closely with Engineering, Product Management, and Program teams to translate customer success strategy and AIdriven use cases into clear, actionable requirements that enable scalable delivery. This role sits on the engineering side of the house, acting as a connective layer between business intent, technical execution, and AIenabled platform outcomes. 

The Business Analyst ensures that AI acceleration initiatives across the Customer Success Platform are well‑defined, appropriately prioritized, and traceable from business objectives through system design and delivery. This includes refining problem statements, documenting requirements, supporting backlog readiness, and helping teams move quickly without losing alignment or clarity. 

Requirements 

• Proven experience as a Business Analyst supporting engineering teams, preferably in enterprise, platform, or SaaS environments. 

• Strong ability to translate business needs, customer success objectives, and AI use cases into clear functional and non‑functional requirements. 

• Experience working on AI‑enabled or data‑driven products, including concepts such as automation, recommendations, agentic workflows, or insights powered by analytics. 

• Ability to partner effectively with Engineers, Product Managers, Technical Program Managers, and UX to support backlog refinement and delivery planning. 

• Experience creating and maintaining artifacts such as user stories, acceptance criteria, process flows, data mappings, and dependency documentation. 

• Comfort operating in fast‑paced, iterative delivery environments, supporting AI acceleration efforts where requirements evolve quickly. 

• Strong analytical skills with the ability to identify gaps, risks, dependencies, and edge cases early in the development lifecycle. 

• Clear written and verbal communication skills, with the ability to align technical and non‑technical stakeholders. 

• Familiarity with ServiceNow‑style enterprise platforms, customer success workflows, or complex system integrations is a strong plus. 

• Bachelor’s degree in Business, Information Systems, Engineering, or a related field—or equivalent professional experience. 

Job Overview

We are looking for an experienced AI/ML Engineer with strong full-stack development skills to design, develop, and deploy AI-powered applications. The ideal candidate should be proficient in Python backend development, frontend technologies, and LLM integration, with the ability to build end-to-end AI-native products, custom dashboards, and lightweight applications.

This role focuses on applying AI to real-world business problems through rapid prototyping, prompt engineering, Retrieval-Augmented Generation (RAG), and scalable application development.

Key Responsibilities

• Design, develop, and deploy end-to-end AI-powered applications.
• Build backend services and REST APIs using Python.
• Develop responsive frontends using React, Next.js, or similar frameworks.
• Integrate LLM APIs such as OpenAI, Claude, and Hugging Face into production applications.
• Build custom dashboards, internal tools, micro-apps, and AI-driven business solutions.
• Implement prompt engineering, embeddings, RAG pipelines, and context-aware AI systems.
• Rapidly prototype and validate ideas using modern AI-assisted development workflows.
• Optimize application performance, scalability, reliability, and AI usage costs.
• Work with data processing libraries such as Pandas and NumPy.
• Collaborate with product and business teams to translate requirements into functional AI solutions.
• Take ownership of features from ideation and development through testing, deployment, and production support.

Required Skills & Qualifications

• 2+ years of experience in software engineering, AI engineering, or application development.
• Strong proficiency in Python and backend development.
• Hands-on experience with React, Next.js, or similar frontend technologies.
• Practical experience integrating LLM APIs such as OpenAI, Claude, or Hugging Face.
• Understanding of REST APIs, microservices, and system design principles.
• Knowledge of prompt engineering, embeddings, and RAG architectures.
• Experience with data processing using Pandas and NumPy.
• Ability to independently build, test, and deploy full-stack applications.
• Strong problem-solving, debugging, and analytical skills.
• Ability to work in a fast-paced environment with a strong ownership mindset.

Good to Have

• Experience with LangChain, LlamaIndex, or similar AI frameworks.
• Familiarity with vector databases such as Pinecone, Weaviate, or Supabase.
• Experience building AI chat interfaces, copilots, assistants, and custom dashboards.
• Familiarity with cloud platforms, application deployment, and production monitoring.
• Experience with AI-assisted coding tools and rapid prototyping workflows.

What We Are Looking For

• A full-stack AI engineer who is comfortable working across both backend and frontend development.
• Someone focused on building practical AI-powered products rather than only training machine learning models.
• A developer who can prototype quickly, validate ideas, and iterate efficiently using a “vibe coding” approach.
• A self-driven professional who can take ownership of a feature from concept to production.

Please note that this job is only for Ahmedabad location.