11+ Model-based testing Jobs in Mumbai | Model-based testing Job openings in Mumbai

Position: QA Engineer – Machine Learning Systems (5 - 7 years)

Location: Remote (Company in Mumbai)

Company: Big Rattle Technologies Private Limited

Immediate Joiners only.

Summary:

The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through feature engineering checks, model training/evaluation verification, batch prediction/optimization validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means probably correct data, models, and outputs at production scale and cadence.

Key Responsibilities:

Test Strategy & Governance

• ○ Define an ML-specific Test Strategy covering data quality KPIs, feature consistency
• checks, model acceptance gates (metrics + guardrails), and E2E run acceptance
• (timeliness, completeness, integrity).
• ○ Establish versioned test datasets & golden baselines for repeatable regression of
• features, models, and optimizers.

Data Quality & Transformation

• Validate raw data extracts and landed data lake data: schema/contract checks, null/outlier thresholds, time-window completeness, duplicate detection, site/material coverage.
• Validate transformed/feature datasets: deterministic feature generation, leakage detection, drift vs. historical distributions, feature parity across runs (hash or statistical similarity tests).
• Implement automated data quality checks (e.g., Great Expectations/pytest + Pandas/SQL) executed in CI and AML pipelines.

Model Training & Evaluation

• Verify training inputs (splits, windowing, target leakage prevention) and hyperparameter configs per site/cluster.
• Automate metric verification (e.g., MAPE/MAE/RMSE, uplift vs. last model, stability tests) with acceptance thresholds and champion/challenger logic.
• Validate feature importance stability and sensitivity/elasticity sanity checks (price/volume monotonicity where applicable).
• Gate model registration/promotion in AML based on signed test artifacts and reproducible metrics.

Predictions, Optimization & Guardrails

• Validate batch predictions: result shapes, coverage, latency, and failure handling.
• Test model optimization outputs and enforced guardrails: detect violations and prove idempotent writes to DB.
• Verify API push to third party system (idempotency keys, retry/backoff, delivery receipts).

Pipelines & E2E

• Build pipeline test harnesses for AML pipelines (data-gen nightly, training weekly,
• prediction/optimization) including orchestrated synthetic runs and fault injection
• (missing slice, late competitor data, SB backlog).
• Run E2E tests from raw data store -> ADLS -> AML -> RDBMS -> APIM/Frontend, assert
• freshness SLOs and audit event completeness (Event Hubs -> ADLS immutable).

Automation & Tooling

• Develop Python-based automated tests (pytest) for data checks, model metrics, and API contracts; integrate with Azure DevOps (pipelines, badges, gates).
• Implement data-driven test runners (parameterized by site/material/model-version) and store signed test artifacts alongside models in AML Registry.
• Create synthetic test data generators and golden fixtures to cover edge cases (price gaps, competitor shocks, cold starts).

Reporting & Quality Ops

• Publish weekly test reports and go/no-go recommendations for promotions; maintain a defect taxonomy (data vs. model vs. serving vs. optimization).
• Contribute to SLI/SLO dashboards (prediction timeliness, queue/DLQ, push success, data drift) used for release gates.

Required Skills (hands-on experience in the following):

• Python automation (pytest, pandas, NumPy), SQL (PostgreSQL/Snowflake), and CI/CD (Azure
• DevOps) for fully automated ML QA.
• Strong grasp of ML validation: leakage checks, proper splits, metric selection
• (MAE/MAPE/RMSE), drift detection, sensitivity/elasticity sanity checks.
• Experience testing AML pipelines (pipelines/jobs/components), and message-driven integrations
• (Service Bus/Event Hubs).
• API test skills (FastAPI/OpenAPI, contract tests, Postman/pytest-httpx) + idempotency and retry
• patterns.
• Familiar with feature stores/feature engineering concepts and reproducibility.
• Solid understanding of observability (App Insights/Log Analytics) and auditability requirements.

Required Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
• 5–7+ years in QA with 3+ years focused on ML/Data systems (data pipelines + model validation).
• Certification in Azure Data or ML Engineer Associate is a plus.

Why should you join Big Rattle?

Big Rattle Technologies specializes in AI/ ML Products and Solutions as well as Mobile and Web Application Development. Our clients include Fortune 500 companies. Over the past 13 years, we have delivered multiple projects for international and Indian clients from various industries like FMCG, Banking and Finance, Automobiles, Ecommerce, etc. We also specialise in Product Development for our clients.

Big Rattle Technologies Private Limited is ISO 27001:2022 certified and CyberGRX certified.

What We Offer:

• Opportunity to work on diverse projects for Fortune 500 clients.
• Competitive salary and performance-based growth.
• Dynamic, collaborative, and growth-oriented work environment.
• Direct impact on product quality and client satisfaction.
• 5-day hybrid work week.
• Certification reimbursement.
• Healthcare coverage.

How to Apply:

Interested candidates are invited to submit their resume detailing their experience. Please detail out your work experience and the kind of projects you have worked on. Ensure you highlight your contributions and accomplishments to the projects.

Role Description

Need a graphic designer who should be able to conceptualise campaigns and execute eye-catching and professional email designs. With the desire to learn organisational and business values, they should be able to determine the requirements and produce exceptional work.

Responsibilities

1. Understand the brief, participate in brainstorming and produce creative designs that result in an engaging consumer journey.
2. Collaborate with the marketing team and copywriters to understand the exact requirements and expectations.
3. Be a great team player and coordinate with other design teams to seek and provide design assistance.
4. Use proficient creative software skills to create variety of static and motion graphics for communication design.
5. Learn business requirements and organisational values to adapt the same in designs.
6. Understand how creatives are performing via analysing performance data, and incorporate the same understanding into subsequest creatives.

Requirements

Strong Knowledge of Photoshop and Illustrator.

• Excellent visual design skills in both static and basic motion graphics.

• Basic knowledge of HTML and Adobe XD will be advantageous.

• Ability to present your designs and defend your solutions to various stakeholders.

• 2-4 years of experience as a graphic designer in a relevant field. Good layout designing skills and sense of colour usage.

• E-commerce background is a plus point.

Professional written and interpersonal skills.

• Understanding the Beauty Space is a plus.

• Experienced in determining requirements and meeting deadlines.

As a Visual & Motion Design at Team Pumpkin, you will have the opportunity to work on creative projects that enhance brand storytelling and engagement. You will assist in creating visually compelling content for various digital platforms, helping to elevate our clients' marketing initiatives.

Key Responsibilities:

• Visual Design Creation:
• Assist in designing graphics for social media, websites, email campaigns, and promotional materials.
• Collaborate with the creative team to develop visually appealing layouts and concepts.

• Motion Graphics Development:
• Create engaging motion graphics and animations for video content, advertisements, and social media.
• Help edit video footage and incorporate visual effects that enhance the overall message.

• Branding Support:
• Assist in maintaining brand consistency across all visual content.
• Support the development of branding materials, including logos, brochures, and presentation decks.

• Creative Collaboration:
• Work closely with copywriters, Account Manager and other designers to brainstorm and execute creative concepts.
• Participate in team meetings to present design ideas and gather feedback.

• Research & Trend Analysis:
• Stay updated on design trends, techniques, and tools to contribute fresh ideas and approaches.
• Conduct research on competitor visual strategies to inform and inspire new designs.

Desired Skills and Qualifications:

• Degree in Graphic Design, Motion Design, Multimedia Arts, or a related field.
• Proficiency in design software, including Adobe Creative Suite (Photoshop, Illustrator, After Effects, Premiere Pro).
• Strong understanding of design principles, typography, color theory, and composition.
• Basic knowledge of animation and motion design techniques is a plus.
• Creative mindset with a passion for visual storytelling and design.
• Strong attention to detail and ability to manage multiple projects.
• Excellent communication and collaboration skills.

What We Offer:

• A dynamic and creative work environment within the digital marketing industry.
• Opportunities to develop your skills in visual and motion design while working on real client projects.
• Mentorship and guidance from experienced design professionals.
• Potential for future employment opportunities based on performance.

Software Engineer

Opportunity in this role / Why should you join us?

- You are your own master.  We don't preach you, we just allow you to Innovate, Iterate, Learn and Adapt

- Work with one of India's leading fintech unicorn company

- ESOPs in the company

Requirements

• 3+ years and above exposure in the art of writing codes and solving problems for large scale
• Extensive and expert programming experience in any one programming language (strong OOPS skills preferred). Deep experience in a java programming language
• A solid foundation in computer science, with strong competencies in data structures, algorithms, and software design.
• Have a penchant for solving complex and interesting problems.
• BE/BTech, MTech in Computer Science or related technical discipline (or equivalent).
• Excellent coding skills – should be able to convert the design into code fluently Good skills to write unit & integration tests with reasonable coverage of code & interfaces - TDD is a plus
• Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with the huge amount of data. Experience with

multi-threading and concurrency programming

• Ability to switch between the technologies and learn new skills on the go.

Roles and Responsibilities

• Drive discussions to create/improve the product, process and technology
• Build abstractions and contracts with separation of concerns for a larger scope
• Rapid prototyping
• Robust and scalable web-based applications
• Do high-level design with guidance; Functional modelling, break-down of a module
• Thinking platforms & reuse, the open-source contribution will be a plus
• Do incremental changes to architecture: impact analysis of the same
• Do performance tuning and improvements in large scale distributed systems
• Mentor young minds and foster team spirit.

Content Writer

(6 months - 1 yrs of experience)

• Proven work experience as content writer, copywriter or similar role.

• Knowledge of digital marketing tactics, including SEO, email marketing and web analytics.

• An impeccable grasp of english language, including idioms, and current trends in slang and expression.

• Ability to work independently with daily or no little supervision.

• Strict adherence to the style guides of each company and their policies for publication.

Key Responsible Area

• Create content marketing campaigns to drive lead and subscribe.

• Use best SEO practices to generate traffic on the website.

• Regularly produce various content types, including emails, social media posts, blogs and guides.

• Actively manage and promote our blog, and pitch articles to relevant third-party platform.

• Edit the content produced by the other members of the team.

• Analyze content marketing metrics and makes changes as needed.

• Collaborate with other departments to create innovative content ideas

• 3-8+ years of experience programming in a backend language (Java / Python), with a good understanding of troubleshooting errors. 
• 5+ years of experience in Confluent Kafka / 3+ years of experience in Confluent Kafka 

• Cloud Kafka, Control Central, Rest Proxy, HA Proxy, Confluent Kafka Connect, Confluent Kafka Security features 

• Develop new user-facing features
• Build reusable code and libraries for future use
• Ensure the technical feasibility of UI/UX designs
• Optimize applications for maximum speed and scalability
• Assure that all user input is validated before submitting to back-end services
• Define APIs for front-end and back-end
• Consume 3rd party APIs
• Collaborate with other team members and stakeholders

• Strong understanding of JavaScript, its quirks, and workarounds
• Basic understanding of web markup, including HTML5 and CSS3
• Good understanding of advanced JavaScript libraries and frameworks - Angular, RxJS, Internationalization
• Good understanding of asynchronous request handling, partial page updates and reactive components
• Proficient understanding of cross-browser compatibility issues and ways to work around such issues
• Familiarity with front-end build tools
• Proficient understanding of Git
• Good understanding of browser rendering behavior and performance
• Basic understanding of HTTP requests and proficiency in creating REST APIs using Swagger
• Strong understanding of relational databases and its concepts - MySQL
• Ability to write database queries and transactions using sequalize ORM
• We would prefer it the candidate has an experience of min 1 year but a maximum of 3 years with all above mentioned technologies, libraries and frameworks

About the Role

We, at upGrad, believe in giving ownership and responsibility to each one of the team members. As an iOS Developer, you will be a part of the iOS app development team and strive to deliver the best learning experience out there to our learners that upGrad is known for. You will be responsible for developing features, taking those features to production and maintaining the existing code.

Innovative nature and pro-active involvement in the product is taken very seriously at upGrad, therefore, a major part of your role would involve thinking about new features and new ways to deliver quality learning experience to our learners.

Roles & Responsibilities

• Own end to end development and operations of high-performance software development team.
• Design the architecture and deliver clean, testable, and scalable code 
• Participate in requirement gathering and display a strong sense of ownership and delivery 
• Maintain high standards of software quality within the team by
• Participating in regular peer-reviews of solution designs and related code 
• Provide technical leadership to teammates through coaching and mentorship.

Skills Required

• Minimum 6 years of strong iOS development experience with at least 2 Apps Published on App Store of Enterprise Platform.
• Strong Swift concepts along with OOPS, Computer Science fundamentals, Memory Management, App Profiling experience.
• In depth understanding of frameworks like UIKit, Foundation classes, AutoLayout, Core Data, Networking, Collections, GCD, ARC.
• Solid understanding to write modular code, template based programming which is Unit testable (Critical Requirement)
• Solid understanding of iOS architectural patterns especially VIPER (and MVVM) and their importance in scalable software development process.
• Prior understanding of Git (must have), JIRA, Trello, Confluence, etc
• Experience in iOS UI creation using Storyboards, XIB and Code.
• Experience with standard libraries like RxSwift, Swinject, Alamofire, etc.
• Good written and verbal communication.
• Ability to collaborate with multiple teams to work on different phases of the project.
• Knowledge about App Store, publishing an app and the common rejection reasons.