AI Verification Engineer

We are seeking a talented and motivated AI Verification Engineer to join our team. The ideal candidate will be responsible for the validation of our AI and Machine Learning systems, ensuring that they meet all necessary quality assurance requirements and work reliably and optimally in real-world scenarios. The role requires strong analytical skills, a good understanding of AI and ML technologies, and a dedication to achieving excellence in the production of state-of-the-art systems.

Key Responsibilities:

1. Develop and execute validation strategies and test plans for AI and ML systems, during development and on production environments.
2. Work closely with AI/ML engineers and data scientists in understanding system requirements and capabilities and coming up with key metrics for system efficacy.
3. Evaluate the system performance under various operating conditions, data variety, and scenarios.
4. Perform functional, stress, system, and other testing types to ensure our systems' reliability and robustness.
5. Create automated test procedures and systems for regular verification and validation processes, and detect any abnormal anomalies in usage.
6. Report and track defects, providing detailed information to facilitate problem resolution.
7. Lead the continuous review and improvement of validation and testing methodologies, procedures, and tools.
8. Provide detailed reports and documentation on system performance, issues, and validation results.

Required Skills & Qualifications:

1. Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
2. Proven experience in the testing and validation of AI/ML systems or equivalent complex systems.
3. Good knowledge and understanding of AI and ML concepts, tools, and frameworks.
4. Proficient in scripting and programming languages such as Python, shell scripts etc.
5. Experience with AI/ML platforms and libraries such as TensorFlow, PyTorch, Keras, or Scikit-Learn.
6. Excellent problem-solving abilities and attention to detail.
7. Strong communication skills, with the ability to document and explain complex technical concepts clearly.
8. Ability to work in a fast-paced, collaborative environment.

Preferred Skills & Qualifications:

1.  A good understanding of various large language models, image models, and their comparative strengths and weaknesses.
2. Knowledge of CI/CD pipelines and experience with tools such as Jenkins, Git, Docker.
3. Experience with cloud platforms like AWS, Google Cloud, or Azure.
4. Understanding of Data Analysis and Visualization tools and techniques.