AI Validation Engineer

As an AI Validation Engineer, you'll play a critical role in ensuring our AI-powered products fully meets all specifications, functional requirements, and quality standards. Your work goes beyond verifying AI-generated code, you will holistically test product features, user flows, and performance metrics. You will collaborate with product managers, developers, UX designers, and data science teams to ensure that every aspect of the software, from code correctness to user experience, aligns with stated business and technical requirements.

Ready to shape the future of AI-driven products? We can't wait to meet you

Responsibilities

• Work with product owners to translate specifications and business goals into clear, testable criteria for AI-driven features
• Design and run tests (unit to UAT) for AI and traditional code, ensuring smooth integration across the stack
• Validate functionality in real-world scenarios and edge cases, ensuring usability and accessibility for an inclusive user experience
• Test performance, load, and scalability of AI components with DevOps, optimizing bottlenecks in algorithms and data flows
• Ensure security and compliance with industry regulations for AI and manual code, documenting vulnerabilities and solutions
• Evaluate AI system behavior, identifying biases, fairness issues, and ethical/legal concerns in models and data pipelines
• Track defects and lead root cause analysis, collaborating with data scientists to refine prompts, models and data
• Document and report testing outcomes, maintaining evolving documentation on AI integration, best practices, and limitations
• Collaborate cross-functionally to refine requirements, ensure usability, and provide comprehensive testing for AI-powered features
• Employ and refine automation frameworks and develop specialized AI-testing tools for robust regression testing, detecting logical, functional, or ethical issues

Technical Skills

• BS/MS in Computer Science or related technical field
• Familiarity with AI code generation tools
• A solid understanding of ML concepts (training, inference, evaluation metrics)
• Familiarity with AI agent development concepts
• Proficiency in scripting languages such as Python, JavaScript, or Shell scripting
• Strong understanding of testing methodologies, test automation frameworks, and testing tools
• Good knowledge of Linux OS
• Experience with performance testing tools and techniques is a plus
• Basic SQL knowledge is required, familiarity with Non-SQL databases is a plus
• Good programming skills in PHP or JavaScript ) are considered a plus
• Familiarity with Linux profilers/debuggers is beneficial

Professional Skills

• Analytical mindset with excellent problem-solving skills
• Attention to detail and ability to thoroughly document test cases and results
• Proactive approach to identifying and addressing quality issues
• Ability to adapt to changing priorities
• Curiosity and eagerness to explore and use new tools and technologies

Collaboration and Soft Skills

• Effective communication skills to collaborate with cross-functional teams
• Self-motivated with the ability to work independently with minimal supervision
• Strong time management and organizational skills
• Willingness to learn and stay updated on industry best practices in Quality Assurance

Benefits

• Above industry financial benefits
• Over 20 benefits, from VIP medical insurance to shares and support programs
• Major technical challenges in real-time communications, high performance service delivery, data analytics
• Healthy snacks
• Full support for relocation to Bucharest (including from abroad)
• Easy access to our office. We even have a Hugmobil to make your commute as short as possible.

Find out more about our team:

The recruiting process is tough (not long). You will take challenging tests while meeting your future colleagues. We guarantee full confidentiality of all applications.