W4M.ai is a platform offering expert-driven evaluation, annotation, and training data for AI models, leveraging 1000+ US-based Masters and PhD-level experts.

Vocalize.ai

Web

ai evaluation

Vocalize.ai is a software suite for advancing conversations between humans and computers, evaluating AI virtual assistants' hearing capabilities and inclusivity.

Patronus AI

Patronus AI is an AI evaluation and optimization platform that helps teams ship top-tier AI products using industry-leading AI research and tools.

EvalAI

Web

ai evaluation

EvalAI is an open source platform for evaluating and comparing machine learning (ML) and artificial intelligence (AI) algorithms at scale.

Parea AI

Freemium

Web

ai evaluation

Parea AI helps teams confidently ship LLM apps to production with experiment tracking, observability, and human annotation. It supports integrations with major LLM providers & frameworks.

EvalsOne

Web

ai evaluation

EvalsOne is an intuitive, comprehensive platform for evaluating and optimizing GenAI-driven products and AI agents, streamlining LLMOps workflows.

LastMile AI

Freemium

Web

ai evaluation

LastMile AI is an enterprise-grade evaluation platform for testing, evaluating, and benchmarking AI applications, offering tools like AutoEval for metrics, fine-tuning, synthetic data, and monitoring.