W4M.ai is a platform offering expert-driven evaluation, annotation, and training data for AI models, leveraging 1000+ US-based Masters and PhD-level experts.

RagaAI Catalyst

Freemium

Web

ai evaluation

RagaAI Catalyst is a sophisticated platform optimized for AI observability, monitoring and evaluation, helping deploy AI agents with confidence.

Patronus AI

Patronus AI is an AI evaluation and optimization platform that helps teams ship top-tier AI products using industry-leading AI research and tools.

EvalAI

Web

ai evaluation

EvalAI is an open source platform for evaluating and comparing machine learning (ML) and artificial intelligence (AI) algorithms at scale.

Parea AI

Freemium

Web

ai evaluation

Parea AI helps teams confidently ship LLM apps to production with experiment tracking, observability, and human annotation. It supports integrations with major LLM providers & frameworks.

LastMile AI

Freemium

Web

ai evaluation

LastMile AI is an enterprise-grade evaluation platform for testing, evaluating, and benchmarking AI applications, offering tools like AutoEval for metrics, fine-tuning, synthetic data, and monitoring.