Promptfoo
Click to visit website
About
Promptfoo is an open-source AI security and testing tool used by 51,000+ developers. It offers features for LLM evaluations, vulnerability scanning, and red teaming, helping developers build secure and reliable AI applications. It provides a command-line interface, live reloads, and caching. It's used by teams serving millions of users and has community and enterprise versions with varying features such as continuous monitoring, team collaboration, and custom plugins. It has been featured in OpenAI Build Hours and Anthropic courses.
Platform
Keywords
Features
• continuous monitoring
• llm evaluation
• vulnerability scanning
• centralized security/compliance dashboard
• team sharing & collaboration
• local or self-hosted deployment
• custom integration with own app
• model provider integrations
FAQs
What's included in the Community version?
The Community version includes all core features for local testing, evaluation, and vulnerability scanning.
Who needs the Enterprise version?
Larger teams and organizations that want to continuously monitor risk in development and production.
How does Enterprise pricing work?
Enterprise pricing is customized based on your team's size and needs. Contact us for a personalized quote.
Can I upgrade from Community to Enterprise?
Yes, you can easily upgrade to Enterprise at any time to access additional features and support.
Pricing Plans
Community
Free Plan• All LLM evaluation features
• All model providers and integrations
• No usage limits
• Custom integration with your own app
• Run locally or self-host on your own infrastructure
• Vulnerability scanning
• Community support
Enterprise
Unknown Price• All Community features
• Team sharing & collaboration
• Continuous monitoring
• Centralized security/compliance dashboard
• Customized red teaming plugins
• SSO and Access Control
• Cloud deployment
• Priority support & SLA guarantees
On-Premise
Unknown Price• All Enterprise features
• Deployment on your own infrastructure
• Complete data isolation
• Dedicated support team
Job Opportunities
Engineering
Open-source AI security testing tool for building reliable and secure LLM applications.
Experience Requirements:
Self-driven generalist
Ability to build and ship quickly
Aggressive prioritization
Passion for security, developer tools, and AI
Other Requirements:
Contributions to promptfoo preferred
Show more details
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Featured Tools
Songmeaning
Songmeaning uses AI to reveal the stories and meanings behind song lyrics. It offers lyric translation and AI music generation.
View Details
Whisper Notes
Offline AI speech-to-text transcription app using Whisper AI. Supports 80+ languages, audio file import, and offers lifetime access with a one-time purchase. Available for iOS and macOS.
View Details
GitGab
Connects Github repos and local files to AI models (ChatGPT, Claude, Gemini) for coding tasks like implementing features, finding bugs, writing docs, and optimization.
View Details
nuptials.ai
nuptials.ai is an AI wedding planning partner, offering timeline planning, budget optimization, vendor matching, and a 24/7 planning assistant to help plan your perfect day.
View Details
Make-A-Craft
Make-A-Craft helps you discover craft ideas tailored to your child's age and interests, using materials you already have at home.
View DetailsPixelfox AI
Free online AI photo editor with comprehensive tools for image, face/body, and text. Features include background/object removal, upscaling, face swap, and AI image generation. No sign-up needed, unlimited use for free, fast results.
View Details
Smart Cookie Trivia
Smart Cookie Trivia is a platform offering a wide variety of trivia questions across numerous categories to help users play trivia, explore different topics, and expand their knowledge.
View Details
Code2Docs
AI-powered code documentation generator. Integrates with GitHub. Automates creation of usage guides, API docs, and testing instructions.
View Details