VMLU
Click to visit website
About
VMLU is a human-centric benchmark suite designed to assess the overall capabilities of foundation models, with a particular focus on the Vietnamese language. It comprises 10,880 multiple-choice questions covering 58 distinct subjects across four domains: STEM, Humanities, Social Sciences, and others. The benchmark spans a wide range of difficulty levels, from elementary proficiency to advanced professional expertise, challenging foundation models in both general knowledge and complex problem-solving. The dataset primarily originates from examinations administered by various esteemed educational institutions and the Ministry of Education and Training. It also provides a Github repository with extensive information, benchmarking results for publicly available models, and accessible benchmarking code.
Platform
Features
• covers 58 distinct subjects
• dataset available for download (vi-mqa, vi-dialog, vi-drop, vi-squad)
• provides accessible benchmarking code
• includes benchmarking results for publicly available models
• wide range of difficulty levels (elementary to professional)
• spans four domains: stem, humanities, social sciences, and others
• 10,880 multiple-choice questions
• vietnamese multitask language understanding benchmark
Pricing Plans
Free
Free Plan• Access to VMLU dataset
• Benchmarking code
• Public leaderboard access
• 58 distinct subjects
• 10,880 multiple-choice questions
Job Opportunities
There are currently no job postings for this AI tool.
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Featured Tools
GirlfriendGPT
NSFW AI chat platform with customizable characters, AI image generation, and voice chat. Explore roleplay and intimate interactions with AI companions.
View Details
Animate My Pic
Animate My Pic is an AI photo to video tool that leverages advanced AI to effortlessly animate your pictures, offering image-to-video, text-to-video, and 30+ effects.
View Details
KeevX
KeevX is an AI-powered platform for generating video ads, translating and dubbing videos with lip sync, and turning ideas into visual content.
View Details
Voxdeck
Voxdeck is an AI tool that transforms ideas and documents into captivating, attention-grabbing slides and motion-rich presentations effortlessly.
View Details
Nano Banana AI
Nano Banana AI is a powerful AI image editor for quick, precise editing, adjustments, and optimization of images, leveraging advanced image-to-image AI models.
View Details
Nano Banana
Nano Banana is Google's state-of-the-art AI image generator powered by Gemini 2.5 Flash Image, offering character consistency and natural language image transformation.
View Details
alivemoment
alivemoment is an AI tool that transforms cherished photos into living stories, allowing users to relive precious moments with gentle, lifelike motion.
View Details