VMLU
Click to visit website
About
VMLU is a human-centric benchmark suite specifically designed to assess the overall capabilities of foundation models, with a strong specialization for the Vietnamese language. It comprises four distinct datasets: Vi-MQA for multiple-choice question answering, Vi-SQuAD for reading comprehension, Vi-DROP for logical reasoning, and Vi-Dialog for conversational ability. These datasets offer diverse evaluation tasks spanning general knowledge, reading comprehension, logical reasoning, and conversational ability, enriching Vietnamese NLP evaluation benchmarks. The platform aims to drive the development of more robust foundation models and encourage further research in LLMs. The dataset sources include examinations from various educational institutions and the Ministry of Education and Training. VMLU also provides a GitHub repository with extensive information, benchmarking results for publicly available models, and accessible benchmarking code for replication.
Platform
Features
• extensive dataset sourced from educational institutions
• offers reproducible benchmarking code for replication
• provides benchmarking results for publicly available models
• evaluates general knowledge, reading comprehension, logical reasoning, and conversational ability
• comprises four distinct datasets: vi-mqa, vi-squad, vi-drop, vi-dialog
• specialized for vietnamese language models
• human-centric benchmark suite for llms
Pricing Plans
Free
Free Plan• Access to Vi-MQA dataset
• Access to Vi-SQuAD dataset
• Access to Vi-Drop dataset
• Access to Vi-Dialog dataset
• Access to Github repository with benchmarking code
Job Opportunities
There are currently no job postings for this AI tool.
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Featured Tools
adly.news
adly.news is a free platform that simplifies newsletter advertising, connecting businesses with engaged audiences through ad slots, offering bidding, negotiation, and messaging.
View Details
AI Dubbing
AI Dubbing is a free AI video dubbing tool that uses advanced AI technology to provide natural, smooth, high-quality dubbing services, supporting 20+ languages and 100+ tones.
View Details
Infatuated.AI
Infatuated.AI is an AI companion platform allowing users to chat, roleplay, and build personalized relationships with AI girlfriends and boyfriends, offering emotional support and secure fantasy sharing.
View Details
ImgGen
ImgGen is the free AI editor that edits photos and turns images into videos in seconds, offering instant creativity all in one place.
View Details
Nano Banana
Nano Banana is a state-of-the-art AI model that revolutionizes text-based image editing and generation with unmatched multi-image fusion and natural language understanding.
View Details
Macaron
Macaron is the world’s first personal AI agent designed to help you live better by focusing on happiness, health, and freedom, unlike typical productivity tools.
View Details
VISBOOM
Visboom is the all-in-one AI fashion content creation platform, enabling brands and e-commerce sellers to generate on-model photoshoots and visual assets quickly.
View Details
Banana AI
Banana AI is an advanced AI photo editor powered by Google’s Nano Banana technology (Gemini 2.5 Flash Image), enabling effortless image editing, restyling, and transformation with simple text prompts.
View Details
twainGPT
twainGPT is a humanizer that transforms any AI-generated text into undetectable, human-like content, trusted by over 2.3 million users.
View Details
AI Image Editor
AI Image Editor is a free online tool to edit, transform, and enhance photos with a text prompt, achieving fast, consistent, high-quality results.
View Details