VMLU
Click to visit website
About
VMLU is a human-centric benchmark suite specifically designed to assess the overall capabilities of foundation models, with a strong specialization for the Vietnamese language. It comprises four distinct datasets: Vi-MQA for multiple-choice question answering, Vi-SQuAD for reading comprehension, Vi-DROP for logical reasoning, and Vi-Dialog for conversational ability. These datasets offer diverse evaluation tasks spanning general knowledge, reading comprehension, logical reasoning, and conversational ability, enriching Vietnamese NLP evaluation benchmarks. The platform aims to drive the development of more robust foundation models and encourage further research in LLMs. The dataset sources include examinations from various educational institutions and the Ministry of Education and Training. VMLU also provides a GitHub repository with extensive information, benchmarking results for publicly available models, and accessible benchmarking code for replication.
Platform
Features
• extensive dataset sourced from educational institutions
• offers reproducible benchmarking code for replication
• provides benchmarking results for publicly available models
• evaluates general knowledge, reading comprehension, logical reasoning, and conversational ability
• comprises four distinct datasets: vi-mqa, vi-squad, vi-drop, vi-dialog
• specialized for vietnamese language models
• human-centric benchmark suite for llms
Pricing Plans
Free
Free Plan• Access to Vi-MQA dataset
• Access to Vi-SQuAD dataset
• Access to Vi-Drop dataset
• Access to Vi-Dialog dataset
• Access to Github repository with benchmarking code
Job Opportunities
There are currently no job postings for this AI tool.
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Featured Tools
adly.news
adly.news is a free platform that simplifies newsletter advertising, connecting businesses with engaged audiences through ad slots, offering bidding, negotiation, and messaging.
View Details
PDF Translator
PDF Translator is an AI-powered tool for instant document translations. Upload PDFs, select from 100+ languages, and get format-preserving translations for free.
View Details
DeVoice
DeVoice is an AI-powered audio and video tool that offers unlimited, accurate transcription, AI rap generation, and background noise removal capabilities.
View Details
DeepSwapAI
DeepSwapAI is a professional AI face swap platform for developers, offering enterprise-grade face exchange technology with RESTful API, SDKs, and batch processing.
View DetailsFace Swap AI
Face Swap AI is a free AI tool for instant face swapping in photos and videos, delivering stunning HD results without signup or watermarks for creative projects.
View Details
StoryShort
StoryShort is an AI creation tool that helps you create viral faceless videos on auto-pilot, generating engaging content in minutes.
View Details
AIhumanize
AIhumanize is an advanced AI humanizer tool that transforms AI-written text into natural, authentic writing, helping you bypass all major AI detectors.
View Details
LoveGen AI
LoveGen AI is an all-in-one platform integrating major image and video AI models, enabling creation from text, visual enhancement, and video generation.
View Details
Capacity
Capacity is an AI tool that helps you turn any idea into a working web app, including fullstack applications and cloned websites, without writing code.
View DetailsNano Banana Pro
Nano Banana Pro is a reasoning-first 4K AI image editor designed for creative teams to generate lossless 4K visuals, transparent PNGs, and high-quality exports.
View Details
ImageTranslator
ImageTranslator is an AI-powered online tool that translates text in images instantly, supporting over 100 languages while preserving original layout.
View DetailsSeedance 2
Seedance 2 is a groundbreaking AI video generation technology that delivers 1080p cinematic quality with advanced motion synthesis and multi-shot storytelling.
View Details
KissGen AI
KissGen AI is the best AI kissing video generator, transforming memories into lifelike kissing videos with realistic animations and custom styles.
View Details