Test your knowledge in live multiplayer Jeopardy-style trivia battles with AI-assisted grading that recognizes correct answers even with spelling mistakes.
Rubra
Rubra is a collection of open-weight, tool-calling LLMs that enhance top open-source large language models with deterministic tool-calling for agentic use cases.
No paid plan
Free
About Rubra
Rubra is a collection of open-weight, tool-calling LLMs designed to enhance top open-source large language models. It adds deterministic tool-calling capability, making these models ideal for agentic use cases. Rubra models are post-trained and use methods to teach new skills while mitigating catastrophic forgetting. They extend popular inferencing projects like llama.cpp and vLLM for easy local use, providing OpenAI-compatible tool-calling. Rubra excels in complex, multi-step function calls, outperforming original models and other fine-tunes in this area. The models are trained on a high-quality dataset of over 1 million conversations and tool calls, with thousands of A100/H100 GPU hours. Rubra models are published under the same license as their parent models, while Rubra code is Apache 2.0 licensed.
Rubra features
- free demo available on huggingface spaces
- ideal for agentic use cases
- supports complex, multi-step function calls ('chain of function')
- extends popular inferencing projects (llama.cpp, vllm) for local use
- mitigates catastrophic forgetting during enhancement
- deterministic tool-calling capability
- enhances top open-source llms (meta-llama-3, gemma, mistral, phi-3, qwen2)
- open-weight, tool-calling llms
Rubra pricing
Is Rubra free? Yes, Rubra has a free plan.
Free
Free
- Open-weight, tool-calling LLMs
- Access to enhanced models
- Demo via Huggingface Spaces
- Local deployment with extended inferencing tools
Rubra FAQs
Who are the intended users of Rubra?
Rubra models are for anyone looking to use open source LLMs with native function calling support, which yields superior results in local LLMs when compared to prompting models to return tool calls.
Why use Rubra models over Llama, Mistral, or other popular fine tunes like Hermes Pro or Gorilla OpenFunctions?
Rubra models are capable of complex, multi-step, function calls (chain of function) and enhance popular open source instruct LLMs while retaining their original capabilities.
Mistral-7B-Instruct-v0.3 has tool calling capability, so why use Rubra enhanced Mistral-7B-Instruct-v0.3
Rubra enhanced Mistral-7B-Instruct-v0.3 is capable of complex tool calling that the original model falls short of, demonstrating superior multi-step function chaining.
vLLM has tool calling capability, so why use Rubra?
Rubra enhanced models and custom vLLM give the LLM full discretion on when to make a tool call or reply with an assistant message, unlike vLLM which expects tool calls.
How were Rubra models trained?
Models were trained on a high-quality tool calling dataset (1M+ conversations) using thousands of A100/H100 GPU hours, with iterative training techniques for fast convergence.
Why do the benchmark results differ from the ones found in parent model cards?
Benchmark results differ due to constant improvements in evaluation tools (LM Evaluation Harness, FastChat LLM Judge) and updates to judging models, but Rubra does not game benchmarks.
How did you construct the training set for Rubra models?
The training set was constructed using the 'chain of function' concept, focusing on multi-step, consecutive function calls to achieve complex goals, exemplified by customer feedback processing.
Ratings & reviews
No reviews yet. Be the first to share how Rubra worked for you.
Sponsored tools
Connect with engaged niche audiences or monetize your subscriber base through an automated marketplace featuring verified metrics and secure Stripe payments.
Swap characters, backgrounds, or styles in any video while preserving original motion and camera paths. Perfect for digital marketers and creators.
Track brand citations and mentions across Google AI Mode, ChatGPT, Claude, and more. Discover top-cited sources and queries with zero signup required.