local.ai
Click to visit website
About
local.ai is a free and open-source native application for managing, verifying, and performing inferencing with AI models offline. It features a robust model downloader with digest verification (BLAKE3 and SHA256) to ensure model integrity. The app supports CPU inferencing, adapting to available threads and offering GGML quantization options. A local streaming server allows quick AI inference with a UI that writes to .mdx and supports inference parameters and remote vocabulary. Future features include GPU inferencing, parallel sessions, nested directories, custom sorting and searching, model explorer, model search, model recommendation, server management, and audio/image support. The app is available for Windows, macOS (Intel and M1/M2), and Linux.
Platform
Task
Features
• cpu inferencing
• digest compute
• directory agnostic
• usage-based sorting
• resumable, concurrent downloader
• adapts to available threads
• known-good model api (local.ai's known-good model api for model verification), license and usage chips, blake3 quick check, model info card, streaming server, quick inference ui, writes to .m
• ggml quantization q4, 5.1, 8, f16
Job Opportunities
There are currently no job postings for this AI tool.
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Alternatives
Awan LLM
Awan LLM is a cost-effective and unrestricted cloud-based AI Inference Platform providing unlimited tokens for power users and developers. They own their GPUs for fast and affordable API endpoints without usage restrictions.
View Details
Inferenceable
Open-source AI inference server written in Node.js, utilizing llama.cpp and parts of llamafile C/C++ core.
View DetailsFeatured Tools
Songmeaning
Songmeaning uses AI to reveal the stories and meanings behind song lyrics. It offers lyric translation and AI music generation.
View Details
Whisper Notes
Offline AI speech-to-text transcription app using Whisper AI. Supports 80+ languages, audio file import, and offers lifetime access with a one-time purchase. Available for iOS and macOS.
View Details
GitGab
Connects Github repos and local files to AI models (ChatGPT, Claude, Gemini) for coding tasks like implementing features, finding bugs, writing docs, and optimization.
View Details
nuptials.ai
nuptials.ai is an AI wedding planning partner, offering timeline planning, budget optimization, vendor matching, and a 24/7 planning assistant to help plan your perfect day.
View Details
Make-A-Craft
Make-A-Craft helps you discover craft ideas tailored to your child's age and interests, using materials you already have at home.
View DetailsPixelfox AI
Free online AI photo editor with comprehensive tools for image, face/body, and text. Features include background/object removal, upscaling, face swap, and AI image generation. No sign-up needed, unlimited use for free, fast results.
View Details
Smart Cookie Trivia
Smart Cookie Trivia is a platform offering a wide variety of trivia questions across numerous categories to help users play trivia, explore different topics, and expand their knowledge.
View Details
Code2Docs
AI-powered code documentation generator. Integrates with GitHub. Automates creation of usage guides, API docs, and testing instructions.
View Details