LiteLLM favicon

LiteLLM

Hiring
LiteLLM screenshot
Click to visit website
Feature this AI

About

LiteLLM serves as an essential LLM Gateway, simplifying how platform teams provide developers with access to a wide range of large language models. It supports over 100 LLMs, including Azure, Gemini, Bedrock, OpenAI, and Anthropic, all through an OpenAI-compatible API format. Key functionalities include comprehensive cost tracking to accurately charge teams for usage, automatic spend tracking across various providers, and tag-based tracking, with options to log spend to S3/GCS. LiteLLM also offers critical features like LLM fallbacks, budgets, rate limiting, guardrails, prompt management, and observability. It streamlines LLM management by standardizing logging and authentication, significantly reducing operational complexities and enabling swift adoption of new models.

Platform
Web
Task
llm api management

Features

prompt management

rate limiting

llm observability

llm fallbacks

openai-compatible api

s3/gcs logging

cost tracking & budgets

unified llm access (100+ models)

Job Opportunities

LiteLLM favicon
LiteLLM

Staff Software Engineer

LiteLLM is an LLM Gateway providing unified model access, fallbacks, and spend tracking across 100+ LLMs, all in an OpenAI-compatible format.

engineeringremoteUS
$170K - $210K
full-time

Experience Requirements:

  • 6+ years

Other Requirements:

  • US citizen/visa only

  • Python

  • Microservices

  • PostgreSQL

  • Amazon Web Services (AWS)

  • System Thinker

  • Amazing Communicator

  • Autonomous

  • Foresight

  • Skilled Collaborator

Responsibilities:

  • Close the gap between current and target technical quality standards

  • Lead the successful delivery of complex cross-functional projects

  • Independently identify and champion work which generates the most value to the organization

  • Drive the design and implementation of mortgage industry-specific features and improvements

  • Integrate mortgage industry standards and best practices into our software design and architecture

Show more details

Backend Engineer (Golang)

LiteLLM is an LLM Gateway providing unified model access, fallbacks, and spend tracking across 100+ LLMs, all in an OpenAI-compatible format.

Benefits:

  • Cutting-Edge Innovation

  • Growth Opportunities

  • Collaborative Culture

  • Competitive Compensation

Experience Requirements:

  • 3+ years

Other Requirements:

  • US citizenship/visa not required

  • Go

  • Distributed Systems

  • Proficiency in Golang

  • Experience with AI-Driven Tools

  • Strong Technical Foundations

  • Problem-Solving Mindset

  • Team-First Attitude

  • Adaptability & Resilience

Responsibilities:

  • Architect & Build: Develop high-performance, scalable backend services and microservices using Golang.

  • Embrace AI Tools: Use Windsurf, Cursor, or similar AI-driven coding tools to accelerate development and maintain top-notch code quality.

  • Optimize & Iterate: Write clean, testable, and efficient code; perform code reviews to ensure best practices and continuous improvement.

  • Collaborate Cross-Functionally: Work with product managers, frontend engineers, and data scientists to deliver seamless end-to-end solutions.

  • Troubleshoot & Maintain: Diagnose, debug, and resolve complex issues in production, ensuring reliability and uptime.

Show more details

Senior Software Engineer (Backend)

LiteLLM is an LLM Gateway providing unified model access, fallbacks, and spend tracking across 100+ LLMs, all in an OpenAI-compatible format.

Benefits:

  • Comprehensive benefits packages designed to support your health and well-being

  • Competitive comp & equity

  • Plenty of PTO

  • Floating holidays to honor the days that matter most to you

  • Flexible remote work

Education Requirements:

  • Bachelor's or Master's degree in Computer Science or related field (bonus)

Experience Requirements:

  • 6+ years of experience with Go and designing REST APIs

Other Requirements:

  • US citizen/visa only

  • Go

  • Software Architecture

  • Information Security

  • Data Modeling

  • PostgreSQL

  • Scrappy; prior startup experience

  • Pragmatic

  • Expert time management

  • Comfortable wearing many hats

  • Experience in (and thrives in) a fast-moving, start-up engineering environment

Responsibilities:

  • Develop and maintain backend services and APIs written in Go

  • Implement and improve metrics and distributed tracing across our services

  • Optimize PostgreSQL database performance and queries

  • Collaborate with the Engineering team on improving the overall Developer Experience

  • Implement security best practices

Show more details

Explore AI Career Opportunities

Social Media

discord

Ratings & Reviews

No ratings available yet. Be the first to rate this tool!

Featured Tools

Sora2 AI Video Generator favicon
Sora2 AI Video Generator

Sora2 AI Video Generator is an advanced tool powered by OpenAI's Sora2 technology, creating cinema-quality 1080p videos from text and images with realistic physics and perfect character consistency.

View Details
Animate Image AI favicon
Animate Image AI

Animate Image AI is a platform that allows you to create captivating animations from your photos. It uses advanced AI technology to bring your photos to life.

View Details
Image To Image favicon
Image To Image

Image To Image is a cutting-edge AI photo generator transforming images with high quality and precise prompt control, offering instant creative evolution.

View Details
AI Make Song favicon
AI Make Song

AI Make Song is your ultimate AI song generator and music maker, designed to help anyone create professional-quality AI music free in minutes.

View Details
CrePal favicon
CrePal

CrePal is the world's first AI Video Creation Agent, transforming ideas into stunning videos with cutting-edge AI models for planning, imaging, and video generation.

View Details
Yolly AI favicon
Yolly AI

Yolly AI is an all-in-one AI video & photo generator that lets you turn a single text prompt into cinema-grade 4K videos or high-resolution images.

View Details
Seedance 1.5 favicon
Seedance 1.5

Seedance 1.5 is a next-generation AI video creation tool transforming ideas into stunning 1080p videos with multi-shot narratives, physics-accurate motion, and cinematic quality.

View Details
Unblur Image Online Free favicon
Unblur Image Online Free

Unblur Image Online Free instantly restores sharpness to blurry photos using AI. Upload JPG, PNG, or WEBP files for clear images in seconds, completely free and no sign-up needed.

View Details
adly.news favicon
adly.news

adly.news is a free platform that simplifies newsletter advertising, connecting businesses with engaged audiences through ad slots, offering bidding, negotiation, and messaging.

View Details
Miss Pepper AI favicon
Miss Pepper AI

Miss Pepper AI is an AI-powered platform for smarter marketing, offering SEO, marketing automation, and identity resolution to drive measurable results and uncover customer insights.

View Details