Outlines

About

Outlines guarantees structured outputs during generation, directly constraining any LLM to produce valid JSON, regex-matched text, context-free grammars, multiple-choice, or Pydantic models. Same code runs across OpenAI, Gemini, vLLM, Ollama, transformers, and llama.cpp — switch models without changing code. Developed and maintained by .txt (dottxt), and trusted in production by NVIDIA, Cohere, HuggingFace, and vLLM. Eliminates the parsing-and-retry headache for production LLM applications.

Topics