Skip to main content

LLM Inference in Production

Introduction
LLM inference basics
Getting started
Inference optimization
Infrastructure and operations

Tool integration

📄️ Function calling

Learn what function calling is and its use case.

📄️ Model Context Protocol

Learn what Model Context Protocol (MCP) is and its use case.

Choosing the right inference framework

Function calling