Interface

An API feature that allows LLMs to output structured function invocations rather than (or in addition to) natural language. The model is given function definitions (name, parameters, descriptions), an...

An API endpoint that accepts inference requests and returns model predictions. Inference endpoints abstract away the complexity of model serving—clients send requests (prompts) and receive responses (...

An API setting that constrains model output to be valid JSON, without specifying a particular schema. JSON mode guarantees parseable JSON but not any specific structure—the model chooses the keys and ...