respond

abstract suspend fun respond(request: ModelRequest): JsonValue(source)

Answers a single request.

At minimum, send ModelRequest.prompt. If the prompt exceeds your input limit, shrink it with ModelRequest.droppingLowestPriorityContextItem.

Return

The model's structured response.

Parameters

request

The request to answer.