Builder

class Builder

Properties

Link copied to clipboard

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.

Link copied to clipboard

The configuration details for the guardrail.

Link copied to clipboard

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.

Link copied to clipboard

The latency configuration for the model.

Link copied to clipboard

Contains the template for the prompt that's sent to the model for response generation. Generation prompts must include the $search_results$ variable. For more information, see Use placeholder variables in the user guide.

Functions