GenerationConfiguration
Contains configurations for response generation based on the knowledge base query results.
This data type is used in the following API operations:
Types
Properties
Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.
The configuration details for the guardrail.
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.
The latency configuration for the model.
Contains the template for the prompt that's sent to the model for response generation. Generation prompts must include the $search_results$ variable. For more information, see Use placeholder variables in the user guide.