Interface AutomatedReasoningPolicyGeneratedTestCase.Builder

All Superinterfaces:
Buildable, CopyableBuilder<AutomatedReasoningPolicyGeneratedTestCase.Builder,AutomatedReasoningPolicyGeneratedTestCase>, SdkBuilder<AutomatedReasoningPolicyGeneratedTestCase.Builder,AutomatedReasoningPolicyGeneratedTestCase>, SdkPojo
Enclosing class:
AutomatedReasoningPolicyGeneratedTestCase
@Mutable @NotThreadSafe public static interface AutomatedReasoningPolicyGeneratedTestCase.Builder extends SdkPojo, CopyableBuilder<AutomatedReasoningPolicyGeneratedTestCase.Builder,AutomatedReasoningPolicyGeneratedTestCase>

  • Method Details

    • queryContent

      AutomatedReasoningPolicyGeneratedTestCase.Builder queryContent(String queryContent)

      The input query or prompt that generated the content. This provides context for the validation.

      Parameters:
      queryContent - The input query or prompt that generated the content. This provides context for the validation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • guardContent

      AutomatedReasoningPolicyGeneratedTestCase.Builder guardContent(String guardContent)

      The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.

      Parameters:
      guardContent - The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • expectedAggregatedFindingsResult

      AutomatedReasoningPolicyGeneratedTestCase.Builder expectedAggregatedFindingsResult(String expectedAggregatedFindingsResult)

      The expected results of the generated test case. Possible values include:

      • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

      • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

      • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

      • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

      Parameters:
      expectedAggregatedFindingsResult - The expected results of the generated test case. Possible values include:

      • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

      • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

      • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

      • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • expectedAggregatedFindingsResult

      AutomatedReasoningPolicyGeneratedTestCase.Builder expectedAggregatedFindingsResult(AutomatedReasoningCheckResult expectedAggregatedFindingsResult)

      The expected results of the generated test case. Possible values include:

      • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

      • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

      • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

      • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

      Parameters:
      expectedAggregatedFindingsResult - The expected results of the generated test case. Possible values include:

      • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

      • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

      • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

      • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: