Interface InferenceComponentRuntimeConfig.Builder

  • Method Details

    • copyCount

      The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.

      Parameters:
      copyCount - The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.
      Returns:
      Returns a reference to this object so that method calls can be chained together.