Class TokenUsage
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<TokenUsage.Builder,TokenUsage>
The tokens used in a message API inference call.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic TokenUsage.Builderbuilder()final List<CacheDetail> Detailed breakdown of cache writes by TTL.final IntegerThe number of input tokens read from the cache for the request.final IntegerThe number of input tokens written to the cache for the request.final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final booleanFor responses, this returns true if the service returned a value for the CacheDetails property.final inthashCode()final IntegerThe number of tokens sent in the request to the model.final IntegerThe number of tokens that the model generated for the request.static Class<? extends TokenUsage.Builder> Take this object and create a builder that contains all of the current property values of this object.final StringtoString()Returns a string representation of this object.final IntegerThe total of input tokens and tokens generated by the model.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
inputTokens
The number of tokens sent in the request to the model.
- Returns:
- The number of tokens sent in the request to the model.
-
outputTokens
The number of tokens that the model generated for the request.
- Returns:
- The number of tokens that the model generated for the request.
-
totalTokens
The total of input tokens and tokens generated by the model.
- Returns:
- The total of input tokens and tokens generated by the model.
-
cacheReadInputTokens
The number of input tokens read from the cache for the request.
- Returns:
- The number of input tokens read from the cache for the request.
-
cacheWriteInputTokens
The number of input tokens written to the cache for the request.
- Returns:
- The number of input tokens written to the cache for the request.
-
hasCacheDetails
public final boolean hasCacheDetails()For responses, this returns true if the service returned a value for the CacheDetails property. This DOES NOT check that the value is non-empty (for which, you should check theisEmpty()method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified. -
cacheDetails
Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m).
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the
hasCacheDetails()method.- Returns:
- Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m).
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<TokenUsage.Builder,TokenUsage> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo- Returns:
- The mapping between the field name and its corresponding field.
-