batchStrategy

Specifies the number of records to include in a mini-batch for an HTTP inference request. A record** is a single unit of input data that inference can be made on. For example, a single line in a CSV file is a record.

To enable the batch strategy, you must set SplitType to Line, RecordIO, or TFRecord.