Path parameters

• model_id string Required

  The unique identifier of the trained model. Currently, only PyTorch models are supported.

Query parameters

• number_of_allocations number

  The number of model allocations on each node where the model is deployed. All allocations on a node share the same copy of the model in memory but use a separate set of threads to evaluate the model. Increasing this value generally increases the throughput. If this setting is greater than the number of hardware threads it will automatically be changed to a value less than the number of hardware threads.

Responses

• 200 application/json
  Hide response attribute Show response attribute object

  • assignment object Required
    Hide assignment attributes Show assignment attributes object

    • assignment_state string Required

      Values are starting, started, stopping, or failed.

    • max_assigned_allocations number
    • routing_table object
      Hide routing_table attributes Show routing_table attributes object

      • Additional properties
      • reason string Required

        The reason for the current state. It is usually populated only when the routing_state is failed.

      • routing_state string Required

        Values are failed, started, starting, stopped, or stopping.

      • current_allocations number Required

        Current number of allocations.

      • target_allocations number Required

        Target number of allocations.

    • start_time string | number Required

      A date and time, either as a string whose format can depend on the context (defaulting to ISO 8601), or a number of milliseconds since the Epoch. Elasticsearch accepts both as input, but will generally output a string representation.

      One of:

      _types:DateTime string _types:UnitMillis number

      Time unit for milliseconds

    • task_parameters object Required
      Hide task_parameters attributes Show task_parameters attributes object

      • model_bytes number Required

        The size of the trained model in bytes.

      • model_id string Required
      • deployment_id string Required

      • cache_size number | string Required

        One of:

        _types:ByteSize number _types:ByteSize string
      • number_of_allocations number Required

        The total number of allocations this model is assigned across ML nodes.

      • priority string Required

        Values are normal or low.

      • queue_capacity number Required

        Number of inference requests are allowed in the queue at a time.

      • threads_per_allocation number Required

        Number of threads per allocation.