Path parameters

• model_id string Required

  The unique identifier of the trained model. Currently, only PyTorch models are supported.

Query parameters

• number_of_allocations number

  The number of model allocations on each node where the model is deployed. All allocations on a node share the same copy of the model in memory but use a separate set of threads to evaluate the model. Increasing this value generally increases the throughput. If this setting is greater than the number of hardware threads it will automatically be changed to a value less than the number of hardware threads.

Responses

• 200 application/json
  Hide response attribute Show response attribute object

  • assignment object Required

    Additional properties are allowed.

    Hide assignment attributes Show assignment attributes object

    • adaptive_allocations object | string | null

      One of:

      _types:AdaptiveAllocationsSettings object string-2 string | null

      Hide attributes Show attributes

      • enabled boolean Required
      • min_number_of_allocations number
      • max_number_of_allocations number
    • assignment_state string Required

      Values are started, starting, stopping, or failed.

    • max_assigned_allocations number
    • reason string
    • routing_table object Required

      The allocation state for each node.

      Hide routing_table attribute Show routing_table attribute object

      • * object

        Additional properties are allowed.

        Hide * attributes Show * attributes object

        • reason string

          The reason for the current state. It is usually populated only when the routing_state is failed.

        • routing_state string Required

          Values are failed, started, starting, stopped, or stopping.

        • current_allocations number Required

          Current number of allocations.

        • target_allocations number Required

          Target number of allocations.

    • start_time string | number Required

      A date and time, either as a string whose format can depend on the context (defaulting to ISO 8601), or a number of milliseconds since the Epoch. Elasticsearch accepts both as input, but will generally output a string representation.

      One of:

      _types:DateTime string _types:UnitMillis number

      Time unit for milliseconds

    • task_parameters object Required

      Additional properties are allowed.

      Hide task_parameters attributes Show task_parameters attributes object

      • model_bytes number | string Required

        One of:

        _types:ByteSize number _types:ByteSize string
      • model_id string Required
      • deployment_id string Required

      • cache_size number | string

        One of:

        _types:ByteSize number _types:ByteSize string
      • number_of_allocations number Required

        The total number of allocations this model is assigned across ML nodes.

      • priority string Required

        Values are normal or low.

      • per_deployment_memory_bytes number | string Required

        One of:

        _types:ByteSize number _types:ByteSize string

      • per_allocation_memory_bytes number | string Required

        One of:

        _types:ByteSize number _types:ByteSize string
      • queue_capacity number Required

        Number of inference requests are allowed in the queue at a time.

      • threads_per_allocation number Required

        Number of threads per allocation.