X-Git-Url: https://git.piment-noir.org/?a=blobdiff_plain;f=docs%2Fclasses%2FDynamicClusterPool.html;h=0ca564e08a11e0db607a6b79d548f59c7f849c85;hb=b667be1103b9362ae29d094de05f812468464d4f;hp=909eb463fafa2a8a77fd8217a6a920f8823018e5;hpb=65632d7d60a45877ab5a8fd02dae3d68eb9853db;p=poolifier.git diff --git a/docs/classes/DynamicClusterPool.html b/docs/classes/DynamicClusterPool.html index 909eb463..0ca564e0 100644 --- a/docs/classes/DynamicClusterPool.html +++ b/docs/classes/DynamicClusterPool.html @@ -1,4 +1,4 @@ -DynamicClusterPool | poolifier
+DynamicClusterPool | poolifier - v2.6.8
  • Preparing search index...
  • -
  • The search index is not available
poolifier
+
  • The search index is not available
  • poolifier - v2.6.8
    @@ -19,30 +19,33 @@

    A cluster pool with a dynamic number of workers, but a guaranteed minimum number of workers.

    This cluster pool creates new workers when the others are busy, up to the maximum number of workers. When the maximum number of workers is reached and workers are busy, an event is emitted. If you want to listen to this event, use the pool's emitter.

    +
    +
    +

    Author

    Christopher Quadflieg

    -

    Author

    Christopher Quadflieg

    - -

    Since

    2.0.0

    +

    Since

    2.0.0

    -
    +

    Type Parameters

    -
      +
      • -

        Data = unknown

        -

        Type of data sent to the worker. This can only be serializable data.

        -
      • +

        Data = unknown

        +

        Type of data sent to the worker. This can only be structured-cloneable data.

        +
        +
      • -

        Response = unknown

        -

        Type of execution response. This can only be serializable data.

        -
    +

    Response = unknown

    +

    Type of execution response. This can only be structured-cloneable data.

    +
    +

    Hierarchy

    +
  • Defined in src/pools/cluster/dynamic.ts:15
  • @@ -50,231 +53,288 @@ When the maximum number of workers is reached and workers are busy, an event is

    Constructors

    -
    - -
      - +
      + +
        +
      • Constructs a new poolifier dynamic cluster pool.

        -
        +

        Type Parameters

        -
          +
          • -

            Data = unknown

          • +

            Data = unknown

          • -

            Response = unknown

        +

        Response = unknown

      Parameters

      • -
        min: number
        +
        min: number

        Minimum number of workers which are always active.

        -
      • +
      +
    • -
      max: number
      +
      max: number

      Maximum number of workers that can be created by this pool.

      -
    • +
    +
  • -
    filePath: string
    +
    filePath: string

    Path to an implementation of a ClusterWorker file, which can be relative or absolute.

    -
  • +
    +
  • -
    opts: ClusterPoolOptions = {}
    +
    opts: ClusterPoolOptions = {}

    Options for this dynamic cluster pool.

    -
  • -

    Returns DynamicClusterPool<Data, Response>

    Properties

    -
    - -
    emitter?: PoolEmitter
    +
    + +
    emitter?: PoolEmitter

    Emitter on which events can be listened to.

    Events that can currently be listened to:

    • 'full': Emitted when the pool is dynamic and full.
    • 'busy': Emitted when the pool is busy.
    • +
    • 'error': Emitted when an uncaught error occurs.
    • +
    • 'taskError': Emitted when an error occurs while executing a task.
    -
    -
    - -
    filePath: string
    +
  • Defined in src/pools/abstract-pool.ts:60
  • +
    + +
    filePath: string

    Path to the worker file.

    -
    -
    - -
    max: number
    +
  • Defined in src/pools/abstract-pool.ts:98
  • +
    + +
    max: number

    Maximum number of workers that can be created by this pool.

    -
    -
    - -
    numberOfWorkers: number
    +
  • Defined in src/pools/cluster/dynamic.ts:29
  • +
    + +
    numberOfWorkers: number

    Number of workers that this pool should manage.

    -
    -
    - - +
  • Defined in src/pools/abstract-pool.ts:97
  • +
    + +

    Options for this fixed cluster pool.

    -
    -
    - -
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...
    +
  • Defined in src/pools/cluster/fixed.ts:52
  • +
    + +
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...

    The execution response promise map.

    • key: The message id of each submitted task.
    • value: An object that contains the worker, the execution response promise resolve and reject callbacks.

    When we receive a message from the worker, we get a map entry with the promise resolve/reject bound to the message id.

    -
    -
    - -
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>
    +
  • Defined in src/pools/abstract-pool.ts:70
  • +
    + +
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>

    Worker choice strategy context referencing a worker choice algorithm implementation.

    -

    Default to a round robin algorithm.

    -
    -
    - -
    workerNodes: WorkerNode<Worker, Data>[] = []
    +
  • Defined in src/pools/abstract-pool.ts:78
  • +
    + +
    workerNodes: WorkerNode<Worker, Data>[] = []

    Pool worker nodes.

    -
    +
  • Defined in src/pools/abstract-pool.ts:57
  • Accessors

    -
    - -
    +
    + +
    • get full(): boolean
    • Whether the pool is full or not.

      The pool filling boolean status.

      -

      Returns boolean

    -
    - -
    +
    + +
      +
    • get info(): PoolInfo
    • -

      Number of tasks queued in the pool.

      +

      Pool information.

      -

      Returns number

    -
    - -
    +
    + +
      +
    • get maxSize(): number
    • -

      Number of tasks running in the pool.

      +

      Pool maximum size.

      -

      Returns number

    -
    - -
    +
    + +
      +
    • get minSize(): number
    • +
    • +

      Pool minimum size.

      +
      +

      Returns number

      +
    +
    + +
      +
    • get type(): "fixed" | "dynamic"
    • Pool type.

      If it is 'dynamic', it provides the max property.

      -

      Returns PoolType

    +
  • Defined in src/pools/cluster/dynamic.ts:37
  • +
    + +
    +
    + +

    Methods

    -
    - -
      - +
      + +
        +
      • Hook executed after the worker task execution. Can be overridden.

        @@ -283,40 +343,45 @@ Can be overridden.

        Parameters

        • -
          worker: Worker
          +
          worker: Worker

          The worker.

          -
        • +
        +
      • -
        message: MessageValue<Response, unknown>
        +
        message: MessageValue<Response, unknown>

        The received message.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes.

      -

      Can be used to update the maxListeners or binding the main-worker<->worker connection if not bind by default.

      +

      Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes. +Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The newly created worker.

        -
      -

      Returns void

      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Hook executed before the worker task execution. Can be overridden.

      @@ -325,84 +390,95 @@ Can be overridden.

      Parameters

      • -
        workerNodeKey: number
        +
        workerNodeKey: number

        The worker node key.

        -
      -

      Returns void

    • +
    • +
      task: Task<Data>
      +

      The task to execute.

      +
      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Chooses a worker node for the next task.

      -

      The default uses a round robin algorithm to distribute the load.

      - -

      Returns

      [worker node key, worker node].

      +

      Creates a new dynamic worker and sets it up completely in the pool worker nodes.

      -

      Returns [number, WorkerNode<Worker, Data>]

    -
    - -
    +
    + +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • -

      Shutdowns the given worker.

      +

      Terminates the given worker.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        A worker within workerNodes.

        -
      -

      Returns void

      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Enables/disables the worker tasks queue in this pool.

      @@ -410,114 +486,75 @@ Can be overridden.

      Parameters

      • -
        enable: boolean
        +
        enable: boolean

        Whether to enable or disable the worker tasks queue.

        -
      • + +
      • -
        Optional tasksQueueOptions: TasksQueueOptions
        +
        Optional tasksQueueOptions: TasksQueueOptions

        The worker tasks queue options.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Executes the function specified in the worker constructor with the task data input parameter.

      - -

      Returns

      Promise that will be fulfilled when the task is completed.

      +

      Executes the specified function in the worker constructor with the task data input parameter.

      Parameters

      • -
        Optional data: Data
        -

        The task input data for the specified worker function. This can only be serializable data.

        -
      -

      Returns Promise<Response>

    • +
    • +
      Optional name: string
      +

      The name of the worker function to execute. If not specified, the default worker function will be executed.

      +
      +
    +

    Returns Promise<Response>

    Promise that will be fulfilled when the task is completed.

    + +
    -
    - -
    +
    + +
      +
    • -

      Finds a free worker node key based on the number of tasks the worker has applied.

      -

      If a worker is found with 0 running tasks, it is detected as free and its worker node key is returned.

      -

      If no free worker is found, -1 is returned.

      - -

      Returns

      A worker node key if there is one, -1 otherwise.

      +

      Whether worker nodes are executing at least one task.

      -

      Returns number

    -
    - -
    -
    - -
    +
    + +
    -
    - -
      - -
    • -

      Registers a listener callback on the given worker.

      -
      -
      -

      Type Parameters

      -
        -
      • -

        Message

      -
      -

      Parameters

      -
        -
      • -
        worker: Worker
        -

        The worker which should register a listener.

        -
      • -
      • -
        listener: ((message: MessageValue<Message, unknown>) => void)
        -

        The message listener callback.

        -
        -
          -
        • -
            -
          • (message: MessageValue<Message, unknown>): void
          • -
          • -
            -

            Parameters

            -
            -

            Returns void

      -

      Returns void

    -
    - -
    +
    + +
      +
    • Sends a message to the given worker.

      @@ -525,21 +562,24 @@ Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker which should receive the message.

        -
      • + +
      • -
        message: MessageValue<Data, unknown>
        +
        message: MessageValue<Data, unknown>

        The message.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker tasks queue options in this pool.

      @@ -547,17 +587,19 @@ Can be overridden.

      Parameters

      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker choice strategy in this pool.

      @@ -565,21 +607,24 @@ Can be overridden.

      Parameters

      • -
        workerChoiceStrategy: "ROUND_ROBIN" | "LESS_USED" | "LESS_BUSY" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN"
        +
        workerChoiceStrategy: "ROUND_ROBIN" | "LEAST_USED" | "LEAST_BUSY" | "LEAST_ELU" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN" | "INTERLEAVED_WEIGHTED_ROUND_ROBIN"

        The worker choice strategy.

        -
      • + +
      • -
        Optional workerChoiceStrategyOptions: WorkerChoiceStrategyOptions
        +
        Optional workerChoiceStrategyOptions: WorkerChoiceStrategyOptions

        The worker choice strategy options.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker choice strategy options in this pool.

      @@ -587,58 +632,61 @@ Can be overridden.

      Parameters

      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Setup hook to execute code before worker node are created in the abstract constructor. -Can be overridden

      +

      Setup hook to execute code before worker nodes are created in the abstract constructor. +Can be overridden.

      -

      Returns void

    -
    - -
    +
    + +
      +
    • This function is the listener registered for each worker message.

      - -

      Returns

      The listener function to execute when a message is received from a worker.

      -

      Returns ((message: MessageValue<Response, unknown>) => void)

      +

      Returns ((message) => void)

      The listener function to execute when a message is received from a worker.

      +
      • -
          -
        • (message: MessageValue<Response, unknown>): void
        • +
            +
          • (message): void
          • This function is the listener registered for each worker message.

            - -

            Returns

            The listener function to execute when a message is received from a worker.

            Parameters

            -

            Returns void

      +

      Returns void

      The listener function to execute when a message is received from a worker.

      + +
    +
    +
  • Defined in src/pools/abstract-pool.ts:974
  • -

    On This Page

    +

    On This Page

    +
  • constructor
  • +
  • emitter
  • +
  • filePath
  • +
  • max
  • +
  • numberOfWorkers
  • +
  • opts
  • +
  • promiseResponseMap
  • +
  • workerChoiceStrategyContext
  • +
  • workerNodes
  • +
  • busy
  • +
  • full
  • +
  • info
  • +
  • maxSize
  • +
  • minSize
  • +
  • type
  • +
  • utilization
  • +
  • worker
  • +
  • afterTaskExecutionHook
  • +
  • afterWorkerSetup
  • +
  • beforeTaskExecutionHook
  • +
  • createAndSetupDynamicWorker
  • +
  • createAndSetupWorker
  • +
  • createWorker
  • +
  • destroy
  • +
  • destroyWorker
  • +
  • enableTasksQueue
  • +
  • execute
  • +
  • internalBusy
  • +
  • isMain
  • +
  • sendToWorker
  • +
  • setTasksQueueOptions
  • +
  • setWorkerChoiceStrategy
  • +
  • setWorkerChoiceStrategyOptions
  • +
  • setupHook
  • +
  • workerListener
  • +
  • AbstractPool
  • +
  • AbstractWorker
  • +
  • CircularArray
  • +
  • ClusterWorker
  • +
  • DynamicClusterPool
  • +
  • DynamicThreadPool
  • +
  • FixedClusterPool
  • +
  • FixedThreadPool
  • +
  • PoolEmitter
  • +
  • Queue
  • +
  • ThreadWorker
  • +
  • WorkerChoiceStrategyContext
  • +
  • ClusterPoolOptions
  • +
  • EventLoopUtilizationMeasurementStatistics
  • +
  • IPool
  • +
  • IWorker
  • +
  • IWorkerChoiceStrategy
  • +
  • MeasurementOptions
  • +
  • MeasurementStatistics
  • +
  • MeasurementStatisticsRequirements
  • +
  • MessageValue
  • +
  • PoolInfo
  • +
  • PoolOptions
  • +
  • PromiseResponseWrapper
  • +
  • StrategyPolicy
  • +
  • Task
  • +
  • TaskError
  • +
  • TaskPerformance
  • +
  • TaskStatistics
  • +
  • TaskStatisticsRequirements
  • +
  • TasksQueueOptions
  • +
  • ThreadPoolOptions
  • +
  • WorkerChoiceStrategyOptions
  • +
  • WorkerInfo
  • +
  • WorkerNode
  • +
  • WorkerOptions
  • +
  • WorkerStatistics
  • +
  • WorkerUsage
  • +
  • ErrorHandler
  • +
  • ExitHandler
  • +
  • KillBehavior
  • +
  • Measurement
  • +
  • MessageHandler
  • +
  • OnlineHandler
  • +
  • PoolEvent
  • +
  • PoolType
  • +
  • TaskFunctions
  • +
  • WorkerAsyncFunction
  • +
  • WorkerChoiceStrategy
  • +
  • WorkerFunction
  • +
  • WorkerSyncFunction
  • +
  • WorkerType
  • +
  • KillBehaviors
  • +
  • Measurements
  • +
  • PoolEvents
  • +
  • PoolTypes
  • +
  • WorkerChoiceStrategies
  • +
  • WorkerTypes
  • +
  • availableParallelism
  • Generated using TypeDoc

    \ No newline at end of file