X-Git-Url: https://git.piment-noir.org/?a=blobdiff_plain;f=docs%2Fclasses%2FDynamicClusterPool.html;h=afc454110a1456263a093f9170ec3efaa683cbec;hb=aba8d9bd41f1bd46f3cc3863c0c2e74bdfacb7b6;hp=909eb463fafa2a8a77fd8217a6a920f8823018e5;hpb=761b0c73be0bf581f50a78123913f933bd405f52;p=poolifier.git diff --git a/docs/classes/DynamicClusterPool.html b/docs/classes/DynamicClusterPool.html index 909eb463..afc45411 100644 --- a/docs/classes/DynamicClusterPool.html +++ b/docs/classes/DynamicClusterPool.html @@ -1,4 +1,4 @@ -DynamicClusterPool | poolifier
+DynamicClusterPool | poolifier
+
  • -

    Response = unknown

    +

    Response = unknown

    Type of execution response. This can only be serializable data.

    -
  • +
    +

    Hierarchy

    +
  • Defined in src/pools/cluster/dynamic.ts:15
  • @@ -50,231 +53,275 @@ When the maximum number of workers is reached and workers are busy, an event is

    Constructors

    -
    - -
      - +
      + +
        +
      • Constructs a new poolifier dynamic cluster pool.

        -
        +

        Type Parameters

        -
          +
          • -

            Data = unknown

          • +

            Data = unknown

          • -

            Response = unknown

        +

        Response = unknown

      Parameters

      • -
        min: number
        +
        min: number

        Minimum number of workers which are always active.

        -
      • +
      +
    • -
      max: number
      +
      max: number

      Maximum number of workers that can be created by this pool.

      -
    • + +
    • -
      filePath: string
      +
      filePath: string

      Path to an implementation of a ClusterWorker file, which can be relative or absolute.

      -
    • + +
    • -
      opts: ClusterPoolOptions = {}
      +
      opts: ClusterPoolOptions = {}

      Options for this dynamic cluster pool.

      -
    -

    Returns DynamicClusterPool<Data, Response>

    +
  • Defined in src/pools/cluster/dynamic.ts:27
  • Properties

    -
    - -
    emitter?: PoolEmitter
    +
    + +
    emitter?: PoolEmitter

    Emitter on which events can be listened to.

    Events that can currently be listened to:

    • 'full': Emitted when the pool is dynamic and full.
    • 'busy': Emitted when the pool is busy.
    • +
    • 'error': Emitted when an uncaught error occurs.
    • +
    • 'taskError': Emitted when an error occurs while executing a task.
    -
    -
    - -
    filePath: string
    +
  • Defined in src/pools/abstract-pool.ts:54
  • +
    + +
    filePath: string

    Path to the worker file.

    -
    -
    - -
    max: number
    +
  • Defined in src/pools/abstract-pool.ts:87
  • +
    + +
    max: number

    Maximum number of workers that can be created by this pool.

    -
    -
    - -
    numberOfWorkers: number
    +
  • Defined in src/pools/cluster/dynamic.ts:29
  • +
    + +
    numberOfWorkers: number

    Number of workers that this pool should manage.

    -
    -
    - - +
  • Defined in src/pools/abstract-pool.ts:86
  • +
    + +

    Options for this fixed cluster pool.

    -
    -
    - -
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...
    +
  • Defined in src/pools/cluster/fixed.ts:54
  • +
    + +
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...

    The execution response promise map.

    • key: The message id of each submitted task.
    • value: An object that contains the worker, the execution response promise resolve and reject callbacks.

    When we receive a message from the worker, we get a map entry with the promise resolve/reject bound to the message id.

    -
    -
    - -
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>
    +
  • Defined in src/pools/abstract-pool.ts:64
  • +
    + +
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>

    Worker choice strategy context referencing a worker choice algorithm implementation.

    -

    Default to a round robin algorithm.

    -
    -
    - -
    workerNodes: WorkerNode<Worker, Data>[] = []
    +
  • Defined in src/pools/abstract-pool.ts:72
  • +
    + +
    workerNodes: WorkerNode<Worker, Data>[] = []

    Pool worker nodes.

    -
    +
  • Defined in src/pools/abstract-pool.ts:51
  • Accessors

    -
    - -
    +
    + +
    • get full(): boolean
    • Whether the pool is full or not.

      The pool filling boolean status.

      -

      Returns boolean

    -
    - -
    +
    + +
      +
    • get info(): PoolInfo
    • -

      Number of tasks queued in the pool.

      +

      Pool information.

      -

      Returns number

    -
    - -
    +
    + +
      +
    • get maxSize(): number
    • -

      Number of tasks running in the pool.

      +

      Pool maximum size.

      -

      Returns number

    -
    - -
    +
    + +
      +
    • get minSize(): number
    • +
    • +

      Pool minimum size.

      +
      +

      Returns number

      +
    +
    + +
      +
    • get type(): "fixed" | "dynamic"
    • Pool type.

      If it is 'dynamic', it provides the max property.

      -

      Returns PoolType

    +
  • Defined in src/pools/cluster/dynamic.ts:37
  • +
    + +
      +
    • get worker(): "cluster" | "thread"
    • +
    • +

      Gets the worker type.

      +
      +

      Returns "cluster" | "thread"

      +

    Methods

    -
    - -
      - +
      + +
        +
      • Hook executed after the worker task execution. Can be overridden.

        @@ -283,21 +330,24 @@ Can be overridden.

        Parameters

        • -
          worker: Worker
          +
          worker: Worker

          The worker.

          -
        • +
        +
      • -
        message: MessageValue<Response, unknown>
        +
        message: MessageValue<Response, unknown, Worker | MessagePort>

        The received message.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes.

      Can be used to update the maxListeners or binding the main-worker<->worker connection if not bind by default.

      @@ -306,17 +356,19 @@ Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The newly created worker.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Hook executed before the worker task execution. Can be overridden.

      @@ -325,84 +377,95 @@ Can be overridden.

      Parameters

      • -
        workerNodeKey: number
        +
        workerNodeKey: number

        The worker node key.

        -
      -

      Returns void

    • +
    • +
      task: Task<Data>
      +

      The task to execute.

      +
      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Chooses a worker node for the next task.

      -

      The default uses a round robin algorithm to distribute the load.

      - -

      Returns

      [worker node key, worker node].

      +

      Creates a new dynamic worker and sets it up completely in the pool worker nodes.

      -

      Returns [number, WorkerNode<Worker, Data>]

    -
    - -
    +
    + +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • -

      Shutdowns the given worker.

      +

      Terminates the given worker.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        A worker within workerNodes.

        -
      -

      Returns void

      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Enables/disables the worker tasks queue in this pool.

      @@ -410,114 +473,116 @@ Can be overridden.

      Parameters

      • -
        enable: boolean
        +
        enable: boolean

        Whether to enable or disable the worker tasks queue.

        -
      • + +
      • -
        Optional tasksQueueOptions: TasksQueueOptions
        +
        Optional tasksQueueOptions: TasksQueueOptions

        The worker tasks queue options.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Executes the function specified in the worker constructor with the task data input parameter.

      - -

      Returns

      Promise that will be fulfilled when the task is completed.

      +

      Executes the specified function in the worker constructor with the task data input parameter.

      Parameters

      • -
        Optional data: Data
        +
        Optional data: Data

        The task input data for the specified worker function. This can only be serializable data.

        -
      -

      Returns Promise<Response>

      +
    • +
    • +
      Optional name: string
      +

      The name of the worker function to execute. If not specified, the default worker function will be executed.

      +
      +
    +

    Returns Promise<Response>

    Promise that will be fulfilled when the task is completed.

    + +
    -
    - -
    +
    + +
      +
    • -

      Finds a free worker node key based on the number of tasks the worker has applied.

      -

      If a worker is found with 0 running tasks, it is detected as free and its worker node key is returned.

      -

      If no free worker is found, -1 is returned.

      - -

      Returns

      A worker node key if there is one, -1 otherwise.

      +

      Whether worker nodes are executing at least one task.

      -

      Returns number

    -
    - -
    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • Registers a listener callback on the given worker.

      -
      +

      Type Parameters

      -
        +
        • -

          Message

      +

      Message

    Parameters

    • -
      worker: Worker
      +
      worker: Worker

      The worker which should register a listener.

      -
    • +
    +
  • -
    listener: ((message: MessageValue<Message, unknown>) => void)
    +
    listener: ((message) => void)

    The message listener callback.

    +
    • -
        -
      • (message: MessageValue<Message, unknown>): void
      • +
          +
        • (message): void
        • Parameters

          +
          message: MessageValue<Message, unknown, Worker | MessagePort>

        Returns void

  • -

    Returns void

    -
    - -
    +
    + +
      +
    • Sends a message to the given worker.

      @@ -525,21 +590,24 @@ Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker which should receive the message.

        -
      • + +
      • -
        message: MessageValue<Data, unknown>
        +
        message: MessageValue<Data, unknown, Worker | MessagePort>

        The message.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker tasks queue options in this pool.

      @@ -547,17 +615,19 @@ Can be overridden.

      Parameters

      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker choice strategy in this pool.

      @@ -565,21 +635,24 @@ Can be overridden.

      Parameters

      • -
        workerChoiceStrategy: "ROUND_ROBIN" | "LESS_USED" | "LESS_BUSY" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN"
        +
        workerChoiceStrategy: "ROUND_ROBIN" | "LEAST_USED" | "LEAST_BUSY" | "LEAST_ELU" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN" | "INTERLEAVED_WEIGHTED_ROUND_ROBIN"

        The worker choice strategy.

        -
      • + +
      • -
        Optional workerChoiceStrategyOptions: WorkerChoiceStrategyOptions
        +
        Optional workerChoiceStrategyOptions: WorkerChoiceStrategyOptions

        The worker choice strategy options.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sets the worker choice strategy options in this pool.

      @@ -587,58 +660,61 @@ Can be overridden.

      Parameters

      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • This function is the listener registered for each worker message.

      - -

      Returns

      The listener function to execute when a message is received from a worker.

      -

      Returns ((message: MessageValue<Response, unknown>) => void)

      +

      Returns ((message) => void)

      The listener function to execute when a message is received from a worker.

      +
      • -
          -
        • (message: MessageValue<Response, unknown>): void
        • +
            +
          • (message): void
          • This function is the listener registered for each worker message.

            - -

            Returns

            The listener function to execute when a message is received from a worker.

            Parameters

            -

            Returns void

      +

      Returns void

      The listener function to execute when a message is received from a worker.

      + +
    +
    +
  • Defined in src/pools/abstract-pool.ts:741
  • -

    On This Page

    +

    On This Page

    +
  • constructor
  • +
  • emitter
  • +
  • filePath
  • +
  • max
  • +
  • numberOfWorkers
  • +
  • opts
  • +
  • promiseResponseMap
  • +
  • workerChoiceStrategyContext
  • +
  • workerNodes
  • +
  • busy
  • +
  • full
  • +
  • info
  • +
  • maxSize
  • +
  • minSize
  • +
  • type
  • +
  • worker
  • +
  • afterTaskExecutionHook
  • +
  • afterWorkerSetup
  • +
  • beforeTaskExecutionHook
  • +
  • createAndSetupDynamicWorker
  • +
  • createAndSetupWorker
  • +
  • createWorker
  • +
  • destroy
  • +
  • destroyWorker
  • +
  • enableTasksQueue
  • +
  • execute
  • +
  • internalBusy
  • +
  • isMain
  • +
  • registerWorkerMessageListener
  • +
  • sendToWorker
  • +
  • setTasksQueueOptions
  • +
  • setWorkerChoiceStrategy
  • +
  • setWorkerChoiceStrategyOptions
  • +
  • setupHook
  • +
  • workerListener
  • +
  • AbstractPool
  • +
  • AbstractWorker
  • +
  • CircularArray
  • +
  • ClusterWorker
  • +
  • DynamicClusterPool
  • +
  • DynamicThreadPool
  • +
  • FixedClusterPool
  • +
  • FixedThreadPool
  • +
  • PoolEmitter
  • +
  • Queue
  • +
  • ThreadWorker
  • +
  • WorkerChoiceStrategyContext
  • +
  • ClusterPoolOptions
  • +
  • EventLoopUtilizationMeasurementStatistics
  • +
  • IPool
  • +
  • IWorker
  • +
  • IWorkerChoiceStrategy
  • +
  • MeasurementOptions
  • +
  • MeasurementStatistics
  • +
  • MeasurementStatisticsRequirements
  • +
  • MessageValue
  • +
  • PoolInfo
  • +
  • PoolOptions
  • +
  • PromiseResponseWrapper
  • +
  • StrategyPolicy
  • +
  • Task
  • +
  • TaskError
  • +
  • TaskPerformance
  • +
  • TaskStatistics
  • +
  • TaskStatisticsRequirements
  • +
  • TasksQueueOptions
  • +
  • ThreadPoolOptions
  • +
  • WorkerChoiceStrategyOptions
  • +
  • WorkerNode
  • +
  • WorkerOptions
  • +
  • WorkerStatistics
  • +
  • WorkerUsage
  • +
  • Draft
  • +
  • ErrorHandler
  • +
  • ExitHandler
  • +
  • KillBehavior
  • +
  • Measurement
  • +
  • MessageHandler
  • +
  • OnlineHandler
  • +
  • PoolEvent
  • +
  • PoolType
  • +
  • TaskFunctions
  • +
  • ThreadWorkerWithMessageChannel
  • +
  • WorkerAsyncFunction
  • +
  • WorkerChoiceStrategy
  • +
  • WorkerFunction
  • +
  • WorkerSyncFunction
  • +
  • WorkerType
  • +
  • KillBehaviors
  • +
  • Measurements
  • +
  • PoolEvents
  • +
  • PoolTypes
  • +
  • WorkerChoiceStrategies
  • +
  • WorkerTypes
  • Generated using TypeDoc

    \ No newline at end of file