X-Git-Url: https://git.piment-noir.org/?a=blobdiff_plain;f=docs%2Fclasses%2FAbstractPool.html;h=6e4b7c7057bac17245f365cf530ad0a9b533cacb;hb=2a6631992868d900762f62e4c228dce4e4ee549a;hp=25e97424a6d2789881b4becb939bfcb243360deb;hpb=06fa9e0de6b62965c9dd2fe6023e943f35775026;p=poolifier.git diff --git a/docs/classes/AbstractPool.html b/docs/classes/AbstractPool.html index 25e97424..6e4b7c70 100644 --- a/docs/classes/AbstractPool.html +++ b/docs/classes/AbstractPool.html @@ -1,4 +1,4 @@ -AbstractPool | poolifier
+AbstractPool | poolifier

Base class that implements some shared logic for all poolifier pools.

-
-
+
+
+

Type Parameters

-
    +
    • -

      Worker extends IWorker

      +

      Worker extends IWorker

      Type of worker which manages this pool.

      -
    • + +
    • -

      Data = unknown

      -

      Type of data sent to the worker. This can only be serializable data.

      -
    • +

      Data = unknown

      +

      Type of data sent to the worker. This can only be structured-cloneable data.

      +
      +
    • -

      Response = unknown

      -

      Type of execution response. This can only be serializable data.

      -
+

Response = unknown

+

Type of execution response. This can only be structured-cloneable data.

+
+

Hierarchy

+
  • FixedClusterPool
  • +
  • FixedThreadPool
  • Implements

      -
    • IPool<Worker, Data, Response>
    @@ -53,225 +57,317 @@

    Constructors

    -

    Properties

    -

    Accessors

    -

    Methods

    -
    afterTaskExecutionHook -afterWorkerSetup -beforeTaskExecutionHook -checkAndEmitEvents -checkFilePath -checkNumberOfWorkers -checkPoolOptions -checkValidWorkerChoiceStrategy -chooseWorkerNode -createAndSetupWorker -createWorker -dequeueTask -destroy -destroyWorker -enqueueTask -execute -executeTask -findFreeWorkerNodeKey -flushTasksQueue -flushTasksQueueByWorker -getWorkerNodeKey -getWorkerTasksUsage -internalBusy -isMain -pushWorkerNode -registerWorkerMessageListener -removeWorkerNode -sendToWorker -setWorkerChoiceStrategy -setWorkerNode -setWorkerNodeTasksUsage -setupHook -tasksQueueSize -workerListener +

    Constructors

    -
    - -
      - +
      + +
        +
      • Constructs a new poolifier pool.

        -
        +

        Type Parameters

        -
          +
          • -

            Worker extends IWorker<Worker>

          • +

            Worker extends IWorker

          • -

            Data = unknown

          • +

            Data = unknown

          • -

            Response = unknown

        +

        Response = unknown

      Parameters

      • -
        numberOfWorkers: number
        +
        numberOfWorkers: number

        Number of workers that this pool should manage.

        -
      • +
      +
    • -
      filePath: string
      -

      Path to the worker-file.

      -
    • +
      filePath: string
      +

      Path to the worker file.

      +
      +
    • -
      opts: PoolOptions<Worker>
      +
      opts: PoolOptions<Worker>

      Options for the pool.

      -
    -

    Returns AbstractPool<Worker, Data, Response>

    +
  • Defined in src/pools/abstract-pool.ts:94
  • Properties

    -
    - -
    emitter?: PoolEmitter
    +
    + +
    emitter?: PoolEmitter

    Emitter on which events can be listened to.

    Events that can currently be listened to:

    • 'full': Emitted when the pool is dynamic and full.
    • 'busy': Emitted when the pool is busy.
    • +
    • 'error': Emitted when an uncaught error occurs.
    • +
    • 'taskError': Emitted when an error occurs while executing a task.
    -
    -
    - -
    filePath: string
    -

    Path to the worker-file.

    -
    -
    - -
    numberOfWorkers: number
    +
  • Defined in src/pools/abstract-pool.ts:58
  • +
    + +
    filePath: string
    +

    Path to the worker file.

    +
    +
    +
    + +
    numberOfWorkers: number

    Number of workers that this pool should manage.

    -
    -
    - -
    opts: PoolOptions<Worker>
    +
  • Defined in src/pools/abstract-pool.ts:95
  • +
    + +
    opts: PoolOptions<Worker>

    Options for the pool.

    -
    -
    - -
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...
    +
  • Defined in src/pools/abstract-pool.ts:97
  • +
    + +
    promiseResponseMap: Map<string, PromiseResponseWrapper<Worker, Response>> = ...

    The execution response promise map.

    • key: The message id of each submitted task.
    • value: An object that contains the worker, the execution response promise resolve and reject callbacks.

    When we receive a message from the worker, we get a map entry with the promise resolve/reject bound to the message id.

    -
    +
    + +
    startTimestamp: number
    +

    The start timestamp of the pool.

    +
    +
    -
    - -
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>
    +
  • Defined in src/pools/abstract-pool.ts:85
  • +
    + +
    workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>

    Worker choice strategy context referencing a worker choice algorithm implementation.

    -

    Default to a round robin algorithm.

    -
    -
    - -
    workerNodes: WorkerNode<Worker, Data>[] = []
    +
  • Defined in src/pools/abstract-pool.ts:76
  • +
    + +
    workerNodes: WorkerNode<Worker, Data>[] = []

    Pool worker nodes.

    -
    +
  • Defined in src/pools/abstract-pool.ts:55
  • Accessors

    -
    - -
    +
    + +
    • get full(): boolean
    • Whether the pool is full or not.

      The pool filling boolean status.

      -

      Returns boolean

    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • get maxSize(): number
    • -

      Number of tasks running in the pool.

      +

      Pool maximum size.

      -

      Returns number

    +
    + +
    +
    + +
    -
    - -
    +
    + +
    +
    + +
      +
    • get utilization(): number
    • +
    • +

      Gets the approximate pool utilization.

      +
      +

      Returns number

      The pool utilization.

      + +
    +
    + +
    +
  • Defined in src/pools/abstract-pool.ts:337
  • Methods

    -
    - -
      - +
      + +
        +
      • Hook executed after the worker task execution. Can be overridden.

        @@ -280,38 +376,43 @@ Can be overridden.

        Parameters

        • -
          worker: Worker
          +
          worker: Worker

          The worker.

          -
        • +
        +
      • -
        message: MessageValue<Response, unknown>
        +
        message: MessageValue<Response, unknown>

        The received message.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes.

      -

      Can be used to update the maxListeners or binding the main-worker<->worker connection if not bind by default.

      +

      Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes. +Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The newly created worker.

        -
      -

      Returns void

      +
    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Hook executed before the worker task execution. Can be overridden.

      @@ -320,355 +421,499 @@ Can be overridden.

      Parameters

      • -
        workerNodeKey: number
        +
        workerNodeKey: number

        The worker node key.

        -
      + +
    • +
    • +
      task: Task<Data>
      +

      The task to execute.

      +
      +
    +

    Returns void

    +
    +
    + +
    +
    + +
    +
    + +
    -
    - -
    +
    + +
    -
    - -
    +
    + +
      +
    • Parameters

      • -
        filePath: string
      +
      opts: PoolOptions<Worker>

    Returns void

    -
    - -
    +
    + +
      +
    • Parameters

      • -
        numberOfWorkers: number
      +
      tasksQueueOptions: TasksQueueOptions

    Returns void

    -
    - -
    +
    + +
      +
    • Parameters

      +
      workerChoiceStrategy: "ROUND_ROBIN" | "LEAST_USED" | "LEAST_BUSY" | "LEAST_ELU" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN" | "INTERLEAVED_WEIGHTED_ROUND_ROBIN"

    Returns void

    -
    - -
      - +
    • Defined in src/pools/abstract-pool.ts:187
    +
    + +
      +
    • Parameters

      • -
        workerChoiceStrategy: "ROUND_ROBIN" | "LESS_USED" | "LESS_BUSY" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN"
      +
      workerChoiceStrategyOptions: WorkerChoiceStrategyOptions

    Returns void

    -
    - -
    +
    + +
      +
    • Chooses a worker node for the next task.

      -

      The default uses a round robin algorithm to distribute the load.

      +

      The default worker choice strategy uses a round robin algorithm to distribute the tasks.

      +
      +

      Returns number

      The worker node key

      -

      Returns

      [worker node key, worker node].

      +
    +
    + +
      + +
    • +

      Creates a new dynamic worker and sets it up completely in the pool worker nodes.

      -

      Returns [number, WorkerNode<Worker, Data>]

    -
    - -
    +
    + +
      +
    • Creates a new worker and sets it up completely in the pool worker nodes.

      - -

      Returns

      New, completely set up worker.

      -

      Returns Worker

    -
    - -
    +
    + +
      +
    • -

      Returns a newly created worker.

      +

      Creates a new worker.

      -

      Returns Worker

    -
    - -
    +
    + +
      +
    • Parameters

      • -
        workerNodeKey: number
      -

      Returns undefined | Task<Data>

    +

    Returns undefined | Task<Data>

    -
    - -
    +
    + +
      +
    • -

      Shutdowns every current worker in this pool.

      +

      Terminates every current worker in this pool.

      -

      Returns Promise<void>

    -
    - -
    +
    + +
      +
    • -

      Shutdowns the given worker.

      +

      Terminates the given worker.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        A worker within workerNodes.

        -
      -

      Returns void | Promise<void>

      +
    +

    Returns void | Promise<void>

    +
    -
    - -
    +
    + +
      +
    • +

      Enables/disables the worker tasks queue in this pool.

      +

      Parameters

      • -
        workerNodeKey: number
      • +
        enable: boolean
        +

        Whether to enable or disable the worker tasks queue.

        +
        +
      • -
        task: Task<Data>
      -

      Returns number

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • -

      Performs the task specified in the constructor with the data parameter.

      - -

      Returns

      Promise that will be resolved when the task is successfully completed.

      -

      Parameters

      • -
        data: Data
        -

        The input for the specified task. This can only be serializable data.

        -
      -

      Returns Promise<Response>

    • +
    • +
      task: Task<Data>
    +

    Returns number

    -
    - -
    +
    + +
      +
    • +

      Executes the specified function in the worker constructor with the task data input parameter.

      +

      Parameters

      • -
        workerNodeKey: number
      • +
        Optional data: Data
        +

        The task input data for the specified worker function. This can only be structured-cloneable data.

        +
        +
      • -
        task: Task<Data>
      -

      Returns void

    -
    - -
      - -
    • -

      Finds a free worker node key based on the number of tasks the worker has applied.

      -

      If a worker is found with 0 running tasks, it is detected as free and its worker node key is returned.

      -

      If no free worker is found, -1 is returned.

      - -

      Returns

      A worker node key if there is one, -1 otherwise.

      +
      Optional name: string
      +

      The name of the worker function to execute. If not specified, the default worker function will be executed.

      -

      Returns number

    +

    Returns Promise<Response>

    Promise that will be fulfilled when the task is completed.

    + +
    -
    - -
    +
    + +
      +
    • Parameters

      • -
        workerNodeKey: number
      +
      workerNodeKey: number
    • +
    • +
      task: Task<Data>

    Returns void

    -
    - -
    +
    + +
      +
    • Parameters

      • -
        worker: Worker
      +
      workerNodeKey: number

    Returns void

    -
    - -
    +
    + +
    +
    + +
      + +
    • +

      Get the worker given its id.

      +
      +
      +

      Parameters

      +
        +
      • +
        workerId: number
        +

        The worker id.

        +
        +
      +

      Returns undefined | Worker

      The worker if found in the pool worker nodes, undefined otherwise.

      -

      Returns

      The worker node key if the worker is found in the pool worker nodes, -1 otherwise.

      +
    +
    + +
      + +
    • +

      Gets the worker id.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker.

        -
      -

      Returns number

    +

    Returns undefined | number

    The worker id.

    + +
    -
    - -
    +
    + +
      +
    • -

      Gets the given worker its tasks usage in the pool.

      - -

      Returns

      The worker tasks usage.

      +

      Gets the given worker its worker node key.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker.

        -
      -

      Returns undefined | TasksUsage

      +
    +

    Returns number

    The worker node key if found in the pool worker nodes, -1 otherwise.

    + +
    -
    - -
    +
    + +
    +
    + +
    -
    - -
    +
    + +
    +
    + +
      + +
    • +

      Whether worker nodes are executing at least one task.

      +
      +

      Returns boolean

      Worker nodes busyness boolean status.

      + +
    +
    + +
      +
    • Should return whether the worker is the main worker or not.

      -

      Returns boolean

    -
    - -
    +
    + +
      +
    • Pushes the given worker in the pool worker nodes.

      - -

      Returns

      The worker nodes length.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker.

        -
      -

      Returns number

    +

    Returns number

    The worker nodes length.

    + +
    -
    - -
    +
    + +
      +
    • Registers a listener callback on the given worker.

      -
      +

      Type Parameters

      -
        +
        • -

          Message

      +

      Message

    Parameters

    • -
      worker: Worker
      +
      worker: Worker

      The worker which should register a listener.

      -
    • +
    +
  • -
    listener: ((message: MessageValue<Message, unknown>) => void)
    +
    listener: ((message) => void)

    The message listener callback.

    +
  • -

    Returns void

    -
    - -
    +
    + +
      +
    • Removes the given worker from the pool worker nodes.

      @@ -676,16 +921,18 @@ Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker.

        -
      -

      Returns void

    +

    Returns void

    +
    -
    - -
    +
    + +
      +
    • Sends a message to the given worker.

      @@ -693,20 +940,43 @@ Can be overridden.

      Parameters

      • -
        worker: Worker
        +
        worker: Worker

        The worker which should receive the message.

        -
      • + +
      • -
        message: MessageValue<Data, unknown>
        +
        message: MessageValue<Data, unknown>

        The message.

        -
      -

      Returns void

    +

    Returns void

    +
    +
    + +
    -
    - -
      - +
    • Defined in src/pools/abstract-pool.ts:418
    +
    + +
      +
    • Sets the worker choice strategy in this pool.

      @@ -714,119 +984,219 @@ Can be overridden.

      Parameters

      • -
        workerChoiceStrategy: "ROUND_ROBIN" | "LESS_USED" | "LESS_BUSY" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN"
        +
        workerChoiceStrategy: "ROUND_ROBIN" | "LEAST_USED" | "LEAST_BUSY" | "LEAST_ELU" | "FAIR_SHARE" | "WEIGHTED_ROUND_ROBIN" | "INTERLEAVED_WEIGHTED_ROUND_ROBIN"

        The worker choice strategy.

        -
      -

      Returns void

    • +
    • +
      Optional workerChoiceStrategyOptions: WorkerChoiceStrategyOptions
      +

      The worker choice strategy options.

      +
      +
    +

    Returns void

    +
    -
    - -
    +
    + +
    +
    + +
      + +
    • +

      Sets the given worker node its tasks usage in the pool.

      +
      +
      +

      Parameters

      +
      • -
        worker: Worker
        -

        The worker.

        -
      • +
        workerNode: WorkerNode<Worker, Data>
        +

        The worker node.

        +
        +
      • -
        tasksUsage: TasksUsage
        -

        The worker tasks usage.

        -
      • +
        workerUsage: WorkerUsage
        +

        The worker usage.

        +
        +
      +

      Returns void

      +
    +
    + +
      + +
    • +
      +

      Parameters

      +
      • -
        tasksQueue: Task<Data>[]
        -

        The worker task queue.

        -
      +
      worker: Worker

    Returns void

    -
    - -
    +
    + +
      +
    • -

      Sets the given worker node its tasks usage in the pool.

      +

      Setup hook to execute code before worker nodes are created in the abstract constructor. +Can be overridden.

      +
      +

      Returns void

      +
    +
    + +
      + +
    • +

      Conditions for dynamic worker creation.

      +

      Returns boolean

      Whether to create a dynamic worker or not.

      + +
    +
    + +
    +
    + +
      + +
    • +
      +

      Parameters

      +
      • -
        tasksUsage: TasksUsage
        -

        The worker node tasks usage.

        -
      +
      workerNodeKey: number
    +

    Returns number

    +
    + +
    -
    - -
    +
    + +
      +
    • -

      Setup hook to execute code before worker node are created in the abstract constructor. -Can be overridden

      -
      +
      +

      Parameters

      +

      Returns void

    -
    - -
    +
    + +
      +
    • Parameters

      • -
        workerNodeKey: number
      -

      Returns number

    • +
    • +
      message: MessageValue<Response, unknown>
    +

    Returns void

    -
    - -
    +
    + +
    +
    + +
      +
    • This function is the listener registered for each worker message.

      - -

      Returns

      The listener function to execute when a message is received from a worker.

      -

      Returns ((message: MessageValue<Response, unknown>) => void)

      +

      Returns ((message) => void)

      The listener function to execute when a message is received from a worker.

      +
      • -
          -
        • (message: MessageValue<Response, unknown>): void
        • +
            +
          • (message): void
          • This function is the listener registered for each worker message.

            - -

            Returns

            The listener function to execute when a message is received from a worker.

            Parameters

            -

            Returns void

      +

      Returns void

      The listener function to execute when a message is received from a worker.

      + +
    +
    +
  • Defined in src/pools/abstract-pool.ts:815
  • -

    On This Page

    +

    On This Page

    +
  • constructor
  • +
  • emitter
  • +
  • filePath
  • +
  • numberOfWorkers
  • +
  • opts
  • +
  • promiseResponseMap
  • +
  • startTimestamp
  • +
  • workerChoiceStrategyContext
  • +
  • workerNodes
  • +
  • busy
  • +
  • full
  • +
  • info
  • +
  • maxSize
  • +
  • minSize
  • +
  • runTime
  • +
  • type
  • +
  • utilization
  • +
  • worker
  • +
  • afterTaskExecutionHook
  • +
  • afterWorkerSetup
  • +
  • beforeTaskExecutionHook
  • +
  • buildTasksQueueOptions
  • +
  • checkAndEmitEvents
  • +
  • checkFilePath
  • +
  • checkNumberOfWorkers
  • +
  • checkPoolOptions
  • +
  • checkValidTasksQueueOptions
  • +
  • checkValidWorkerChoiceStrategy
  • +
  • checkValidWorkerChoiceStrategyOptions
  • +
  • chooseWorkerNode
  • +
  • createAndSetupDynamicWorker
  • +
  • createAndSetupWorker
  • +
  • createWorker
  • +
  • dequeueTask
  • +
  • destroy
  • +
  • destroyWorker
  • +
  • enableTasksQueue
  • +
  • enqueueTask
  • +
  • execute
  • +
  • executeTask
  • +
  • flushTasksQueue
  • +
  • flushTasksQueues
  • +
  • getWorkerById
  • +
  • getWorkerId
  • +
  • getWorkerNodeKey
  • +
  • getWorkerUsage
  • +
  • handleTaskExecutionResponse
  • +
  • handleWorkerStartedMessage
  • +
  • internalBusy
  • +
  • isMain
  • +
  • pushWorkerNode
  • +
  • registerWorkerMessageListener
  • +
  • removeWorkerNode
  • +
  • sendToWorker
  • +
  • setTasksQueueOptions
  • +
  • setWorkerChoiceStrategy
  • +
  • setWorkerChoiceStrategyOptions
  • +
  • setWorkerNodeTasksUsage
  • +
  • setWorkerStatistics
  • +
  • setupHook
  • +
  • shallCreateDynamicWorker
  • +
  • tasksMaxQueueSize
  • +
  • tasksQueueSize
  • +
  • updateEluWorkerUsage
  • +
  • updateRunTimeWorkerUsage
  • +
  • updateTaskStatisticsWorkerUsage
  • +
  • updateWaitTimeWorkerUsage
  • +
  • workerListener
  • +
  • AbstractPool
  • +
  • AbstractWorker
  • +
  • CircularArray
  • +
  • ClusterWorker
  • +
  • DynamicClusterPool
  • +
  • DynamicThreadPool
  • +
  • FixedClusterPool
  • +
  • FixedThreadPool
  • +
  • PoolEmitter
  • +
  • Queue
  • +
  • ThreadWorker
  • +
  • WorkerChoiceStrategyContext
  • +
  • ClusterPoolOptions
  • +
  • EventLoopUtilizationMeasurementStatistics
  • +
  • IPool
  • +
  • IWorker
  • +
  • IWorkerChoiceStrategy
  • +
  • MeasurementOptions
  • +
  • MeasurementStatistics
  • +
  • MeasurementStatisticsRequirements
  • +
  • MessageValue
  • +
  • PoolInfo
  • +
  • PoolOptions
  • +
  • PromiseResponseWrapper
  • +
  • StrategyPolicy
  • +
  • Task
  • +
  • TaskError
  • +
  • TaskPerformance
  • +
  • TaskStatistics
  • +
  • TaskStatisticsRequirements
  • +
  • TasksQueueOptions
  • +
  • ThreadPoolOptions
  • +
  • WorkerChoiceStrategyOptions
  • +
  • WorkerInfo
  • +
  • WorkerNode
  • +
  • WorkerOptions
  • +
  • WorkerStatistics
  • +
  • WorkerUsage
  • +
  • ErrorHandler
  • +
  • ExitHandler
  • +
  • KillBehavior
  • +
  • Measurement
  • +
  • MessageHandler
  • +
  • OnlineHandler
  • +
  • PoolEvent
  • +
  • PoolType
  • +
  • TaskFunctions
  • +
  • WorkerAsyncFunction
  • +
  • WorkerChoiceStrategy
  • +
  • WorkerFunction
  • +
  • WorkerSyncFunction
  • +
  • WorkerType
  • +
  • KillBehaviors
  • +
  • Measurements
  • +
  • PoolEvents
  • +
  • PoolTypes
  • +
  • WorkerChoiceStrategies
  • +
  • WorkerTypes
  • +
  • availableParallelism
  • Generated using TypeDoc

    \ No newline at end of file