DynamicThreadPool | poolifier

X-Git-Url: https://git.piment-noir.org/?a=blobdiff_plain;f=docs%2Fclasses%2FDynamicThreadPool.html;h=739b1085a3d509017ae2f62f8ee7650d7695c320;hb=8735b4e51c0cfabc9612d57417834d42042cab4e;hp=a609d859bfb1757fb5c7beacb7dc657f3182dd43;hpb=6d59ea2c71b8a88d41498c6fb54dfad95fd3a3ac;p=poolifier.git diff --git a/docs/classes/DynamicThreadPool.html b/docs/classes/DynamicThreadPool.html index a609d859..739b1085 100644 --- a/docs/classes/DynamicThreadPool.html +++ b/docs/classes/DynamicThreadPool.html @@ -1,4 +1,4 @@ -DynamicThreadPool | poolifier

+DynamicThreadPool | poolifier - v2.6.29

@@ -30,12 +30,12 @@ When the maximum number of threads is reached and workers are busy, an event is

Data = unknown
-
Type of data sent to the worker. This can only be serializable data.
+
Type of data sent to the worker. This can only be structured-cloneable data.
Response = unknown
-
Type of execution response. This can only be serializable data.
+
Type of execution response. This can only be structured-cloneable data.

@@ -45,7 +45,7 @@ When the maximum number of threads is reached and workers are busy, an event is

DynamicThreadPool

Defined in src/pools/thread/dynamic.ts:15

@@ -73,24 +73,33 @@ When the maximum number of threads is reached and workers are busy, an event is info maxSize minSize +ready type +utilization worker

Methods

afterTaskExecutionHook -afterWorkerSetup +afterWorkerNodeSetup beforeTaskExecutionHook -createAndSetupDynamicWorker -createAndSetupWorker +checkDynamicPoolSize +createAndSetupDynamicWorkerNode +createAndSetupWorkerNode createWorker destroy -destroyWorker +destroyWorkerNode enableTasksQueue execute +flushTasksQueue +getWorkerInfo +hasWorkerNodeBackPressure internalBusy isMain +listTaskFunctions registerWorkerMessageListener +sendKillMessageToWorker +sendStartupMessageToWorker sendToWorker setTasksQueueOptions setWorkerChoiceStrategy @@ -141,7 +150,7 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/thread/dynamic.ts:27

Properties

@@ -150,16 +159,19 @@ When the maximum number of threads is reached and workers are busy, an event is

Emitter on which events can be listened to.

Events that can currently be listened to:

'full': Emitted when the pool is dynamic and full.
'busy': Emitted when the pool is busy.
'ready': Emitted when the number of workers created in the pool has reached the minimum size expected and are ready.
'busy': Emitted when the number of workers created in the pool has reached the maximum size expected and are executing at least one task.
'full': Emitted when the pool is dynamic and the number of workers created has reached the maximum size expected.
'destroy': Emitted when the pool is destroyed.
'error': Emitted when an uncaught error occurs.
'taskError': Emitted when an error occurs while executing a task.
'backPressure': Emitted when all worker nodes have back pressure (i.e. their tasks queue is full: queue size >= pool maximum size^2).

Defined in src/pools/abstract-pool.ts:65

`Protected` `Readonly` filePath

filePath: string

@@ -168,7 +180,7 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/abstract-pool.ts:105

`Protected` `Readonly` max

max: number

@@ -176,7 +188,7 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/thread/dynamic.ts:29

`Protected` `Readonly` numberOfWorkers

numberOfWorkers: number

@@ -185,7 +197,7 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/abstract-pool.ts:104

`Protected` `Readonly` opts

opts: ThreadPoolOptions = {}

@@ -194,11 +206,11 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/thread/fixed.ts:49

`Protected` promiseResponseMap

promiseResponseMap: Map<string, PromiseResponseWrapper<ThreadWorkerWithMessageChannel, Response>> = ...

The execution response promise map.

promiseResponseMap: Map<string, PromiseResponseWrapper<Response>> = ...

The task execution response promise map.

key: The message id of each submitted task.
value: An object that contains the worker, the execution response promise resolve and reject callbacks.

Defined in src/pools/abstract-pool.ts:75

`Protected` workerChoiceStrategyContext

workerChoiceStrategyContext: WorkerChoiceStrategyContext<ThreadWorkerWithMessageChannel, Data, Response>

workerChoiceStrategyContext: WorkerChoiceStrategyContext<Worker, Data, Response>

Worker choice strategy context referencing a worker choice algorithm implementation.

Defined in src/pools/abstract-pool.ts:81

`Readonly` workerNodes

workerNodes: WorkerNode<ThreadWorkerWithMessageChannel, Data>[] = []

`Readonly` `Internal` workerNodes

workerNodes: IWorkerNode<Worker, Data>[] = []

Pool worker nodes.

Defined in src/pools/abstract-pool.ts:62

Accessors

@@ -241,7 +253,7 @@ When the maximum number of threads is reached and workers are busy, an event is

Defined in src/pools/thread/dynamic.ts:48

`Protected` full

Defined in src/pools/abstract-pool.ts:631

info

Defined in src/pools/abstract-pool.ts:321

`Protected` maxSize

get maxSize(): number
-
Pool maximum size.
+
The pool maximum size.

Returns number
Overrides FixedThreadPool.maxSize
- Defined in src/pools/thread/dynamic.ts:42

Defined in src/pools/thread/dynamic.ts:43

`Protected` minSize

get minSize(): number
-
Pool minimum size.
+
The pool minimum size.

Returns number
Inherited from FixedThreadPool.minSize
- Defined in src/pools/thread/fixed.ts:122

Defined in src/pools/thread/fixed.ts:132

`Private` ready

get ready(): boolean
+
The pool readiness boolean status.
+
+
Returns boolean
+
+
Inherited from FixedThreadPool.ready
+
- Defined in src/pools/abstract-pool.ts:464

`Protected` type

get type(): "fixed" | "dynamic"
-
Pool type.
+
The pool type.

If it is 'dynamic', it provides the max property.

Returns "fixed" | "dynamic"
Overrides FixedThreadPool.type
- Defined in src/pools/thread/dynamic.ts:37

Defined in src/pools/thread/dynamic.ts:38

`Private` utilization

get utilization(): number
+
The approximate pool utilization.
+
+
Returns number
The pool utilization.
+ +
+
Inherited from FixedThreadPool.utilization
+
- Defined in src/pools/abstract-pool.ts:481

`Protected` worker

get worker(): "cluster" | "thread"
get worker(): "thread" | "cluster"
-
Gets the worker type.
+
The worker type.

-
Returns "cluster" | "thread"
+
Returns "thread" | "cluster"
Inherited from FixedThreadPool.worker
- Defined in src/pools/thread/fixed.ts:117

Defined in src/pools/thread/fixed.ts:127

Methods

`Protected` afterTaskExecutionHook

afterTaskExecutionHook(worker, message): void
afterTaskExecutionHook(workerNodeKey, message): void
Hook executed after the worker task execution. Can be overridden.
@@ -330,12 +367,12 @@ Can be overridden.

Parameters
- -
  worker: ThreadWorkerWithMessageChannel
  -
  The worker.
  +
  workerNodeKey: number
  +
  The worker node key.
- -
  message: MessageValue<Response, unknown, Worker | MessagePort>
  +
  message: MessageValue<Response, unknown>
  
  The received message.
@@ -343,28 +380,28 @@ Can be overridden.
Inherited from FixedThreadPool.afterTaskExecutionHook
- Defined in src/pools/abstract-pool.ts:505

`Protected` afterWorkerSetup

Defined in src/pools/abstract-pool.ts:818

`Protected` afterWorkerNodeSetup

afterWorkerSetup(worker): void
afterWorkerNodeSetup(workerNodeKey): void
-
Function that can be hooked up when a worker has been newly created and moved to the pool worker nodes.
-
Can be used to update the maxListeners or binding the main-worker<->worker connection if not bind by default.
+
Method hooked up after a worker node has been newly created. +Can be overridden.
Parameters
- -
  worker: ThreadWorkerWithMessageChannel
  -
  The newly created worker.
  +
  workerNodeKey: number
  +
  The newly created worker node key.
Returns void
-
Inherited from FixedThreadPool.afterWorkerSetup
+
Inherited from FixedThreadPool.afterWorkerNodeSetup
- Defined in src/pools/thread/fixed.ts:102

Defined in src/pools/abstract-pool.ts:1081

`Protected` beforeTaskExecutionHook

`Protected` createAndSetupDynamicWorker

Defined in src/pools/abstract-pool.ts:795

`Protected` checkDynamicPoolSize

checkDynamicPoolSize(min, max): void
+
+
Parameters
+
- +
  min: number
- +
  max: number
+
Returns void
+
Inherited from FixedThreadPool.checkDynamicPoolSize
+
- Defined in src/pools/abstract-pool.ts:176

`Protected` createAndSetupDynamicWorkerNode

createAndSetupDynamicWorker(): ThreadWorkerWithMessageChannel
createAndSetupDynamicWorkerNode(): number
-
Creates a new dynamic worker and sets it up completely in the pool worker nodes.
+
Creates a new, completely set up dynamic worker node.

-
Returns ThreadWorkerWithMessageChannel
New, completely set up dynamic worker.
+
Returns number
New, completely set up dynamic worker node key.
-
Inherited from FixedThreadPool.createAndSetupDynamicWorker
+
Inherited from FixedThreadPool.createAndSetupDynamicWorkerNode
- Defined in src/pools/abstract-pool.ts:736

`Protected` createAndSetupWorker

Defined in src/pools/abstract-pool.ts:1028

`Protected` createAndSetupWorkerNode

createAndSetupWorker(): ThreadWorkerWithMessageChannel
createAndSetupWorkerNode(): number
-
Creates a new worker and sets it up completely in the pool worker nodes.
+
Creates a new, completely set up worker node.

-
Returns ThreadWorkerWithMessageChannel
New, completely set up worker.
+
Returns number
New, completely set up worker node key.
-
Inherited from FixedThreadPool.createAndSetupWorker
+
Inherited from FixedThreadPool.createAndSetupWorkerNode
- Defined in src/pools/abstract-pool.ts:703

Defined in src/pools/abstract-pool.ts:988

`Protected` createWorker

createWorker(): ThreadWorkerWithMessageChannel
createWorker(): Worker
Creates a new worker.

-
Returns ThreadWorkerWithMessageChannel
Newly created worker.
+
Returns Worker
Newly created worker.
Inherited from FixedThreadPool.createWorker
- Defined in src/pools/thread/fixed.ts:94

Defined in src/pools/thread/fixed.ts:114

destroy

destroy(): Promise<void>
-
Terminate every current worker in this pool.
+
Terminates all workers in this pool.

Returns Promise<void>
Inherited from FixedThreadPool.destroy
- Defined in src/pools/abstract-pool.ts:450

`Protected` destroyWorker

Defined in src/pools/abstract-pool.ts:741

`Protected` destroyWorkerNode

destroyWorker(worker): Promise<void>
destroyWorkerNode(workerNodeKey): Promise<void>
-
Terminates the given worker.
+
Terminates the worker node given its worker node key.
Parameters
- -
  worker: ThreadWorkerWithMessageChannel
  -
  A worker within workerNodes.
  +
  workerNodeKey: number
  +
  The worker node key.
Returns Promise<void>
-
Inherited from FixedThreadPool.destroyWorker
+
Inherited from FixedThreadPool.destroyWorkerNode
- Defined in src/pools/thread/fixed.ts:70

Defined in src/pools/thread/fixed.ts:60

enableTasksQueue

Defined in src/pools/abstract-pool.ts:596

execute

execute(data?, name?): Promise<Response>
execute(data?, name?, transferList?): Promise<Response>
Executes the specified function in the worker constructor with the task data input parameter.

@@ -499,12 +552,17 @@ Can be overridden.
- Optional data: Data
  -
  The task input data for the specified worker function. This can only be serializable data.
  +
  The optional task input data for the specified task function. This can only be structured-cloneable data.
- Optional name: string
  -
  The name of the worker function to execute. If not specified, the default worker function will be executed.
  +
  The optional name of the task function to execute. If not specified, the default task function will be executed.
  +
  +
- +
  Optional transferList: TransferListItem[]
  +
  An optional array of transferable objects to transfer ownership of. Ownership of the transferred objects is given to the pool's worker_threads worker and they should not be used in the main thread afterwards.
Returns Promise<Response>
Promise that will be fulfilled when the task is completed.
@@ -512,20 +570,76 @@ Can be overridden.
Inherited from FixedThreadPool.execute
- Defined in src/pools/abstract-pool.ts:416

Defined in src/pools/abstract-pool.ts:681

`Protected` flushTasksQueue

flushTasksQueue(workerNodeKey): void
+
+
Parameters
+
- +
  workerNodeKey: number
+
Returns void
+
Inherited from FixedThreadPool.flushTasksQueue
+
- Defined in src/pools/abstract-pool.ts:1327

`Protected` getWorkerInfo

getWorkerInfo(workerNodeKey): WorkerInfo
+
Gets the worker information given its worker node key.
+
+
+
Parameters
+
- +
  workerNodeKey: number
  +
  The worker node key.
  +
  +
+
Returns WorkerInfo
The worker information.
+ +
+
Inherited from FixedThreadPool.getWorkerInfo
+
- Defined in src/pools/abstract-pool.ts:1241

hasWorkerNodeBackPressure

hasWorkerNodeBackPressure(workerNodeKey): boolean
Internal +
Whether the worker node has back pressure (i.e. its tasks queue is full).
+
+
+
Parameters
+
- +
  workerNodeKey: number
  +
  The worker node key.
  +
  +
+
Returns boolean
true if the worker node has back pressure, false otherwise.
+ +
+
Inherited from FixedThreadPool.hasWorkerNodeBackPressure
+
- Defined in src/pools/abstract-pool.ts:1284

`Protected` internalBusy

internalBusy(): boolean
-
Whether worker nodes are executing at least one task.
+
Whether worker nodes are executing concurrently their tasks quota or not.

Returns boolean
Worker nodes busyness boolean status.
Inherited from FixedThreadPool.internalBusy
- Defined in src/pools/abstract-pool.ts:407

Defined in src/pools/abstract-pool.ts:647

`Protected` isMain

Defined in src/pools/thread/fixed.ts:55

listTaskFunctions

listTaskFunctions(): string[]
+
Lists the names of task function available in this pool.
+
+
Returns string[]
The names of task function available in this pool.
+ +
+
Inherited from FixedThreadPool.listTaskFunctions
+
- Defined in src/pools/abstract-pool.ts:668

`Protected` registerWorkerMessageListener

registerWorkerMessageListener<Message>(worker, listener): void
registerWorkerMessageListener<Message>(workerNodeKey, listener): void
-
Registers a listener callback on the given worker.
+
Registers a listener callback on the worker given its worker node key.
Type Parameters
@@ -554,8 +681,8 @@ Can be overridden.

Parameters
- -
  worker: ThreadWorkerWithMessageChannel
  -
  The worker which should register a listener.
  +
  workerNodeKey: number
  +
  The worker node key.
- @@ -572,38 +699,79 @@ Can be overridden.
  
  Parameters
  - -
    message: MessageValue<Message, unknown, Worker | MessagePort>
+
message: MessageValue<Message, unknown>

Returns void

Defined in src/pools/thread/fixed.ts:104

`Protected` sendKillMessageToWorker

sendKillMessageToWorker(workerNodeKey, workerId): Promise<void>
+
+
Parameters
+
- +
  workerNodeKey: number
- +
  workerId: number
+
Returns Promise<void>
+
Inherited from FixedThreadPool.sendKillMessageToWorker
+
- Defined in src/pools/abstract-pool.ts:750

`Protected` sendStartupMessageToWorker

sendStartupMessageToWorker(workerNodeKey): void
+
Sends the startup message to worker given its worker node key.
+
+
+
Parameters
+
- +
  workerNodeKey: number
  +
  The worker node key.
  +
  +
+
Returns void
+
+
Inherited from FixedThreadPool.sendStartupMessageToWorker
+
- Defined in src/pools/thread/fixed.ts:88

`Protected` sendToWorker

sendToWorker(worker, message): void
sendToWorker(workerNodeKey, message, transferList?): void
-
Sends a message to the given worker.
+
Sends a message to worker given its worker node key.
Parameters
- -
  worker: ThreadWorkerWithMessageChannel
  -
  The worker which should receive the message.
  +
  workerNodeKey: number
  +
  The worker node key.
- -
  message: MessageValue<Data, unknown, Worker | MessagePort>
  +
  message: MessageValue<Data, unknown>
  
  The message.
  
  +
- +
  Optional transferList: TransferListItem[]
  +
  The optional array of transferable objects.
  +
Returns void
Inherited from FixedThreadPool.sendToWorker
- Defined in src/pools/thread/fixed.ts:78

Defined in src/pools/thread/fixed.ts:77

`Protected` setupHook

setupHook(): void
-
Setup hook to execute code before worker node are created in the abstract constructor. -Can be overridden
+
Setup hook to execute code before worker nodes are created in the abstract constructor. +Can be overridden.

Returns void
Inherited from FixedThreadPool.setupHook
- Defined in src/pools/abstract-pool.ts:473

Defined in src/pools/abstract-pool.ts:779

`Protected` workerListener

workerListener(): ((message) => void)
-
This function is the listener registered for each worker message.
+
This method is the listener registered for each worker message.

Returns ((message) => void)
The listener function to execute when a message is received from a worker.
@@ -696,20 +864,20 @@ Can be overridden
- (message): void
- -
  This function is the listener registered for each worker message.
  +
  This method is the listener registered for each worker message.
  Parameters
  
  -
  message: MessageValue<Response, unknown, Worker | MessagePort>
  +
  message: MessageValue<Response, unknown>
Returns void
The listener function to execute when a message is received from a worker.

Defined in src/pools/abstract-pool.ts:1164

WorkerTypes

availableParallelism

Generated using TypeDoc

\ No newline at end of file

workerNodeKey: number

worker: ThreadWorkerWithMessageChannel

workerNodeKey: number

workerNodeKey: number

workerNodeKey: number

message: MessageValue<Message, unknown, Worker | MessagePort>

workerNodeKey: number

Parameters

message: MessageValue<Response, unknown, Worker | MessagePort>