Thread Pools
Siren Federate introduces new thread pools:
-
federate.planner
- For the query planner operations. Thread pool type is
scaling
. -
federate.data
- For the data operations (create, upload, delete). Thread pool type is
scaling
. -
federate.task.worker
- For task worker threads. Thread pool type is
fixed_auto_queue_size
with a size ofmax((# of available_processors) - 1, 1)
, and initial queue_size of1000
. -
federate.connector.query
- For connector query operations. Thread pool type is
fixed_auto_queue_size
with a size ofint((# of available_processors * 3) / 2) + 1
, and an unlimited initial queue_size with-1
. -
federate.connector.jobs.management
- For connector job management operations like starting and stopping ingestion jobs. Thread pool type is
scaling
. -
federate.connector.jobs
- For job worker threads like ingestion jobs and related concurrent indexing bulk requests. Thread pool type is
fixed_auto_queue_size
with a size ofint((# of available_processors * 3) / 2) + 1
, and an unlimited initial queue_size with-1
. -
federate.connector.internal
- For connector internal cluster communications. Thread pool type is
scaling
.