Siren Platform User Guide

Thread Pools

Siren Federate introduces new thread pools:

federate.planner
For the query planner operations. Thread pool type is scaling.
federate.data
For the data operations (create, upload, delete). Thread pool type is scaling.
federate.task.worker
For task worker threads. Thread pool type is fixed_auto_queue_size with a size of max((# of available_processors) - 1, 1), and initial queue_size of 1000.
federate.connector.query
For connector query operations. Thread pool type is fixed_auto_queue_size with a size of int((# of available_processors * 3) / 2) + 1, and an unlimited initial queue_size with -1.
federate.connector.jobs.management
For connector job management operations like starting and stopping ingestion jobs. Thread pool type is scaling.
federate.connector.jobs
For job worker threads like ingestion jobs and related concurrent indexing bulk requests. Thread pool type is fixed_auto_queue_size with a size of int((# of available_processors * 3) / 2) + 1, and an unlimited initial queue_size with -1.
federate.connector.internal
For connector internal cluster communications. Thread pool type is scaling.
In this section: