Siren Platform User Guide

Connector

The Federate Connector module supports the following node configuration settings, which can be set on JDBC-enabled nodes:

siren.connector.datasources.index
The index in which Federate will store datasource configurations.
siren.connector.query.max_result_rows
DEPRECATED (to be removed in 10.4) The maximum number of rows returned when executing a query on a remote datasource. Defaults to the default value of siren.connector.query.project_max_size.
siren.query.data_terms.max_terms_count
DEPRECATED (to be removed in 10.4) the maximum number of terms that will be used to compute a join when the right table of the join is a datasource. Defaults to the default value of siren.connector.query.project_max_size.
siren.connector.query.project_max_size
A setting that controls how much data flows between datasources or between a datasource and the Elasticsearch cluster. This encapsulates both settings siren.query.data_terms.max_terms_count and siren.connector.query.max_result_rows into a single tunable knob in order to improve clarity. Defaults to 50000 records transferred between systems consisting in the projected values, e.g., joined values.
siren.connector.siren.timeout.connection
the maximum amount of seconds to wait when establishing or acquiring a JDBC connection (30 by default).
siren.connector.timeout.query
the maximum execution time for JDBC queries, in seconds (30 by default).
siren.connector.enable_union_aggregations
true by default, can be set to false to disable the use of unions in nested aggregations.
siren.connector.query.max_bucket_queries
the maximum number of JDBC queries that will be generated to compute aggregation buckets. Defaults to 500.
siren.connector.pool.size
the number of threads that will be allocated to process the execution of queries to remote datasources; by default it is set to int((number of available_processors * 3) / 2) + 1.
siren.connector.pool.queue
the maximum number of requests that should be queued if all the threads are busy. Defaults to 40.
siren.connector.jobs.pool.size
the number of threads that will be allocated to process the execution of ingestion jobs to remote datasources; by default it is set to 100.
siren.connector.jobs.pool.queue
the maximum number of requests that should be queued if all the threads are busy. Defaults to -1 (unlimited).