Configuration
Where configuration comes from
This repo ships no Helm chart — the orchestration repo renders this location’s runtime environment when the location is registered. Configuration reaches the running code as environment variables, layered from Doppler:
global/prd— shared connection/vendor values- each declared Doppler dependency project
core-data-updater/prd— this location’s own project
Later layers win on key conflicts. To add or change a value, edit it in Doppler — the platform auto-publishes a ClusterSecretStore per Doppler project, so a new project needs no platform edit.
Create core-data-updater/prd before registration. The platform’s scheduled
sync discovers new projects automatically; dispatch its secret-stores-sync
workflow when the store is needed immediately.
The production project exists and deliberately overrides
POSTGRES_DB=core_data, DBT_TARGET=prod, DBT_THREADS=4,
CORE_DATA_CONFIG_SCHEMA=core_data_updater, and APP_ENV=production.
global/prd supplies POSTGRES_HOST/PORT/USER/PASSWORD, FMP_API_KEY,
EODHD_API_KEY, and optional FINRA credentials. Because the location project
is merged last, it cannot accidentally use the legacy global database name.
DBT_PROJECT_DIR=/app/dbt is an image-level runtime setting, not a secret.
The database-backed flow and dbt run rows are operational configuration in the
core_data_updater PostgreSQL schema; they are not environment variables.
Local development
Copy .env.example to .env and fill in what dagster dev needs locally.
.env is git-ignored; nothing secret ever lands in the repo.
| Variable | Description | Default |
|---|---|---|
APP_ENV | Environment name | development |
LOG_LEVEL | Logging level | INFO |
POSTGRES_HOST/PORT/USER/PASSWORD | PostgreSQL connection | required to execute jobs |
POSTGRES_DB | One database containing all owned schemas | core_data in production |
FMP_API_KEY, EODHD_API_KEY | Required vendor credentials | none |
FINRA_API_CLIENT_ID/SECRET | Higher-limit FINRA access | optional |
DBT_TARGET | dbt profile output | dev locally, prod in production |
DBT_SCHEMA | local/test schema namespace | core_data_updater_dev locally |
DBT_THREADS | dbt worker threads | 4 |
CORE_DATA_CONFIG_SCHEMA | live workload configuration schema | core_data_updater |