fix(pipeline): run meltano install in Dockerfile to generate catalogs
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 32s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m13s
Build and Push Docker Images / Build Integrator (push) Successful in 58s
Build and Push Docker Images / Build Kestra Init (push) Successful in 33s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m31s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s

Meltano elt requires catalog files (tap.properties.json) to exist.
These are generated by `meltano install` which discovers tap schemas
and installs the target-postgres loader. Without this step, `meltano
elt` fails with "catalog file is missing".

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-03-26 12:28:59 +00:00
parent 07869738c0
commit 1c77a6c593

View File

@@ -29,6 +29,9 @@ COPY transform/ transform/
COPY scripts/ scripts/ COPY scripts/ scripts/
COPY dags/ dags/ COPY dags/ dags/
# Initialize Meltano project (generates catalog, installs target-postgres)
RUN meltano install
# dbt deps # dbt deps
RUN cd transform && dbt deps --profiles-dir . 2>/dev/null || true RUN cd transform && dbt deps --profiles-dir . 2>/dev/null || true