fix(pipeline): run meltano install in Dockerfile to generate catalogs
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 32s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m13s
Build and Push Docker Images / Build Integrator (push) Successful in 58s
Build and Push Docker Images / Build Kestra Init (push) Successful in 33s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m31s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 32s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m13s
Build and Push Docker Images / Build Integrator (push) Successful in 58s
Build and Push Docker Images / Build Kestra Init (push) Successful in 33s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m31s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
Meltano elt requires catalog files (tap.properties.json) to exist. These are generated by `meltano install` which discovers tap schemas and installs the target-postgres loader. Without this step, `meltano elt` fails with "catalog file is missing". Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -29,6 +29,9 @@ COPY transform/ transform/
|
|||||||
COPY scripts/ scripts/
|
COPY scripts/ scripts/
|
||||||
COPY dags/ dags/
|
COPY dags/ dags/
|
||||||
|
|
||||||
|
# Initialize Meltano project (generates catalog, installs target-postgres)
|
||||||
|
RUN meltano install
|
||||||
|
|
||||||
# dbt deps
|
# dbt deps
|
||||||
RUN cd transform && dbt deps --profiles-dir . 2>/dev/null || true
|
RUN cd transform && dbt deps --profiles-dir . 2>/dev/null || true
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user