pipeline/requirements.txt

# Pipeline dependencies
meltano==4.1.*
dbt-postgres~=1.10
apache-airflow==3.1.*
apache-airflow-providers-standard>=1.0
apache-airflow-providers-postgres>=5.0
typesense>=2.0,<3
requests>=2.31
openpyxl>=3.1
odfpy>=1.4
psycopg2-binary>=2.9
feat(pipeline): add Meltano + dbt + Airflow ELT pipeline scaffold Replaces the hand-rolled integrator with a production-grade ELT pipeline using Meltano (Singer taps), dbt Core (medallion architecture), and Apache Airflow (orchestration). Adds Typesense for search and PostGIS for geospatial queries. - 6 custom Singer taps (GIAS, EES, Ofsted, Parent View, FBIT, IDACI) - dbt project: 12 staging, 5 intermediate, 12 mart models - 3 Airflow DAGs (daily/monthly/annual schedules) - Typesense sync + batch geocoding scripts - docker-compose: add Airflow, Typesense; upgrade to PostGIS - Portainer stack definition matching live deployment topology Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 2026-03-26 08:37:53 +00:00			`# Pipeline dependencies`
chore(pipeline): bump all dependencies to latest stable versions - Airflow 2.11 → 3.1 (BashOperator moved to providers-standard) - Meltano 3.5 → 4.1 (meltano.yml version 2, meltanolabs target-postgres) - dbt-postgres 1.9 → 1.10 - singer-sdk 0.39 → 0.53 (all 6 taps) - Typesense Docker 27.1 → 30.1 - Typesense Python client >=2.0 - Python base image 3.12 → 3.13 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 2026-03-26 09:18:11 +00:00			`meltano==4.1.*`
			`dbt-postgres~=1.10`
			`apache-airflow==3.1.*`
			`apache-airflow-providers-standard>=1.0`
feat(pipeline): add Meltano + dbt + Airflow ELT pipeline scaffold Replaces the hand-rolled integrator with a production-grade ELT pipeline using Meltano (Singer taps), dbt Core (medallion architecture), and Apache Airflow (orchestration). Adds Typesense for search and PostGIS for geospatial queries. - 6 custom Singer taps (GIAS, EES, Ofsted, Parent View, FBIT, IDACI) - dbt project: 12 staging, 5 intermediate, 12 mart models - 3 Airflow DAGs (daily/monthly/annual schedules) - Typesense sync + batch geocoding scripts - docker-compose: add Airflow, Typesense; upgrade to PostGIS - Portainer stack definition matching live deployment topology Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 2026-03-26 08:37:53 +00:00			`apache-airflow-providers-postgres>=5.0`
chore(pipeline): bump all dependencies to latest stable versions - Airflow 2.11 → 3.1 (BashOperator moved to providers-standard) - Meltano 3.5 → 4.1 (meltano.yml version 2, meltanolabs target-postgres) - dbt-postgres 1.9 → 1.10 - singer-sdk 0.39 → 0.53 (all 6 taps) - Typesense Docker 27.1 → 30.1 - Typesense Python client >=2.0 - Python base image 3.12 → 3.13 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 2026-03-26 09:18:11 +00:00			`typesense>=2.0,<3`
feat(pipeline): add Meltano + dbt + Airflow ELT pipeline scaffold Replaces the hand-rolled integrator with a production-grade ELT pipeline using Meltano (Singer taps), dbt Core (medallion architecture), and Apache Airflow (orchestration). Adds Typesense for search and PostGIS for geospatial queries. - 6 custom Singer taps (GIAS, EES, Ofsted, Parent View, FBIT, IDACI) - dbt project: 12 staging, 5 intermediate, 12 mart models - 3 Airflow DAGs (daily/monthly/annual schedules) - Typesense sync + batch geocoding scripts - docker-compose: add Airflow, Typesense; upgrade to PostGIS - Portainer stack definition matching live deployment topology Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 2026-03-26 08:37:53 +00:00			`requests>=2.31`
			`openpyxl>=3.1`
			`odfpy>=1.4`
			`psycopg2-binary>=2.9`