Logo
Explore Help
Register Sign In
tudor/school_compare
1
0
Fork 0
You've already forked school_compare
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
8f02b5125e6ec8aa766a217760f94a06626ad41d
school_compare/pipeline/plugins/extractors/tap-uk-ees/pyproject.toml

18 lines
419 B
TOML
Raw Normal View History

feat(pipeline): add Meltano + dbt + Airflow ELT pipeline scaffold Replaces the hand-rolled integrator with a production-grade ELT pipeline using Meltano (Singer taps), dbt Core (medallion architecture), and Apache Airflow (orchestration). Adds Typesense for search and PostGIS for geospatial queries. - 6 custom Singer taps (GIAS, EES, Ofsted, Parent View, FBIT, IDACI) - dbt project: 12 staging, 5 intermediate, 12 mart models - 3 Airflow DAGs (daily/monthly/annual schedules) - Typesense sync + batch geocoding scripts - docker-compose: add Airflow, Typesense; upgrade to PostGIS - Portainer stack definition matching live deployment topology Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-26 08:37:53 +00:00
[build-system]
requires = ["setuptools>=68", "wheel"]
build-backend = "setuptools.build_meta"
[project]
name = "tap-uk-ees"
version = "0.1.0"
description = "Singer tap for UK Explore Education Statistics (KS2, KS4, Census, Admissions, Phonics)"
requires-python = ">=3.10"
dependencies = [
"singer-sdk~=0.39",
"requests>=2.31",
"pandas>=2.0",
]
[project.scripts]
tap-uk-ees = "tap_uk_ees.tap:TapUKEES.cli"
Reference in New Issue Copy Permalink
Powered by Gitea Version: 1.25.5 Page: 15ms Template: 1ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API