school_compare

tudor/school_compare

Fork 0

Files

History

Tudor ae9fd26eba

Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 32s

Details

Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m10s

Details

Build and Push Docker Images / Build Integrator (push) Successful in 57s

Details

Build and Push Docker Images / Build Kestra Init (push) Successful in 32s

Details

Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m30s

Details

Build and Push Docker Images / Trigger Portainer Update (push) Successful in 0s

Details

perf(dbt): materialize stg_ees_ks2 and stg_ees_ks4 as tables

KS2 attainment has 1.2M rows in long format. As a view, the pivot was
re-executed inline for every downstream model (intermediate → fact),
causing fact_ks2_performance CREATE TABLE to run for 18+ minutes.

Materializing as tables means the pivot runs once during staging, and
downstream models read from a pre-computed ~16k-row result.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-03-27 11:20:20 +00:00

dags

feat: migrate backend to marts schema, update EES tap for verified datasets

2026-03-27 09:29:27 +00:00

plugins/extractors

fix(ees-tap): filter out rows with null URN before emitting

2026-03-27 10:13:17 +00:00

scripts

fix(pipeline): make total_pupils non-optional for Typesense, add lat/lng to dim_location

2026-03-26 22:45:02 +00:00

transform

perf(dbt): materialize stg_ees_ks2 and stg_ees_ks4 as tables