feat(ees): rewrite EES tap and KS2 models for actual data structure
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 31s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m8s
Build and Push Docker Images / Build Integrator (push) Successful in 55s
Build and Push Docker Images / Build Kestra Init (push) Successful in 32s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m45s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 31s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m8s
Build and Push Docker Images / Build Integrator (push) Successful in 55s
Build and Push Docker Images / Build Kestra Init (push) Successful in 32s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m45s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
- Fix publication slugs (KS4, Phonics, Admissions were wrong) - Split KS2 into two streams: ees_ks2_attainment (long format) and ees_ks2_info (wide format context data) - Target specific filenames instead of keyword matching - Handle school_urn vs urn column naming - Pivot KS2 attainment from long to wide format in dbt staging - Add all ~40 KS2 columns the backend needs (GPS, absence, gender, disadvantaged breakdowns, context demographics) - Pass through all columns in int_ks2_with_lineage and fact_ks2 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -6,17 +6,50 @@ select
|
||||
source_urn,
|
||||
year,
|
||||
total_pupils,
|
||||
eligible_pupils,
|
||||
|
||||
-- Core attainment
|
||||
rwm_expected_pct,
|
||||
reading_expected_pct,
|
||||
writing_expected_pct,
|
||||
maths_expected_pct,
|
||||
rwm_high_pct,
|
||||
reading_expected_pct,
|
||||
reading_high_pct,
|
||||
writing_high_pct,
|
||||
maths_high_pct,
|
||||
reading_progress,
|
||||
writing_progress,
|
||||
maths_progress,
|
||||
reading_avg_score,
|
||||
maths_avg_score
|
||||
reading_progress,
|
||||
writing_expected_pct,
|
||||
writing_high_pct,
|
||||
writing_progress,
|
||||
maths_expected_pct,
|
||||
maths_high_pct,
|
||||
maths_avg_score,
|
||||
maths_progress,
|
||||
gps_expected_pct,
|
||||
gps_high_pct,
|
||||
gps_avg_score,
|
||||
science_expected_pct,
|
||||
|
||||
-- Absence
|
||||
reading_absence_pct,
|
||||
writing_absence_pct,
|
||||
maths_absence_pct,
|
||||
gps_absence_pct,
|
||||
science_absence_pct,
|
||||
|
||||
-- Gender
|
||||
rwm_expected_boys_pct,
|
||||
rwm_high_boys_pct,
|
||||
rwm_expected_girls_pct,
|
||||
rwm_high_girls_pct,
|
||||
|
||||
-- Disadvantaged
|
||||
rwm_expected_disadvantaged_pct,
|
||||
rwm_expected_non_disadvantaged_pct,
|
||||
disadvantaged_gap,
|
||||
|
||||
-- Context
|
||||
disadvantaged_pct,
|
||||
eal_pct,
|
||||
sen_support_pct,
|
||||
sen_ehcp_pct,
|
||||
stability_pct
|
||||
|
||||
from {{ ref('int_ks2_with_lineage') }}
|
||||
|
||||
Reference in New Issue
Block a user