tudor/school_compare
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(dbt): fix stg_ees_ks4 breakdown filter: 'Total' not 'All pupils'
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 31s
Details
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m7s
Details
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m26s
Details
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 0s
Details

Browse Source 
The EES KS4 performance CSV uses breakdown_topic='Total' for the
all-pupils aggregate, not 'All pupils' as the model assumed. This
caused 0 rows to pass the filter despite 40k rows in raw.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Tudor
2026-03-28 18:35:00 +00:00
parent 3e787b395f
commit f0c76a1724
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
pipeline/transform/models/staging/stg_ees_ks4.sql
View File

@@ -46,7 +46,7 @@ all_pupils as (
{{ safe_numeric('gcse_91_percent') }} as gcse_grade_91_pct {{ safe_numeric('gcse_91_percent') }} as gcse_grade_91_pct
from performance from performance
where breakdown_topic = 'All pupils' where breakdown_topic = 'Total'
and breakdown = 'Total' and breakdown = 'Total'
and sex = 'Total' and sex = 'Total'
), ),