5 Commits

Include renames

Author	SHA1	Message	Date
TudorandClaude Fable 5	02084e427c	feat(pipeline): extract Ofsted report-card judgements (rc_* columns) ... Wires the tap TODO in stg_ofsted_inspections.sql: maps the 7 confirmed report-card MI columns (Safeguarding standards, Inclusion, Curriculum and teaching, Achievement, Attendance and behaviour, Personal development and wellbeing, Leadership and governance) into rc_* fields, parsed via the new parse_report_card_grade macro against real sampled grade values (Exceptional/Strong standard/Expected standard/Needs attention/Urgent improvement). rc_safeguarding_met becomes boolean from Met/Not met. rc_early_years/rc_sixth_form have no MI column yet and are intentionally omitted from COLUMN_PRIORITY, staying NULL. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0146VHeLAWjDVE2B5uU67jCB	2026-07-12 22:12:33 +01:00
TudorandClaude Opus 4.8	2332ee6347	feat(ofsted): fall back to ungraded inspection outcome for school grade ... Ungraded (Section 8) inspections don't assign a fresh grade — the export only gives free text like "School remains Good". Parse that text into a grade (remains Outstanding -> 1, remains Good -> 2, else null) and use it as a last-resort fallback when no graded overall effectiveness exists. Also retain schools that have only an ungraded inspection (no graded date) by coalescing the inspection date, so ~8.5k previously-dropped schools now carry a grade. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-07-01 21:44:01 +01:00
tudorandClaude Sonnet 4.6	33b395d2bd	fix(dbt): apply safe_numeric macro to fix EES suppression code 'c' errors ... Replace nullif(col, 'z') casts with safe_numeric macro across KS2, KS4, and admissions staging models. The regex-based macro treats any non-numeric string (z, c, x, q, u, etc.) as NULL without needing an explicit list. Also fix FSM_eligible_percent column quoting in stg_ees_admissions — target- postgres stores mixed-case column names quoted, so unquoted references were being folded to fsm_eligible_percent by PostgreSQL. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-03-27 10:41:27 +00:00
tudorandClaude Opus 4.6	45f3e4d9fc	fix(dbt): override generate_schema_name to use direct schema names ... dbt default prepends the profile schema as prefix (public_staging, public_marts). Override to use custom schema names directly (staging, marts) so scripts can reference marts.dim_location correctly. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-03-26 21:09:23 +00:00
tudorandClaude Opus 4.6	8f02b5125e	feat(pipeline): add Meltano + dbt + Airflow ELT pipeline scaffold ... Replaces the hand-rolled integrator with a production-grade ELT pipeline using Meltano (Singer taps), dbt Core (medallion architecture), and Apache Airflow (orchestration). Adds Typesense for search and PostGIS for geospatial queries. - 6 custom Singer taps (GIAS, EES, Ofsted, Parent View, FBIT, IDACI) - dbt project: 12 staging, 5 intermediate, 12 mart models - 3 Airflow DAGs (daily/monthly/annual schedules) - Typesense sync + batch geocoding scripts - docker-compose: add Airflow, Typesense; upgrade to PostGIS - Portainer stack definition matching live deployment topology Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-03-26 08:37:53 +00:00