tudor/school_compare
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

test(dim_school): downgrade phase not_null to warn
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 13s
Details
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 45s
Details
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m16s
Details
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
Details

Browse Source 
The new phase inference can legitimately leave ~1100 independent schools with
null phase (no GIAS phase, no statutory ages, name gives no hint). That's a
known data quality gap, not a pipeline failure — the UI already handles null
by showing no pill. Downgrade the test to warn so it stays visible in dbt
output without blocking the DAG.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Tudor Sitaru
2026-04-07 22:12:57 +01:00
parent ca5f6a962c
commit f053b35c6f
1 changed files with 7 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
pipeline/transform/models/marts/_marts_schema.yml
+7 -1
View File
@@ -9,7 +9,13 @@ models:
- name: school_name - name: school_name
tests: [not_null] tests: [not_null]
- name: phase - name: phase
tests: [not_null] description: >
Primary / Secondary / All-through etc. May be null for a small number
of independent schools where GIAS publishes "Not Applicable", no
statutory age range, and the school name gives no hint.
tests:
- not_null:
severity: warn
- name: status - name: status
tests: tests:
- accepted_values: - accepted_values: