fix(dbt): fix GIAS source column quoting and remove tests on unloaded sources
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 2m39s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m8s
Build and Push Docker Images / Build Integrator (push) Successful in 56s
Build and Push Docker Images / Build Kestra Init (push) Successful in 31s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m27s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 2m39s
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m8s
Build and Push Docker Images / Build Integrator (push) Successful in 56s
Build and Push Docker Images / Build Kestra Init (push) Successful in 31s
Build and Push Docker Images / Build Pipeline (Meltano + dbt + Airflow) (push) Successful in 1m27s
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
GIAS tap emits uppercase URN column — add quote: true so dbt source tests reference "URN" instead of urn. Remove source-level tests from tables not yet loaded (ofsted, ees, parent_view, fbit, idaci) to prevent relation-not-found errors during dbt build. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -8,65 +8,42 @@ sources:
|
||||
- name: gias_establishments
|
||||
description: GIAS bulk establishment data (one row per URN)
|
||||
columns:
|
||||
- name: urn
|
||||
- name: URN
|
||||
quote: true
|
||||
tests: [not_null, unique]
|
||||
|
||||
- name: gias_links
|
||||
description: GIAS predecessor/successor links between schools
|
||||
columns:
|
||||
- name: urn
|
||||
- name: URN
|
||||
quote: true
|
||||
tests: [not_null]
|
||||
|
||||
# Sources below are loaded by monthly/annual pipelines.
|
||||
# Source tests are added once the corresponding extract has run.
|
||||
- name: ofsted_inspections
|
||||
description: Ofsted Management Information inspection records
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: ees_ks2
|
||||
description: KS2 attainment data from Explore Education Statistics
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: ees_ks4
|
||||
description: KS4 attainment data from Explore Education Statistics
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: ees_census
|
||||
description: School census pupil characteristics
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: ees_admissions
|
||||
description: Primary and secondary school admissions data
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: ees_phonics
|
||||
description: Phonics screening check results
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: parent_view
|
||||
description: Ofsted Parent View survey responses
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: fbit_finance
|
||||
description: Financial benchmarking data from FBIT API
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
- name: idaci
|
||||
description: Income Deprivation Affecting Children Index lookups
|
||||
columns:
|
||||
- name: urn
|
||||
tests: [not_null]
|
||||
|
||||
Reference in New Issue
Block a user