tudor/school_compare
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(ks2): make reimport async with polling to avoid HTTP timeout
All checks were successful
Build and Push Docker Images / Build Backend (FastAPI) (push) Successful in 47s
Details
Build and Push Docker Images / Build Frontend (Next.js) (push) Successful in 1m12s
Details
Build and Push Docker Images / Build Integrator (push) Successful in 58s
Details
Build and Push Docker Images / Build Kestra Init (push) Successful in 31s
Details
Build and Push Docker Images / Trigger Portainer Update (push) Successful in 1s
Details

Browse Source 
The geocoding pass over ~15k schools takes longer than any reasonable
HTTP timeout. New approach:
- POST /api/admin/reimport-ks2 starts migration in background thread,
  returns {"status":"started"} immediately
- GET /api/admin/reimport-ks2/status returns {running, done}
- ks2.py polls status every 30s (max 2h) before returning
- Kestra flow timeout bumped to PT2H

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Tudor
2026-03-24 21:08:06 +00:00
parent 68b15400b0
commit 0e5b71d4a0
3 changed files with 71 additions and 23 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
integrator/flows/ks2.yml
View File

@@ -10,7 +10,7 @@ tasks:
uri: http://integrator:8001/run/ks2?action=load
method: POST
allowFailed: false
timeout: PT20M # full migration takes ~10 min; give headroom
timeout: PT2H # polls backend every 30s; geocoding 15k schools takes up to 1h
errors:
- id: notify-failure