Files
compass_teams_nhs/docker-compose.yml
Sam Rolfe d7d529eb0f Phase 3: parse stored Compass pages into structured items
Turn the raw pages stored by Phase 2 into rows in the SQLite items table
(AGENTS.md §11 Phase 3, FR-3/FR-4/FR-5/FR-12).

- internal/parse: dependency-free HTML reader plus extractors for the ExtJS
  learning-task grid (subject, title, category, kind, due date, status), the
  home news feed (author, posted time, title, body) and the calendar week grid
  (day column + grid offset give the time; label gives title/room/teacher).
- internal/parse: fail loudly. A challenge page, login page, changed layout or
  unknown due-date format is an explicit error, never an empty day.
- FR-4: structure is parsed deterministically; importance is classified by an
  OmniRoute model (default openrouter/google/gemini-3.5-flash-lite) with a
  deterministic fallback. The classifier used is printed and recorded.
- internal/llm: small OpenAI-compatible OmniRoute client (handles SSE replies).
- internal/store: migration 002 adds source_page, importance and external_ref
  with a unique (child_id, source, type, external_ref) index; UpsertItems,
  CountItemsByType, SampleItems and ChildByName.
- cmd/school parse: reads var/raw/<child>/<run>, upserts items, records the scan
  row (ok=0 plus the error on failure) and prints counts and samples.
- scripts/parse-compass.sh and make parse run it in a one-off container against
  the service's own volume without restarting the service.
- docs/phase-3-parse-notes.md records the approach, the FR-4 decision and the
  known gaps.

Evidence on the live database: 56 rows for Harry (20 task, 1 message, 35 event).
Re-running the same raw pages inserts 0 and updates 56.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-15 17:27:25 +11:00

41 lines
1.1 KiB
YAML

# Compass / NHS — its own image, own container, own port (8792).
# Deploy on .13: cd /home/sam/paseo/projects/compass_teams_nhs && docker compose up -d --build
#
# Secrets live in environment.d/school-service.env (gitignored), never here.
name: compass-teams-nhs
services:
school:
build:
context: .
args:
VERSION: "0.2.0-phase3"
image: compass-teams-nhs/school:0.2.0-phase3
container_name: compass-teams-nhs
restart: unless-stopped
env_file:
- environment.d/school-service.env
ports:
- "8792:8792"
volumes:
- compass-teams-nhs-data:/data
healthcheck:
test: ["CMD", "wget", "-qO-", "http://127.0.0.1:8792/health"]
interval: 30s
timeout: 5s
retries: 3
start_period: 10s
logging:
driver: json-file
options:
max-size: "10m"
max-file: "3"
# .13 has every default Docker address pool subnetted out (many projects),
# so this single-container service uses the host's default bridge and does
# not create a project network. The port is published above.
network_mode: bridge
volumes:
compass-teams-nhs-data: