From b9d1c01950edd2c3f304ee22485d8b9bdb25e93e Mon Sep 17 00:00:00 2001 From: Sam Rolfe Date: Sun, 6 Sep 2026 15:54:08 +1000 Subject: [PATCH] sam-4screen-desktop 2026-9-6:15:54:8 --- .../Photo Project Master Overview.md | 32 ++++++++++++++++++- 1 file changed, 31 insertions(+), 1 deletion(-) diff --git a/300 areas/360 Dev-Ops Network Computers/Photo Project Master Overview.md b/300 areas/360 Dev-Ops Network Computers/Photo Project Master Overview.md index 62ef711..2338139 100644 --- a/300 areas/360 Dev-Ops Network Computers/Photo Project Master Overview.md +++ b/300 areas/360 Dev-Ops Network Computers/Photo Project Master Overview.md @@ -1,13 +1,24 @@ --- tags: [photos, immich, pipeline, project-overview, google-takeout, backup] created: 2026-08-27 +modified: 2026-09-06 aliases: [photo-pipeline, photo-project] --- # 📸 Photo Project — Master Overview > Single source of truth for the photo consolidation + Google Takeout + Immich + backup effort. -> Status: **Takeout downloaded & ingested; 11,269 photos awaiting review in dashboard.** +> Status: **Takeout downloaded & ingested; review in progress; merge+import built & tested.** + +## 📋 Project tracking & docs (AI + human) + +| Tool | What | Link/How to access | +|---|---|---| +| **Vikunja** | Live kanban — tasks/stages/progress | Project **"Photo Pipeline & Archive"** (To Do / In Progress / Done) | +| **Outline** | Project docs for AI agents | Collection **"Photo Pipeline & Archive"** (Overview / Architecture / Operations / Storage & Backup) | +| **Obsidian** | This note — human reading + key configs | 300 areas/360 Dev-Ops | + +> Tasks, architecture and ops live in Vikunja + Outline. This note is the quick human reference. --- @@ -196,6 +207,25 @@ git clone ssh://gitea.lab.audasmedia.com.au:2222/sam/photo-pipeline.git --- +## 🛠️ Tools (employment reference) + +| Category | Tools used | Role | +|---|---|---| +| **Orchestration** | **Prefect 3** | Flow pipelines, scheduled deployments, worker lifecycle | +| **Backend** | Python, FastAPI, SQLite | Review dashboard, dedup, quality scan | +| **Image analysis** | PIL/Pillow | Blurry/dark verdicts (luminance/edge metrics) | +| **Frontend** | htmx, Jinja2, HTML/CSS/JS | Dashboard UI with live polling | +| **Self-hosted** | NixOS, Docker, Caddy, Immich, Gitea, Vikunja, Outline | Full homelab | +| **Storage/backup** | Borg, Kopia, AWS S3, rclone/aws-cli | Backup layers + offsite | +| **Databases** | SQLite (pipeline), Postgres (Immich) | Fingerprints + assets | +| **Monitoring** | Prefect UI, systemd, journalctl, Prefect logs | Observability | + +**Demonstrated strengths**: content-addressed dedup, incremental import design, +data-safety discipline (backup-verify-before-merge), image-quality analysis at scale, +full-stack dashboard with background jobs, cross-machine SSH automation. + +--- + ## Related notes - [[Backup Architecture — Offsite to AWS S3]] — the S3 plan (bucket, IAM, costs) - [[Filesystem Drive Map]] — disk layout