sam/obsidian-vault
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

sam-4screen-desktop 2026-9-6:15:54:8

Browse Source
This commit is contained in:
Sam Rolfe
2026-09-06 15:54:08 +10:00
parent 4ac34fd510
commit b9d1c01950
1 changed files with 31 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

32
300 areas/360 Dev-Ops Network Computers/Photo Project Master Overview.md
View File

@@ -1,13 +1,24 @@
--- ---
tags: [photos, immich, pipeline, project-overview, google-takeout, backup] tags: [photos, immich, pipeline, project-overview, google-takeout, backup]
created: 2026-08-27 created: 2026-08-27
modified: 2026-09-06
aliases: [photo-pipeline, photo-project] aliases: [photo-pipeline, photo-project]
--- ---
# 📸 Photo Project — Master Overview # 📸 Photo Project — Master Overview
> Single source of truth for the photo consolidation + Google Takeout + Immich + backup effort. > Single source of truth for the photo consolidation + Google Takeout + Immich + backup effort.
> Status: **Takeout downloaded & ingested; 11,269 photos awaiting review in dashboard.** > Status: **Takeout downloaded & ingested; review in progress; merge+import built & tested.**
## 📋 Project tracking & docs (AI + human)
| Tool | What | Link/How to access |
|---|---|---|
| **Vikunja** | Live kanban — tasks/stages/progress | Project **"Photo Pipeline & Archive"** (To Do / In Progress / Done) |
| **Outline** | Project docs for AI agents | Collection **"Photo Pipeline & Archive"** (Overview / Architecture / Operations / Storage & Backup) |
| **Obsidian** | This note — human reading + key configs | 300 areas/360 Dev-Ops |
> Tasks, architecture and ops live in Vikunja + Outline. This note is the quick human reference.
--- ---
@@ -196,6 +207,25 @@ git clone ssh://gitea.lab.audasmedia.com.au:2222/sam/photo-pipeline.git
--- ---
## 🛠️ Tools (employment reference)
| Category | Tools used | Role |
|---|---|---|
| **Orchestration** | **Prefect 3** | Flow pipelines, scheduled deployments, worker lifecycle |
| **Backend** | Python, FastAPI, SQLite | Review dashboard, dedup, quality scan |
| **Image analysis** | PIL/Pillow | Blurry/dark verdicts (luminance/edge metrics) |
| **Frontend** | htmx, Jinja2, HTML/CSS/JS | Dashboard UI with live polling |
| **Self-hosted** | NixOS, Docker, Caddy, Immich, Gitea, Vikunja, Outline | Full homelab |
| **Storage/backup** | Borg, Kopia, AWS S3, rclone/aws-cli | Backup layers + offsite |
| **Databases** | SQLite (pipeline), Postgres (Immich) | Fingerprints + assets |
| **Monitoring** | Prefect UI, systemd, journalctl, Prefect logs | Observability |
**Demonstrated strengths**: content-addressed dedup, incremental import design,
data-safety discipline (backup-verify-before-merge), image-quality analysis at scale,
full-stack dashboard with background jobs, cross-machine SSH automation.
---
## Related notes ## Related notes
- [[Backup Architecture — Offsite to AWS S3]] — the S3 plan (bucket, IAM, costs) - [[Backup Architecture — Offsite to AWS S3]] — the S3 plan (bucket, IAM, costs)
- [[Filesystem Drive Map]] — disk layout - [[Filesystem Drive Map]] — disk layout