Optimize media indexing and thumbnail throughput #1

Closed
opened 2026-04-05 18:12:02 +00:00 by LyAhn · 0 comments
LyAhn commented 2026-04-05 18:12:02 +00:00 (Migrated from github.com)

Summary

Improve cold-index and post-index media processing performance, especially for large folders and external drives.

Scope

  • Add atomic thumbnail job claiming
  • Add multiple thumbnail workers safely
  • Batch DB writes during thumbnail processing
  • Benchmark JPEG vs WebP thumbnail output and choose the faster acceptable option
  • Continue reducing frontend update churn during active indexing
  • Validate throughput improvements against a large fresh index

Notes

This is the last major performance pass before moving fully into embeddings.

## Summary Improve cold-index and post-index media processing performance, especially for large folders and external drives. ## Scope - [ ] Add atomic thumbnail job claiming - [ ] Add multiple thumbnail workers safely - [ ] Batch DB writes during thumbnail processing - [ ] Benchmark JPEG vs WebP thumbnail output and choose the faster acceptable option - [ ] Continue reducing frontend update churn during active indexing - [ ] Validate throughput improvements against a large fresh index ## Notes This is the last major performance pass before moving fully into embeddings.
LyAhn closed this issue 2026-06-12 21:54:46 +00:00
Sign in to join this conversation.