WebFrost system overview

WebFrost system overview An architecture diagram generated by Archify. Web UI · React SPA via SDK · Architecture component Web UI React SPA via SDK SDK, curl, scripts · REST clients · Architecture component SDK, curl, scripts REST clients HTTP API · Elysia, /api/v1 + static UI · Server process (@webfrost/server) HTTP API Elysia, /api/v1 + static UI Scheduler · polls every 30 s · Server process (@webfrost/server) Scheduler polls every 30 s Recovery sweep · every 60 s · Server process (@webfrost/server) Recovery sweep every 60 s JobRunner · WEBFROST_CONCURRENCY slots · Server process (@webfrost/server) JobRunner WEBFROST_CONCURRENCY slots Pipeline · extractors in parallel · Server process (@webfrost/server) Pipeline extractors in parallel webfrost CLI · own process · Architecture component webfrost CLI own process Database · SQLite, PostgreSQL or MySQL · Architecture component Database SQLite, PostgreSQL or MySQL File storage · snapshots/ or S3 bucket · Architecture component File storage snapshots/ or S3 bucket HTTP fetch · safeFetch, once · Architecture component HTTP fetch safeFetch, once Chromium · browser guard · Architecture component Chromium browser guard yt-dlp · subprocess · Architecture component yt-dlp subprocess Public web · pages, feeds, media · Architecture component Public web pages, feeds, media REST REST enqueue (202) due schedules orphaned jobs run library calls results, status files public hosts one load media Server process (@webfrost/server) Legend Frontend Backend Database Security External