Hi @MohamedBassem,

Great project.

I have started using it for a week and I love it. Its philosophy is exactly as I always wanted for myself.

I wonder if you'd be willing to allow for customizing the user-agent header in the worker process, allowing for bypassingthe usual bot blockers from detecting that we're not doing harmful crawling, but rather scraping the usual content for our own self-hosted Hoarder instance; for example by passing the Firefox or Chrome user agent, or ideally by filling it randomly every single time!

https://github.com/hoarder-app/hoarder/blob/219e16a0bd8e0aaa7cbba24fc5e758e9f719907c/apps/workers/feedWorker.ts#L96-L102

An already implemented version in another part of the code:

https://github.com/hoarder-app/hoarder/blob/219e16a0bd8e0aaa7cbba24fc5e758e9f719907c/apps/workers/crawlerWorker.ts#L282-L284

Is that something you'd be OK with?

Cheers. 🥂