u/AppointmentNearby161

If I select my entire library and select download metadata, pretty quickly I start to get download errors presumably because Amazon, Goodreads and Google are treating me like a bot. I haven't seen a way to rate limit the metadata downloads. I am willing to download metadata a a couple of books per minute if it avoids blocks.

Does a script exist that uses the CLI interface to walk through a library downloading metadata with a variable time out and graceful recovery from being blocked?

I have a data hording problem. I self host a kiwix server with all the books from project Gutenberg, the survivor library, and some smaller libraries. The project Gutenberg books are epubs while the survivor library has pdfs and the others have a variety of formats.

Browsing these books across the different kiwix sites and then reading them is a pain. I like Calibre better. Will Calibre, and Calibre web, scale to a library with 100s of thousands of books (yeah I have a data hording problem)?

What is the best way to import huge libraries like the survivor library and project Gutenberg?,