Two major updates come to 4scraper in this release.

Parallel Downloads

4scraper now uses go routines to retrieve images and videos in parallel. The number of concurrent downloads is currently throttled at 20 and cannot be changed. This might be changed in the future.

Parallel downloading is enabled by default. To disable, you'll need to create/update your 4scraper.config to set ParallelDownload=false.

Thread Search

You can now search threads in a particular board then download directly from the results!

1. Run 4scraper.exe -f [board] [keywords] for example: 4scraper.exe -f g linux desktop. This will search all keywords in the given board and return information about any threads that match all keywords.

[Thread No] [URL] (Images: No of Images)
  [Thread Subtitle]
  [Thread OP Comment]

2. You will then be prompted to either enter a thread number to download all files from that thread, "all" to download files from all threads returned, or "q" to exit.

Hope you all enjoy this new update :) Have fun, and use responsibly.

Happy Christmas all! 🎄

For this tiny release, I've added a new flag --output -o. You use it like this: 4scraper.exe -o=custom/download/dir [url] This will download all files from the provided url and put them in your custom directory instead of the default one. Note that this will ignore the BoardDir and ThreadDir settings if you have them set in config.

Also fixed an issue where custom filenames (either because UseOriginalFilename is set to false or if there's an existing file with the same filename in the target directory) were getting an extra . before the extension.

Finally, there was some sanitization issues with the filenames when using 4chan's original filenames, and that should be fixed now.

You can now use a config file to set some basic settings if that's your thing. You can download the config file from this release and place it in the same folder as 4scraper.exe/4scraper.bin, or check the README to create one yourself.

Actually, read the README anyway... I spent so much time on that thing.

Added new flags for anyone wanting to run the tool in silent mode (perhaps to automate downloading multiple threads?) Otherwise everything stays the same. Here's the flag descriptions:

4scraper.exe [options] [URL]
  -h, --help         Display help
  -s, --silent       Run in silent mode (no output), requires URL
  -v, --version      Show version number and exit
  URL                Full 4chan thread URL to scrape

If --silent flag is set but no URL is provided, then the tool will run as normal (with prompt). For full help and examples, run 4scraper.exe -h.

Download the bin file for linux, exe file for windows. You know the drill.

4scraper is an open source command line tool written in Go that quickly finds and downloads all images, videos and gifs in a given thread. No setup or installation required, and no fluff.

1. Run 4scraper
2. Enter/paste the thread you'd like to download from and press Enter
3. Wait for the download to finish
4. Profit

Just download the correct version for your OS. If you have issues with the Linux one, let me know in the Issues tab!