JSiteCopier

Copy An Entire Website

View On Github Download .zip Download .tar.gz

This is a shell script written in bash to copy an entire website. It uses wget to download web pages and mirror the site into a local directory.

Install:

  1. You can simply run the script jsitecopy in terminal or install it by running install.sh. Installing it will enable it to be run from menu (Network category) with mouse click or from terminal just by entering jsitecopy without any path.

  2. Whether you run either of them , you first need to give them execution permission.

How To Use:

  1. Make sure the url contains the www or http term, otherwise it may download a single file and leave everything untouched.
  2. Don't use quotes in urls or file/folder path

  3. Spaces are allowed in path 

    Ex: ~/Downloads/New Site
~/Downloads/"New Site" is invalid because quotes aren't allowed.
  4. Verbose mode means it will show output in terminal or put a log in a file in wget-log in your home directory
  5. Interval means the time interval between each file download.
  6. This script runs wget which works in the background even after closing the terminal. If you want to close it, you have to run pkill wget in a terminal.

Contribute:

If you are a developer, you can consider contributing to this project by forking this repository and making changes for better and do a pull request, or sharing ideas and suggestions or finding bugs, anything at all, what you think will be beneficial for this project.

If you aren't a developer, but still want to contribute, then you can support the contributing developers spiritually, by starring the repository and sharing ideas. If you want to be notified of the continuous development, you can add this in your watch list in Github.

If you see any problems or bugs please open an issue here