Friday, May 13, 2016

Wget to download your site HTML pages

Here is the snipped to download your site as html with some restriction,

- This will not download jpeg,jpg,png,gif,mpeg,mp4 files.
- This will not download files under 'anyfolder' (sites/anyfolder)
- This will download your files inside 'files' (sites/files)

wget -p -nH --restrict-file-names=nocontrol -R jpeg,jpg,png,gif,mpeg,mp4 -X sites/anyfolder --html-extension -e robots=off --base=./ -k -P sites/files

No comments:

Post a Comment