lists.arthurdejong.org
RSS feed

Re: Create a list of links for an entire website?

[Date Prev][Date Next] [Thread Prev][Thread Next]

Re: Create a list of links for an entire website?



On Thu, 2013-12-19 at 16:34 -0500, David Roth wrote:
> Can webcheck be used to produce a list of all the links for a website?
> Thanks!

Yes, it crawls a website and all crawled links are stored as part of the
report as can be seen here:
  http://arthurdejong.org/webcheck/demo/
There are reports of all links, external links and more. Also webcheck
includes a database (the Git version uses SQLite, older versions use
another text-based format) with all the information that can be
extracted.

What it cannot do is produce a list of all links that point to a
specific website.

Hope this helps,

-- 
-- arthur - arthur@arthurdejong.org - http://arthurdejong.org/ --
-- 
To unsubscribe send an email to
webcheck-users-unsubscribe@lists.arthurdejong.org or see
http://lists.arthurdejong.org/webcheck-users/