webcheck commit: r456 - webcheck/webcheck

[Commits of the webcheck project <webcheck-commits [at] lists.arthurdejong.org>]

Author: arthur
Date: Fri Oct 14 10:14:28 2011
New Revision: 456
URL: http://arthurdejong.org/viewvc/webcheck?revision=456&view=revision

Log:
simplify logging of depth

Modified:
   webcheck/webcheck/crawler.py

Modified: webcheck/webcheck/crawler.py
==============================================================================
--- webcheck/webcheck/crawler.py        Sat Oct  8 20:43:55 2011        (r455)
+++ webcheck/webcheck/crawler.py        Fri Oct 14 10:14:28 2011        (r456)
@@ -410,8 +410,8 @@
         for link in self.bases:
             link.depth = 0
         session.commit()
-        debugio.debug('crawler.postprocess(): %d links at depth 0' % count)
         while count > 0:
+            debugio.debug('crawler.postprocess(): %d links at depth %d' % 
(count, depth))
             # update the depth of all links without a depth that have a
             # parent with the previous depth
             qry = session.query(Link).filter(Link.depth == None)
@@ -419,7 +419,6 @@
             count = qry.update(dict(depth=depth + 1), 
synchronize_session=False)
             session.commit()
             depth += 1
-            debugio.debug('crawler.postprocess(): %d links at depth %d' % 
(count, depth))
             # TODO: also handle embeds
         # see if any of the plugins want to do postprocessing
         for plugin in config.PLUGINS:
-- 
To unsubscribe send an email to
webcheck-commits-unsubscribe@lists.arthurdejong.org or see
http://lists.arthurdejong.org/webcheck-commits/