webcheck 2.0b fails with non-ASCII HTTP Error messages

[Emmanuel Blot <eblot.ml [at] gmail.com>]

eblot@autagne:~/Sources/Git/arthurdejong.org/webcheck
$> ./run.py http://www.ffplum.com -o report
webcheck: INFO: checking site....
webcheck: INFO: getting robots.txt for http://www.ffplum.com
webcheck: INFO: http://www.ffplum.com/
webcheck: WARNING: tidy library (python-utidylib) is unavailable
....
webcheck: INFO: HTTP Error 404: Ressource non trouvée
Traceback (most recent call last):
  File "./run.py", line 53, in <module>
    main(vars(args))
  File "/Users/eblot/Sources/Git/arthurdejong.org/webcheck/webcheck/cmd.py",
line 131, in main
    crawler.crawl()
  File "/Users/eblot/Sources/Git/arthurdejong.org/webcheck/webcheck/crawler.py",
line 326, in crawl
    session.commit()
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 721, in commit
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 354, in commit
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 334, in _prepare_impl
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 1818, in flush
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 1936, in _flush
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/util/langhelpers.py",
line 58, in __exit__
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/session.py",
line 1900, in _flush
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/unitofwork.py",
line 372, in execute
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/unitofwork.py",
line 525, in execute
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/persistence.py",
line 64, in save_obj
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/orm/persistence.py",
line 569, in _emit_insert_statements
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/base.py",
line 662, in execute
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/base.py",
line 761, in _execute_clauseelement
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/base.py",
line 874, in _execute_context
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/base.py",
line 1024, in _handle_dbapi_exception
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/util/compat.py",
line 196, in raise_from_cause
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/base.py",
line 867, in _execute_context
  File "build/bdist.macosx-10.9-intel/egg/sqlalchemy/engine/default.py",
line 324, in do_execute
sqlalchemy.exc.ProgrammingError: (ProgrammingError) You must not use
8-bit bytestrings unless you use a text_factory that can interpret
8-bit bytestrings (like text_factory = str). It is highly recommended
that you instead just switch your application to Unicode strings.
u'INSERT INTO linkproblems (link_id, message) VALUES (?, ?)' (119,
'HTTP Error 404: Ressource non trouv\xc3\xa9e')

Cheers,
Manu
-- 
To unsubscribe send an email to
webcheck-users-unsubscribe@lists.arthurdejong.org or see
http://lists.arthurdejong.org/webcheck-users/