setup log on crawler

[JPBeckner]

Setup the log register on the crawler, to assure observability of the crawler process, and register failures for better bug fixes.