plugin-spider-assistantopen in new window is a Crawlab plugin that provides assistance in spider management. It allows users to view and manage items in spider frameworks.

Spider Frameworks

Scrapyopen in new windowPython
Collyopen in new windowGo
WebMagicopen in new windowJava
DotnetSpideropen in new windowC#

How to use

  1. Navigate to spider detail page.
  2. Click Assistant tab.
  3. You are now able to view info of detected spider framework.