plugin-spider-assistant

plugin-spider-assistant

plugin-spider-assistantopen in new window is a Crawlab plugin that provides assistance in spider management. It allows users to view and manage items in spider frameworks.

Spider Frameworks

NameLanguageViewManage
Scrapyopen in new windowPython✅❌
Collyopen in new windowGo❌❌
WebMagicopen in new windowJava❌❌
DotnetSpideropen in new windowC#❌❌

How to use

  1. Navigate to spider detail page.
  2. Click Assistant tab.
  3. You are now able to view info of detected spider framework.