Deploy spider

Crawlab deploys spiders automatically. The master node synchronizes the spider files on this node to all online nodes every 60 seconds. Therefore, after the user uploads the spider, it only needs to wait up to 60 seconds to run the spider task on all nodes.

Please refer to principles - Chapter of spider deployment for the principles of spider deployment and synchronization.

© 2020 Crawlab, Made by Crawlab-Team all right reserved,powered by Gitbook该文件最后修改时间: 2020-05-21 10:30:12

results matching ""

    No results matching ""

    results matching ""

      No results matching ""