Introduction

As developers, you might be interested in how Crawlab works. This section will introduce the fundamentals and basic technologies behind it.

This section is consisted of the topics.

• Architecture
• Node
  • Master Node
  • Worker Node
  • Node Communication
• Database
  • MongoDB
• File System
  • SeaweedFS