Crawlab (Worker)
Crawlab worker node for distributed web crawling. Connects to an existing Crawlab master node via gRPC.
Deploy Crawlab (Worker) on Dokploy
- Install Dokploy on your server if you haven't already.
- In your Dokploy panel, open a project and click Create Service → Template.
- Search for Crawlab (Worker) and click Create — Dokploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInZlcnNpb246IFwiMy44XCJcbnNlcnZpY2VzOlxuICBjcmF3bGFiLXdvcmtlcjpcbiAgICBpbWFnZTogY3Jhd2xhYnRlYW0vY3Jhd2xhYjpsYXRlc3RcbiAgICByZXN0YXJ0OiB1bmxlc3Mtc3RvcHBlZFxuICAgIGVudmlyb25tZW50OlxuICAgICAgLSBDUkFXTEFCX05PREVfTUFTVEVSPU5cbiAgICAgIC0gQ1JBV0xBQl9HUlBDX0FERFJFU1M9JHtNQVNURVJfR1JQQ19BRERSRVNTfVxuICAgICAgLSBDUkFXTEFCX0ZTX0ZJTEVSX1VSTD0ke01BU1RFUl9GSUxFUl9VUkx9XG4gICAgdm9sdW1lczpcbiAgICAgIC0gY3Jhd2xhYi13b3JrZXItZGF0YTovcm9vdC8uY3Jhd2xhYlxuICAgICAgLSBjcmF3bGFiLXdvcmtlci1hcHA6L2RhdGFcbiAgICBkZXBsb3k6XG4gICAgICByZXNvdXJjZXM6XG4gICAgICAgIGxpbWl0czpcbiAgICAgICAgICBjcHVzOiBcIiR7Q1BVX0xJTUlUOi0wLjh9XCIgIyAwLjggd2lsbCBsaW1pdCB0byA4MCUgb2YgQ1BVIGlmIG9uZSBjb3JlLiBJZiAyIGNvcmVzLCB5b3UgbmVlZCB0byBwdXQgMC44KjI9MS42XG5cbnZvbHVtZXM6XG4gIGNyYXdsYWItd29ya2VyLWRhdGE6XG4gIGNyYXdsYWItd29ya2VyLWFwcDoiLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbk1BU1RFUl9HUlBDX0FERFJFU1MgPSBcIjxtYXN0ZXJfbm9kZV9pcD46OTY2NlwiXG5NQVNURVJfRklMRVJfVVJMID0gXCJodHRwOi8vPG1hc3Rlcl9ub2RlX2lwPjo4MDgwL2FwaS9maWxlclwiXG5DUFVfTElNSVQgPSBcIjAuOFwiXG5cbltjb25maWddXG5lbnYgPSBbXCJNQVNURVJfR1JQQ19BRERSRVNTPSR7TUFTVEVSX0dSUENfQUREUkVTU31cIiwgXCJNQVNURVJfRklMRVJfVVJMPSR7TUFTVEVSX0ZJTEVSX1VSTH1cIiwgXCJDUFVfTElNSVQ9JHtDUFVfTElNSVR9XCJdIgp9
Configuration
The exact Docker Compose and template configuration this template deploys.
Related Templates
Crawlab (Master)
Version: latest
Crawlab is a distributed web crawler admin platform supporting multiple programming languages and frameworks. This template deploys the master node with MongoDB.
Crawl4AI
Version: 0.7.3
Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.
Firecrawl
Version: latest
Firecrawl is an API service that takes a URL, crawls it, and converts it into clean markdown or structured data. It can crawl all accessible subpages and provide clean data for each.
Ackee
Version: latest
Ackee is a self-hosted analytics tool for your website.
Affine Pro
Version: stable
Affine Pro is a modern, self-hosted platform designed for collaborative content creation and project management. It offers an intuitive interface, seamless real-time collaboration, and powerful tools for organizing tasks, notes, and ideas.
Akaunting
Version: latest
Akaunting is a self-hosted, open-source accounting app for small businesses.
Self-host Crawlab (Worker) in minutes
Dokploy is a free, open source deployment platform. Deploy Crawlab (Worker) and 499+ other templates on your own infrastructure with a single click.