Crawlab (Master)
Crawlab is a distributed web crawler admin platform supporting multiple programming languages and frameworks. This template deploys the master node with MongoDB.
Deploy Crawlab (Master) on Dokploy
- Install Dokploy on your server if you haven't already.
- In your Dokploy panel, open a project and click Create Service → Template.
- Search for Crawlab (Master) and click Create — Dokploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInZlcnNpb246IFwiMy44XCJcbnNlcnZpY2VzOlxuICBjcmF3bGFiLW1hc3RlcjpcbiAgICBpbWFnZTogY3Jhd2xhYnRlYW0vY3Jhd2xhYjpsYXRlc3RcbiAgICByZXN0YXJ0OiB1bmxlc3Mtc3RvcHBlZFxuICAgIGVudmlyb25tZW50OlxuICAgICAgLSBDUkFXTEFCX05PREVfTUFTVEVSPVlcbiAgICAgIC0gQ1JBV0xBQl9NT05HT19IT1NUPW1vbmdvXG4gICAgICAtIENSQVdMQUJfTU9OR09fUE9SVD0yNzAxN1xuICAgICAgLSBDUkFXTEFCX01PTkdPX0RCPWNyYXdsYWJcbiAgICAgIC0gQ1JBV0xBQl9NT05HT19VU0VSTkFNRT0ke01PTkdPX1VTRVJOQU1FfVxuICAgICAgLSBDUkFXTEFCX01PTkdPX1BBU1NXT1JEPSR7TU9OR09fUEFTU1dPUkR9XG4gICAgICAtIENSQVdMQUJfTU9OR09fQVVUSFNPVVJDRT1hZG1pblxuICAgIHZvbHVtZXM6XG4gICAgICAtIGNyYXdsYWItbWFzdGVyLWRhdGE6L3Jvb3QvLmNyYXdsYWJcbiAgICAgIC0gY3Jhd2xhYi1hcHAtZGF0YTovZGF0YVxuICAgICAgLSBjcmF3bGFiLWxvZ3M6L3Zhci9sb2cvY3Jhd2xhYlxuICAgIGV4cG9zZTpcbiAgICAgIC0gXCI4MDgwXCJcbiAgICAgIC0gXCI5NjY2XCJcbiAgICBkZXBlbmRzX29uOlxuICAgICAgLSBtb25nb1xuICAgIGRlcGxveTpcbiAgICAgIHJlc291cmNlczpcbiAgICAgICAgbGltaXRzOlxuICAgICAgICAgIGNwdXM6IFwiJHtDUFVfTElNSVQ6LTAuOH1cIiAjIDAuOCB3aWxsIGxpbWl0IHRvIDgwJSBvZiBDUFUgaWYgb25lIGNvcmUuIElmIDIgY29yZXMsIHlvdSBuZWVkIHRvIHB1dCAwLjgqMj0xLjZcblxuICBtb25nbzpcbiAgICBpbWFnZTogbW9uZ286NC4yXG4gICAgcmVzdGFydDogdW5sZXNzLXN0b3BwZWRcbiAgICBlbnZpcm9ubWVudDpcbiAgICAgIC0gTU9OR09fSU5JVERCX1JPT1RfVVNFUk5BTUU9JHtNT05HT19VU0VSTkFNRX1cbiAgICAgIC0gTU9OR09fSU5JVERCX1JPT1RfUEFTU1dPUkQ9JHtNT05HT19QQVNTV09SRH1cbiAgICB2b2x1bWVzOlxuICAgICAgLSBtb25nby1kYXRhOi9kYXRhL2RiXG5cbnZvbHVtZXM6XG4gIGNyYXdsYWItbWFzdGVyLWRhdGE6XG4gIGNyYXdsYWItYXBwLWRhdGE6XG4gIGNyYXdsYWItbG9nczpcbiAgbW9uZ28tZGF0YToiLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbk1PTkdPX1VTRVJOQU1FID0gXCJjcmF3bGFiXCJcbk1PTkdPX1BBU1NXT1JEID0gXCIke3Bhc3N3b3JkOjI0fVwiXG5DUFVfTElNSVQgPSBcIjAuOFwiXG5cbltjb25maWddXG5lbnYgPSBbXCJNT05HT19VU0VSTkFNRT0ke01PTkdPX1VTRVJOQU1FfVwiLCBcIk1PTkdPX1BBU1NXT1JEPSR7TU9OR09fUEFTU1dPUkR9XCIsIFwiQ1BVX0xJTUlUPSR7Q1BVX0xJTUlUfVwiXVxuXG5bW2NvbmZpZy5kb21haW5zXV1cbnNlcnZpY2VOYW1lID0gXCJjcmF3bGFiLW1hc3RlclwiXG5wb3J0ID0gODA4MFxuaG9zdCA9IFwiJHtkb21haW59XCIiCn0=
Configuration
The exact Docker Compose and template configuration this template deploys.
Related Templates
Crawlab (Worker)
Version: latest
Crawlab worker node for distributed web crawling. Connects to an existing Crawlab master node via gRPC.
Crawl4AI
Version: 0.7.3
Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.
Firecrawl
Version: latest
Firecrawl is an API service that takes a URL, crawls it, and converts it into clean markdown or structured data. It can crawl all accessible subpages and provide clean data for each.
Ackee
Version: latest
Ackee is a self-hosted analytics tool for your website.
Affine Pro
Version: stable
Affine Pro is a modern, self-hosted platform designed for collaborative content creation and project management. It offers an intuitive interface, seamless real-time collaboration, and powerful tools for organizing tasks, notes, and ideas.
Akaunting
Version: latest
Akaunting is a self-hosted, open-source accounting app for small businesses.
Self-host Crawlab (Master) in minutes
Dokploy is a free, open source deployment platform. Deploy Crawlab (Master) and 499+ other templates on your own infrastructure with a single click.