Administration

Contents:

• Administration interface
• 🌐 Crawl a new URL
• ✔ Crawl queue
• 🕷 Crawlers
• 📊 Analytics
• ⚡ Collections
  • ⚡ Crawl tab
  • 🌍 Browser tab
  • 🔖 Archive tab
  • 🕑 Recurrence tab
  • 🔒 Authentication tab
  • Actions
• Atom and RSS feeds
  • Caching for news aggregators
• 🔤 Documents
  • Document detailed view
  • Document list view
• ⭐ Tags
• 🕸 Domains
  • Browse mode
  • Ignore robots.txt
  • Robots.txt status
  • Robots.txt allow/disallow rules
• 🍪 Cookies
  • Cookies import
• 📡 Webhooks
  • Webhook Configuration
  • Example: Discord Notification Webhook
• 🧩 Mime Plugins
  • Mime plugin detailed view
• 🔗 Excluded URLs
• 🔍 External Search Engines
• 👥 Permissions
  • Crawl Permissions
  • Search Permissions