Changelog# 1.9.0 (2024-03-10)# Features (2 changes)# ignore robots.txt file when it redirects in a loop (merge request) CLI command to mass delete documents (merge request) Bug fixes (3 changes)# fixes for long upgrade time and slow crawler startup (merge request) prevent user creation of Domain settings (merge request) fix browser mode detection (merge request) 1.8.2 (2024-01-23)# Bug fixes (2 changes)# fix thumbnails deletion when deleting a document (merge request) pin working Selenium version (merge request) 1.8.1 (2024-01-14)# Bug fixes (2 changes)# fix skipping pages with mimetype to be skipped (merge request) work-around to libmagic misidentifying some HTML page as application/javascript (merge request) 1.8.0 (2024-01-10)# Features (4 changes)# HTML pages download with Requests (merge request) online status detection to optionally search locally when offline (merge request) improve page changes detection (merge request) add a “starts with” option to excluded urls (merge request) Bug fixes (1 change)# avoid recrawling documents after a redirect (merge request) 1.7.0 (2023-11-10)# Features (4 changes)# navigation improvements (merge request) display the search bar in cached pages (merge request) set in the Crawl policy when to remove navigation related elements (merge request) save dynamic CSS in HTML snapshots (merge request) Bug fixes (4 changes)# fix font size on Chrome (merge request) fix downloading css assets containings special characters (merge request) avoid an infinite loops in particular conditions when a page is self-referencing (merge request) avoid timing issues during authentication (merge request) 1.6.0 (2023-10-14)# Features (2 changes)# crawler Firefox 🦊 support (merge request) Atom and RSS feeds parsing (merge request) 1.5.0 (2023-08-29)# Bug fixes (5 changes)# remove html comments from documents (merge request) handle invalid links correctly (merge request) fix result heights when thumbnail is enabled (merge request) fix an exception on links with unknown schemes (merge request) fix handling element in html snapshots (merge request) 1.4.0 (2023-08-24)# Features (1 change)# create pages thumbnails (merge request) Bug fixes (2 changes)# add missing noreferrer flag to the unknown url page (merge request) avoid a race condition in HTML assets handling (merge request) 1.3.2 (2023-08-22)# Bug fixes (2 changes)# fix handling some malformed urls fix the docker build 1.3.1 (2023-08-21)# Bug fixes (1 change)# fix running with debug disabled (merge request) 1.3.0 (2023-08-21)# Features (4 changes)# no referrer and open in new tab options for external links (merge request) HTML content snapshot (merge request) foldable header in screenshots view (merge request) Document admin page improvement (merge request) Bug fixes (3 changes)# update extern links if the target is indexed again afterward (merge request) fix sameSite cookie option formatting force screenshot refresh when they changed (merge request) 1.2.0 (2023-07-14)# Features (2 changes)# crawling status improvements (merge request) navigation elements removal (merge request) Bug fixes (1 change)# fix screenshots resize (merge request) 1.1.2 (2023-06-30)# Bug fixes (1 change)# fix database configuration documentation 1.1.1 (2023-06-29)# Bug fixes (1 change)# misc Bookworm, Docker and Selenium fixes (merge request) 1.1.0 (2023-06-18)# Features (3 changes)# Debian Bookworm support (merge request) browsable archive on homepage view (merge request) automatically follow redirection in cached pages (merge request) Bug fixes (2 changes)# fix resolving links when the header has a tag (merge request) scroll all elements when taking screenshots (merge request) 1.0.1 (2023-05-01)# Features (1 change)# doc improvements Bug fixes (1 change)# build the Docker release using pypi packages