Skip to content

Allow crawlers to read robots.txt when indexing is disabled - #613

Open
dajiaohuang wants to merge 1 commit into
redlib-org:mainfrom
dajiaohuang:fix/robots-txt-crawler-access
Open

dajiaohuang wants to merge 1 commit into
redlib-org:mainfrom
dajiaohuang:fix/robots-txt-crawler-access

Commits

  1. Commits on Nov 6, 2026