Skip to main content

Scholarly Works - Preprints


Identifying AI Web Scrapers Using Canary Tokens

Preprint · May 13, 2026 From pre-training to query-time augmentation, web-scraped data helps to improve the quality and contextual relevancy of content generated by large language models (LLMs). However, large-scale web scraping to feed LLMs can affect site stability and raise le ... Link to item Cite