I crawled 1,500 sites: 30% block AI bots, 0.2% use llms.txt

(websiteaiscore.com) by aggeeinn | Jan 15, 2026 | 1 comments on HN