Tag Archives: Web Crawlers

September 6, 2026

Sep 2026

RSS Amplifier Re-Publishes 19 Full NLJ Articles Without Permission

A PSA about a new scraping service for AI crawlers that syndicated (charitably) or re-published (less charitably) 19 New Leaf Journal articles without permission, before I identified the issue.

December 4, 2025

Dec 2025

Adding Ads.txt to Website Without Ads

Nicholas A. Ferrell

Demonstrating how to add a properly formatted ads.txt file to an ad-free website.

December 1, 2025

Dec 2025

Adding a carbon.txt File

Nicholas A. Ferrell

On adding a carbon.txt file to The New Leaf Journal after learning about it from our server logs.

August 28, 2025

Aug 2025

Thinkbot Visits The New Leaf Journal

Nicholas A. Ferrell

My site is crawled regularly by a bot called Thinkbot. Thanks to Hacker News, I learned that I am not the only one with this “problem.”