of Robots.txt in Aruba. Last updated 14th Nov 2024.
Google AdsBot Disallow is currently the most popular technology in this category.