The Disallowed directories from the robots.txt files of the world's top websitesgithub.com/danielmiessler2 pointsgkop10 years ago