I'm happy that the White House has a robots.txt file.

Jung

???
Premium
14,205
2,465
637
www.whitehouse.gov/robots.txt


Lol, "national security."
 

gumercules

Ultra Mega
993
34
342
i believe it's disallowed for search engine spiders to crawl those directories. but don't quote me on that
 

Jung

???
Premium
14,205
2,465
637
Gumercules is correct. Robots.txt basically tells search engine spiders to fuck off; it tells them which directories to ignore when crawling the site. Obviously though, robots.txt shouldn't be publicly viewable. It's common practice to block access to it via .htaccess. The Whites House's site admins/developers are just in need of some security training.
 

AnthemBoy7

Scene Kid
100
0
0
yeah, it looks like most of those files have been taken down or really don't matter at all. But it's still funny.
 

Jung

???
Premium
14,205
2,465
637
Some of the directories are accesable, at least a few that I tried were. Others look like they're restricted by referer. (which is a good thing.)