Comments on: Does the Federal Government Hate Search Engines? http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html Internet Marketing News Sun, 21 Mar 2010 01:14:13 -0400 http://wordpress.org/?v=2.9.1 hourly 1 By: businesses grants http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-64510 businesses grants Tue, 30 Dec 2008 04:56:52 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-64510 Yes, that a good part from our u.s government. It is even difficult to get a government grant easily. Thanks for the mention and helping out people who need to apply for grants. Yes, that a good part from our u.s government. It is even difficult to get a government grant easily. Thanks for the mention and helping out people who need to apply for grants.

]]> By: mark http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-60444 mark Fri, 21 Nov 2008 01:50:05 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-60444 the robot.txt do not provide any such security for any private or classified documents. the robot.txt only instructs the web crawler not to crawl all or part of a website. and not all search engines follow the robot.txt instructions. now the real rule of thumb here is if you want to hide a file, keep that file off of any networked computer or server. <em>mark's last blog post..<a href='http://www.gitrweb.com/blogging/blogcatalogcom' rel="nofollow">blogcatalog.com</a></em> the robot.txt do not provide any such security for any private or classified documents.
the robot.txt only instructs the web crawler not to crawl all or part of a website.
and not all search engines follow the robot.txt instructions.
now the real rule of thumb here is if you want to hide a file, keep that file off
of any networked computer or server.

mark’s last blog post..blogcatalog.com

]]> By: Omad http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-31177 Omad Mon, 27 Aug 2007 18:17:28 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-31177 Conspiracy,.....wait I don't know, as suspiciouse as it looks, why would they not want to be so easily found. besides, they should know by now that the more suspiciouse it looks - the more people want to look. Conspiracy,…..wait
I don’t know, as suspiciouse as it looks, why would they not want to be so easily found. besides, they should know by now that the more suspiciouse it looks – the more people want to look.

]]> By: Michael Martinez http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-31176 Michael Martinez Mon, 27 Aug 2007 18:16:19 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-31176 As I pointed out to Matt Cutts last week, there are Federal sites (and educational and NGO sites) that disavow any endorsement of sites they link out to. Google nonetheless treats all their outbound links as endorsements. I would say the government has good reason not to trust search engines since they don't follow direction very well. As I pointed out to Matt Cutts last week, there are Federal sites (and educational and NGO sites) that disavow any endorsement of sites they link out to.

Google nonetheless treats all their outbound links as endorsements.

I would say the government has good reason not to trust search engines since they don’t follow direction very well.

]]> By: Alopecia http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-31145 Alopecia Mon, 27 Aug 2007 08:53:16 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-31145 I guess it's right to use robot.txt for the government site. They must be having a lot of data which should be kept confidential, to maintain proper law and order. I guess it’s right to use robot.txt for the government site. They must be having a lot of data which should be kept confidential, to maintain proper law and order.

]]> By: Steven Bradley http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html/comment-page-1#comment-31142 Steven Bradley Mon, 27 Aug 2007 06:58:50 +0000 http://www.marketingpilgrim.com/2007/08/does-the-federal-government-hate-search-engines.html#comment-31142 "I’m fairly certain that the ODNI is smart enough to know that robots.txt isn’t a security mechanism." I'm not as certain as you are. You would like to think they're smart enough and I'm sure they are, but it's quite possible the person who put up the robots.txt file isn't and did think they were hiding the content. “I’m fairly certain that the ODNI is smart enough to know that robots.txt isn’t a security mechanism.”

I’m not as certain as you are. You would like to think they’re smart enough and I’m sure they are, but it’s quite possible the person who put up the robots.txt file isn’t and did think they were hiding the content.

]]>