Comments on: Publishers to Spend Half Million Dollars on a Robots.txt File http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html Internet Marketing News Fri, 10 Feb 2012 16:37:43 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Abstroose http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html/comment-page-1#comment-30589 Abstroose Wed, 15 Aug 2007 10:17:53 +0000 http://localhost:8888/wp_import/2006/09/publishers-to-spend-half-million-dollars-on-a-robotstxt-file.htm#comment-30589 $500,000?! Wow, I possibly don't see what you could want in a Robots.txt file worth that much? $500,000?! Wow, I possibly don’t see what you could want in a Robots.txt file worth that much?

]]> By: I’m Going to Shoot Myself in the Foot | inter:digital strategies http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html/comment-page-1#comment-1251 I’m Going to Shoot Myself in the Foot | inter:digital strategies Wed, 01 Nov 2006 19:25:33 +0000 http://localhost:8888/wp_import/2006/09/publishers-to-spend-half-million-dollars-on-a-robotstxt-file.htm#comment-1251 [...] Andy Beal describes this as publishers building a new robots.txt file, but I think there’s really a bit more to it. The publishers still see that search engines are a great way to get users to their information. They don’t want their content removed, they simply want more control over how it’s used. [...] [...] Andy Beal describes this as publishers building a new robots.txt file, but I think there’s really a bit more to it. The publishers still see that search engines are a great way to get users to their information. They don’t want their content removed, they simply want more control over how it’s used. [...]

]]> By: Paul Drago http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html/comment-page-1#comment-776 Paul Drago Mon, 25 Sep 2006 04:32:00 +0000 http://localhost:8888/wp_import/2006/09/publishers-to-spend-half-million-dollars-on-a-robotstxt-file.htm#comment-776 I guess the World Newspaper Association can't even ask their own webguys since they haven't bothered with a robots.txt file either. Yet, amazingly our local paper has one. New York Times has one. Hell even the Clarion Ledger in mississippi has one! (though # be nice. isn't a command I am familiar with :) ) I guess the World Newspaper Association can’t even ask their own webguys since they haven’t bothered with a robots.txt file either.
Yet, amazingly our local paper has one. New York Times has one.
Hell even the Clarion Ledger in mississippi has one! (though # be nice. isn’t a command I am familiar with :) )

]]> By: Brian Gilley http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html/comment-page-1#comment-775 Brian Gilley Sun, 24 Sep 2006 21:49:00 +0000 http://localhost:8888/wp_import/2006/09/publishers-to-spend-half-million-dollars-on-a-robotstxt-file.htm#comment-775 I could've hooked them up for about $20 since it only takes a whopping 5 seconds to do. That's ridiculous! I could’ve hooked them up for about $20 since it only takes a whopping 5 seconds to do.

That’s ridiculous!

]]> By: Mike http://www.marketingpilgrim.com/2006/09/publishers-to-spend-half-million.html/comment-page-1#comment-774 Mike Sat, 23 Sep 2006 02:24:00 +0000 http://localhost:8888/wp_import/2006/09/publishers-to-spend-half-million-dollars-on-a-robotstxt-file.htm#comment-774 Wow, someone talked them into that deal? If people want to throw away money I'll take some. Wow, someone talked them into that deal?
If people want to throw away money I’ll take some.

]]>