Comments on: Google is Cracking the “Invisible Web” http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html Internet Marketing News Fri, 10 Feb 2012 17:00:40 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: 9tlwyg http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-53301 9tlwyg Fri, 01 Aug 2008 12:17:06 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-53301 I think, now the big question is, where Googlebot getting its search queries? Google press says it is getting it from "the site". If search queries are stored on the site (via Google Analytics or whatever), then it's a big privacy violation. And I don't see a point of Google expanding its index as we have too many already. I think, now the big question is, where Googlebot getting its search queries? Google press says it is getting it from “the site”. If search queries are stored on the site (via Google Analytics or whatever), then it’s a big privacy violation.

And I don’t see a point of Google expanding its index as we have too many already.

]]> By: Web Marketing Man http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45452 Web Marketing Man Tue, 15 Apr 2008 13:04:43 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45452 This should prove to be helpful, especially if webmasters use robots.txt to block the googlebots where they aren't supposed to go. The more information being made available in the returned results the better experience for the end-user will be at the end of the day. This should prove to be helpful, especially if webmasters use robots.txt to block the googlebots where they aren’t supposed to go. The more information being made available in the returned results the better experience for the end-user will be at the end of the day.

]]> By: Steven Bradley http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45395 Steven Bradley Mon, 14 Apr 2008 18:37:41 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45395 Like most things this comes with both pros and cons. I think more pros, which is good, but we will have to pay a little more attention to preventing thank you pages from being indexed. There could also be duplicate content issues too depending on your forms. Overall though, this is good news. Like most things this comes with both pros and cons. I think more pros, which is good, but we will have to pay a little more attention to preventing thank you pages from being indexed. There could also be duplicate content issues too depending on your forms.

Overall though, this is good news.

]]> By: Seomotion http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45375 Seomotion Mon, 14 Apr 2008 15:23:00 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45375 It is good idea. But I am afraid of server bandwidth It is good idea. But I am afraid of server bandwidth

]]> By: Seologia http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45366 Seologia Mon, 14 Apr 2008 13:44:17 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45366 Is there a list of the sites they're experimenting on? Is there a list of the sites they’re experimenting on?

]]> By: Futon-Matt http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45363 Futon-Matt Mon, 14 Apr 2008 12:24:46 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45363 I like that idea, though I only have one form on my site. I like that idea, though I only have one form on my site.

]]> By: Wayne Smallman http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45361 Wayne Smallman Mon, 14 Apr 2008 11:20:26 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45361 Hi Andy, I appreciate what you're saying, and that less reputable people may have been using these techniques. But what these guys never had was Google's scale and reach... Hi Andy, I appreciate what you’re saying, and that less reputable people may have been using these techniques.

But what these guys never had was Google’s scale and reach…

]]> By: andymurd http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45360 andymurd Mon, 14 Apr 2008 11:05:28 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45360 @Wayne Smallman - Google's blog post stated that they only fill in forms that use the HTTP method "GET". That's a pretty small number and usually used for search or drop down menus. If a form results in entries going into a database, it should use "POST" instead of "GET" because the browser can legitimately cache the results of "GET" requests. I think Google are doing the right thing here and blackhats have probably been using this technique for years (whilst ignoring robots.txt etc). @Wayne Smallman – Google’s blog post stated that they only fill in forms that use the HTTP method “GET”. That’s a pretty small number and usually used for search or drop down menus.

If a form results in entries going into a database, it should use “POST” instead of “GET” because the browser can legitimately cache the results of “GET” requests.

I think Google are doing the right thing here and blackhats have probably been using this technique for years (whilst ignoring robots.txt etc).

]]> By: Elections guy http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45359 Elections guy Mon, 14 Apr 2008 10:47:12 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45359 Looks like we got new black-hat SEO tools. Looks like we got new black-hat SEO tools.

]]> By: » Search Engines Filling In Forms - Scotland SEO Blog http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45354 » Search Engines Filling In Forms - Scotland SEO Blog Mon, 14 Apr 2008 04:03:47 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45354 [...] Beal from Marketing Pilgrim points out in his article, Google is Cracking the “Invisible Web”: This is exciting for many webmasters as it means the information that you may be creating [...] [...] Beal from Marketing Pilgrim points out in his article, Google is Cracking the “Invisible Web”: This is exciting for many webmasters as it means the information that you may be creating [...]

]]> By: Piper http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45353 Piper Mon, 14 Apr 2008 03:28:19 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45353 I wonder if this will lead to duplicate content issues for people, depending on the nature of the forms and the content that becomes available by going through the forms. I'd definitely like to hear more about how this works. I wonder if this will lead to duplicate content issues for people, depending on the nature of the forms and the content that becomes available by going through the forms. I’d definitely like to hear more about how this works.

]]> By: Steve Teal http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45345 Steve Teal Mon, 14 Apr 2008 01:53:34 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45345 For as long as we can stop the bots from spidering with the robots.txt i am sure we have nothing to worry about. Steve For as long as we can stop the bots from spidering with the robots.txt i am sure we have nothing to worry about.

Steve

]]> By: Google passa a descobrir links em formulários | Lucrando na Rede http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45326 Google passa a descobrir links em formulários | Lucrando na Rede Sun, 13 Apr 2008 16:31:09 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45326 [...] Google is Cracking the “Invisible Web” [via Zemanta] [...] [...] Google is Cracking the “Invisible Web” [via Zemanta] [...]

]]> By: guruassassin http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45323 guruassassin Sun, 13 Apr 2008 15:55:38 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45323 do not forget guys google rule it all !!! do not forget guys
google rule it all !!!

]]> By: Jaan Kanellis http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45322 Jaan Kanellis Sun, 13 Apr 2008 15:53:09 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45322 So the obvious question is we can stop Googlebot from doing this. Sort of a nofollow for forms. So the obvious question is we can stop Googlebot from doing this. Sort of a nofollow for forms.

]]> By: Wayne Smallman http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45317 Wayne Smallman Sun, 13 Apr 2008 13:48:29 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45317 This is an astonishingly bad idea by Google. My clients use their forms to harvest data from their customers before offering them information that is in some cases, commercial sensitive. Yes, anyone could just fill out a form and share this data, but that really doesn't happen. The value is in the data. If that data is there for all to see, what edge does any company have, and how do they engage their prospective consumers? The problem is, too few people are aware of the robot.txt file, so the negatives massively out-weigh the benefits. The dialogue is effectively killed... This is an astonishingly bad idea by Google.

My clients use their forms to harvest data from their customers before offering them information that is in some cases, commercial sensitive.

Yes, anyone could just fill out a form and share this data, but that really doesn’t happen. The value is in the data.

If that data is there for all to see, what edge does any company have, and how do they engage their prospective consumers?

The problem is, too few people are aware of the robot.txt file, so the negatives massively out-weigh the benefits.

The dialogue is effectively killed…

]]> By: Sasha T. http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45314 Sasha T. Sun, 13 Apr 2008 09:46:40 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45314 I'm not really that excited about this news, maybe because I don't have forms on my blog. I guess it will help some websites but more likely people will block G spider. Sasha T. I’m not really that excited about this news, maybe because I don’t have forms on my blog. I guess it will help some websites but more likely people will block G spider.

Sasha T.

]]> By: Google to reveal the Deep Invisible web http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45313 Google to reveal the Deep Invisible web Sun, 13 Apr 2008 09:40:44 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45313 [...] The search engine is filling out forms on a “small number of particularly useful sites” in order to bring forth the content that is populated by these forms and index these results….MORE…. [...] [...] The search engine is filling out forms on a “small number of particularly useful sites” in order to bring forth the content that is populated by these forms and index these results….MORE…. [...]

]]> By: Barbara Ling (aka Owlbert) http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45312 Barbara Ling (aka Owlbert) Sun, 13 Apr 2008 09:07:55 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45312 Wow, I've been teaching about the Invisible web now since, hmmm....1998? Almost a decade now...it's great that Google is starting to index content of that nature. Resource Shelf is a useful tool for that aspect of the Internet as well. Enjoy, Barbara Wow, I’ve been teaching about the Invisible web now since, hmmm….1998? Almost a decade now…it’s great that Google is starting to index content of that nature. Resource Shelf is a useful tool for that aspect of the Internet as well.

Enjoy,

Barbara

]]> By: PS3 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html/comment-page-1#comment-45307 PS3 Sun, 13 Apr 2008 00:22:08 +0000 http://www.marketingpilgrim.com/2008/04/google-is-cracking-the-invisible-web.html#comment-45307 That's quite a radical turnaround, Google seem to be having a bit of a shake up. I don't currently use forms but may have to start! That’s quite a radical turnaround, Google seem to be having a bit of a shake up. I don’t currently use forms but may have to start!

]]>