By now you should know that, anything you post online, to the public, is fair-game for Google’s crawler. But a recent incident involving the indexing of social security numbers and test scores for 619 students at public schools in Catawba County, N.C., shows there is still a grey area when it comes to password protected info.
While Google eventually took down the information – and claims it can’t crawl secure data – it once again raises the issue of where the burden should lie.
Should a webmaster be held responsible for knowing all of the procedures necessary to prevent Google from spidering, or should the burden be on Google.
It’s a tough call, but I can’t help thinking that the Internet existed before Google, therefore the onus should be on Google to NOT crawl secure content – even if it finds a loophole. Of course, for Google to accept responsibility would mean a huge drain on the company’s resources, so it would rather we all appease it, rather than the other way round.