Google Blogoscoped

Forum

Omgili, Discussion Forum Search  (View post)

Brian M. [PersonRank 10]

Monday, January 9, 2006
18 years ago

They are doing some custom scraping. I know this because the SDMB (site:boards.straightdope.com) has blocked spiders, yet they have it indexed.

/pd [PersonRank 10]

18 years ago #

its does not accept url's as a search term and parsed out the periods within a url to concat seperate search word(s).

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!