erin anne
05-02-2008, 01:59 AM
Just curious what that is? I see it under the quick links.
|
View Full Version : Slurp Spider erin anne 05-02-2008, 01:59 AM Just curious what that is? I see it under the quick links. becky 05-02-2008, 02:34 AM Slurp Spiders show up on the "who Online" page when yahoo to crawling the site. They do this daily to update their database. Unless a website has a robots.txt file saying that it does not want to be crawled by search engine the slurp spider will show up in the "who's online" page often. they are a pain but it helps websites show up in search engine and in the end will help more moms find SCM :) now if that doesn't make sense I am not sure this will either LOL http://help.yahoo.com/l/us/yahoo/search/webcrawler/ Oh but i found this on another forum reply who was asking the same question (found it in a google search LOL) "They are the search engine robot thingies that go out looking for where stuff is so they can tell people about where to find it when they put in a search." I hope that helps erin anne 05-02-2008, 02:36 AM Um, yes I think so. Thanks Becky, Sounds very Big Brother. becky 05-02-2008, 02:39 AM glad i can help. I don't know about Big Brother though but i know what you mean. I actually love it when google crawls my sites because my pages get indexed, people can find me in search engines and helps increase my page rank. Yahoo is more of a major PITA though. |