Announcement

Collapse
No announcement yet.

Question

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Question

    what is Yahoo & MSN Slurp Spider's????
    "Copykat Chat Forums" on Facebook, look it up!


    E-Foo

  • #2
    Re: Question

    If found this.... ?????? From http://help.yahoo.com/l/us/yahoo/search/webcrawler/

    Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! Search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

    As part of the crawling effort, the Yahoo! Slurp crawler takes robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search. If a page is disallowed to be crawled by robots.txt standards, Yahoo! does not read or use the contents of that page.

    Note: The URL of a disallowed page may be included in Yahoo! Search as a "thin" document with no text content. Links and reference text from other public web pages may provide identifiable information about a URL and may be indexed as part of web search coverage.
    The average woman would rather have beauty than brains, because the average man can see better than he can think.

    Comment


    • #3
      Re: Question

      I have yahoo email and I've never heard of Slurp Spiders. Ya learn somethin new every day.
      Every new beginning comes from some other beginning's end.

      Comment

      Working...
      X