FRIHOST FORUMS SEARCH FAQ TOS BLOGS COMPETITIONS
You are invited to Log in or Register a free Frihost Account!


Weird Yahoo Slurp behaviour





Jamatu
Yahoo slurp is acting weird whilst Indexing my website. I get two hits from it every couple of hours, one on robots.txt then another straight after on a random page. How come it's doing this? Why doesn't it just index the whole site all in one go?
Scorpio
Interestingly enough, Yahoo slurp indexed my privacy policy page and one other random page.

It did not even touch my index page
manumiglani
I too experienced a lot of problems to get my site indexed by yahoo. Google and msn were listing all pages of my site but yahoo sometimes listed 10, 5, sometimes 6, sometimes 1. So, I think its better to submit a urllist.txt sitemap to yahoo. you can make .txt yahoo sitemap at http://www.xml-sitemaps.com

Kindly let me know the results after you submit your yahoo sitemap to yahoo.
Jamatu
manumiglani wrote:
I too experienced a lot of problems to get my site indexed by yahoo. Google and msn were listing all pages of my site but yahoo sometimes listed 10, 5, sometimes 6, sometimes 1. So, I think its better to submit a urllist.txt sitemap to yahoo. you can make .txt yahoo sitemap at http://www.xml-sitemaps.com

Kindly let me know the results after you submit your yahoo sitemap to yahoo.

I use GSiteCrawler to create sitemaps for my website, anyways I'll be your guinea pig and test Yahoo's sitemap submit for you.

http://pics.uk.to/urllist.txt <-- Yahoo sitemap
http://pics.uk.to/sitemap.xml <--Googles sitemap
manumiglani
Jamatu wrote:
manumiglani wrote:
I too experienced a lot of problems to get my site indexed by yahoo. Google and msn were listing all pages of my site but yahoo sometimes listed 10, 5, sometimes 6, sometimes 1. So, I think its better to submit a urllist.txt sitemap to yahoo. you can make .txt yahoo sitemap at http://www.xml-sitemaps.com

Kindly let me know the results after you submit your yahoo sitemap to yahoo.

I use GSiteCrawler to create sitemaps for my website, anyways I'll be your guinea pig and test Yahoo's sitemap submit for you.

http://pics.uk.to/urllist.txt <-- Yahoo sitemap
http://pics.uk.to/sitemap.xml <--Googles sitemap


Well I am sorry I am not able to understand this post fully. Well, I have heard a lot about gsitecwawler but yet to try it.

Yahoo sitemap looks fine. Have u submitted it ? You need to submit it here http://submit.search.yahoo.com/free/request . You must have a yahoo id to do this.

Do post the outcome after submitting your yahoo sitemap. It currently shows only three pages from your site. I think the no. of your webpages in yahoo will increase after you submit your sitemap to yahoo.
Jamatu
manumiglani wrote:
Well I am sorry I am not able to understand this post fully. Well, I have heard a lot about gsitecwawler but yet to try it.

Yahoo sitemap looks fine. Have u submitted it ? You need to submit it here http://submit.search.yahoo.com/free/request . You must have a yahoo id to do this.

Do post the outcome after submitting your yahoo sitemap. It currently shows only three pages from your site. I think the no. of your webpages in yahoo will increase after you submit your sitemap to yahoo.


I submitted the URL list to yahoo yesterday (30 May 2006) I haven't got a hit yet. I will keep you updated though.

Strangely I got a hit on my google sitemap from MSNBot today Shocked
Jamatu
Done!

About half of my website was indexed by Yahoo Slurp last night over the course of 8 hours.

Edit: It's still crawling, i'm getting about 6 hits an hour from it.
Hobbit
That's quick! What page are you on? I submitted it when the link was posted and I'm on the 9th page if you search for 'Band Of The Week.'
Jamatu
You can only see the first few pages on my website currently, there is a delay between a website getting crawled and the pages showing up in search results.
Related topics
How to prepare a "robots.txt" to get crawled by Se
Statystyki na stronie
how often does spiders crawl your pages
Need Help
TOS Ammendment
Hide Part of Your Web Site from Yahoo!
Google AVIs With MPC (weird behaviour)
Weird Traffic Laws in the United States
weird net
Yahoo developing an audio search engine!
Yahoo takes on iTunes with new music service
Yahoo 360!
Yahoo mail is bester
Why use Gmail?
Reply to topic    Frihost Forum Index -> Webmaster and Internet -> SEO and Search Engines

FRIHOST HOME | FAQ | TOS | ABOUT US | CONTACT US | SITE MAP
© 2005-2011 Frihost, forums powered by phpBB.