Real Estate Forums

Bama-Homer · 11-02-2006, 12:01 PM

I just went through and redesigned and coded my company website. Before going "live", I did the site:mysite(dot)com at G to see what was cached.

Every page except the homepage was a supplemental result. Since the last version of the site was junk and those pages were deleted, I really wasn't concerned. (I sort of figured they would go away on their own...

)

G just picked up the new version of the homepage on the 28th. I checked my server logs last night and the site is being crawled by the Googlebot.

Does anyone have an idea about the time frame for the new pages to be picked up and cached after being crawled?

Thanks

HHI Golf Guy · 11-02-2006, 01:45 PM

Google's crawling habits have changed alot in the past 6 months. 3 or 4 months ago Matt Cutts posted in his blog about supplemental results, spammy sites, and Googlebot crawl rates. I tried to find that post, but his blog has a ton of pages now and I could not locate that post.

In essence, what he talked about was that if there was some reason that Google did not like something about your web site, the Googlebot would not crawl your site as much or as deep as in the past. So if you tick off Google, it could be a while before they grab all of your pages again.

One way to possibly mitigate this circumstance and speed up the crawling is to sign up for Google sitemaps.

I know from personal experience that it can be very frustrating for Google to re-index all of your pages when you make changes. In my case, it took almost 2 months. But now that the site is back in the good graces of G, the bot hits on a frequent basis.

Bama-Homer · 11-02-2006, 03:38 PM

Thanks for the info!

I did set up Google Sitemaps and it has been verified, downloaded, and visited.

johnc · 11-24-2006, 11:15 PM

I find the Google may regularly your site, even on daily bases. But the catched pages may not show up after a week or so. I guess all you need to do is sit back and watch Google to its job.

hbnathan · 01-05-2007, 06:46 PM

Yes, I think that a good and updated sitemap is essential.
I think that the supplemental results are basically a way Google is telling you that he doesn't care too much about these pages.
It's OK to have 50% of your pages as supplemental results, but if Google indexes 10 pages and the rest of of your 200 pages is listed as supplemental, you might have a problem.

Specialists in Florida Condo , Aventura Condo , Miami Condo