Google not indexing our site

[cubabit]

Hi,

We have developed a site for a customer and we are having trouble getting Google to index it. It only seems to index the home page. The site is:

http://www.rentdisplayboards.co.uk/

Now, some of you may say that perhaps the site hasn't been indexed yet. Well, it has - many times looking at the access logs of the site. Just the home page and the site map appear to get spidered though. The site has been live for months now.

If I go to Google and search: allinurl:www.rentdisplayboards.co.uk then only the homepage comes up.

The second thing you may suggest is that the site is not linked. It is, from these two sites at least:

http://www.pep.ltd.uk/
http://www.popcornwebdesign.co.uk/

However, site:www.rentdisplayboards.co.uk sees no links. Odd!

And finally, yes, the site is spiderable. I entered the URI into this facility:

http://www.webconfs.com/search-engin...-simulator.php

and it came up with 10 distinct pages.

Does anyone have any experience of this and what may be causing it? I think Google is actually choosing not to spider the site though don't know why.

[ernestrome]

No robots.txt file being used?

[cubabit]

Nope. In fact, this is the excerpt from the access log of Google bot's visit this month:

66.249.66.43 - - [01/Nov/2006:12:20:38 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.43 - - [01/Nov/2006:12:20:38 +0000] "HEAD / HTTP/1.1" 200 0 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.43 - - [01/Nov/2006:12:20:39 +0000] "HEAD / HTTP/1.1" 200 0 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [03/Nov/2006:21:50:26 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [03/Nov/2006:21:50:26 +0000] "GET / HTTP/1.1" 200 10902 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [04/Nov/2006:04:41:55 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [04/Nov/2006:04:41:55 +0000] "GET /sitemap.shtml HTTP/1.1" 200 8371 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [06/Nov/2006:20:20:03 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [06/Nov/2006:20:20:03 +0000] "GET / HTTP/1.1" 200 10946 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [07/Nov/2006:21:42:38 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [07/Nov/2006:21:42:38 +0000] "GET /script/pep.js HTTP/1.1" 200 640 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [07/Nov/2006:23:42:15 +0000] "GET /script/pep.js HTTP/1.1" 200 640 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [08/Nov/2006:16:26:27 +0000] "GET /robots.txt HTTP/1.1" 404 300 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.166 - - [08/Nov/2006:16:26:27 +0000] "GET / HTTP/1.1" 200 11019 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Note the 404 on the robots.txt - definitely not there.