Support Forums

My Website & Google Webmaster Tools

This is a discussion on My Website & Google Webmaster Tools within the Templates, HTML, CSS, and Design Help forums, part of the General category; I've read previous posts on this subject and I'm not sure if my situation quite fits in the same square, ...


Go Back   68 Classifieds Forums > General > Templates, HTML, CSS, and Design Help

Reply
 
Thread Tools Display Modes
Old 12-03-2008, 09:19 PM   #1
Member
 
HorseOptions's Avatar
 
Join Date: Dec 2008
Posts: 79
Rep Power: 14
HorseOptions is on a distinguished road
Default My Website & Google Webmaster Tools

I've read previous posts on this subject and I'm not sure if my situation quite fits in the same square, so I thought I'd ask again in my own words. Sorry to be repetative......

I've created a google webmaster tools account. I've verified my site, added a sitemap successfully, the home page has been crawled successfully and the index status is good, google analytics is good, but google still says that it's having trouble crawling the following page - http://www.horseoptions.com/userlogin.php - why?

I'm also not too keen on the 80+ (out of 87 total) useless keywords GoogleBot has drummed up. The keywords we've entered into the admin area of 68Classifieds - do we need to have those keywords in the text somewhere on the home page or do we embed them in code somewhere? If so, where? And doesn't the sitemap provide enough info for Google to crawl my site accurately?

Just curious.

Thanks for your time
__________________
Rob Shurtleff - Marketing
Lin Shurtleff - Webmaster
www.HorseOptions.com
Hosted Edition V4.0.9
HorseOptions is offline   Reply With Quote
Old 12-03-2008, 09:41 PM   #2
curmudgeon
 
Join Date: Mar 2006
Posts: 5,416
Rep Power: 139
Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light
Default

Quote:
Originally Posted by HorseOptions
but google still says that it's having trouble crawling the following page - http://www.horseoptions.com/userlogin.php - why?
have you tried going to the link you posted? I get a 404 page not found error. The file you see when you login ins login.php
__________________
Larry

Knowledge learned is more valuable than knowledge given.
Lhotch is offline   Reply With Quote
Old 12-03-2008, 10:17 PM   #3
Member
 
HorseOptions's Avatar
 
Join Date: Dec 2008
Posts: 79
Rep Power: 14
HorseOptions is on a distinguished road
Default RE

Quote:
Originally Posted by Lhotch
have you tried going to the link you posted? I get a 404 page not found error. The file you see when you login ins login.php
Larry,

Exactly. Do you know why? Any thoughts on the keywords?

Rob
__________________
Rob Shurtleff - Marketing
Lin Shurtleff - Webmaster
www.HorseOptions.com
Hosted Edition V4.0.9
HorseOptions is offline   Reply With Quote
Old 12-04-2008, 10:39 AM   #4
Customer
 
Join Date: Jan 2007
Posts: 125
Rep Power: 23
HotAir is on a distinguished road
Default

Hi Rob,
You have a link somewhere pointing to that non-existant page. Googlebot is following the links throughout your site and is being sent to that page even though it isn't really there.

When you are loggingged in to your Google Webmaster Tools account, go to Dashboard -> Diagnostics -> Web crawl. Click the "Not found" link. On that page you'll see a column titled "Linked from". Click the entry under that column heading to find out where the errant link is and fix it if it is on your site. It's possible the link is from an outside site you can't control (I have a bunch of these) - in which case you might want to create a useful 404 error page that helps people find what they are looking for on your site.

Regards,
Jim
__________________
V4.2.3 Developer - live
HotAir is offline   Reply With Quote
Old 12-04-2008, 11:17 AM   #5
Member
 
HorseOptions's Avatar
 
Join Date: Dec 2008
Posts: 79
Rep Power: 14
HorseOptions is on a distinguished road
Default RE:

I clicked on each of the 4 links and could still get to the login page. So not sure what to do there.

Any thoughts on my question about keywords? How to get my site to showup with the keywords and increase it's rank in google?
__________________
Rob Shurtleff - Marketing
Lin Shurtleff - Webmaster
www.HorseOptions.com
Hosted Edition V4.0.9
HorseOptions is offline   Reply With Quote
Old 09-17-2009, 12:04 AM   #6
Junior Member
 
Join Date: Jul 2009
Posts: 15
Rep Power: 10
nashford is on a distinguished road
Default Webmaster Tools (google)

I see it crawls but produces errors like this?

1089 Invalid URL
This is not a valid URL. Please correct it and resubmit. URL: http://listing/27/.htmlParent tag: url
Tag: loc
Problem detected on: Sep 16, 2009

Also what should be in the robots.txt file on my site?

sitemap: 404 - Not Found

What would cause this???
nashford is offline   Reply With Quote
Old 09-17-2009, 05:59 AM   #7
All Hands On Deck
 
 
Join Date: Mar 2008
Posts: 3,433
Rep Power: 87
seymourjames is a jewel in the rough
Default

There is no page called userlogin.php . Search your site files to where this link exists and delete it. Google will take care of the rest over time. You can also exclude it from being indexed using a robots.txt file. In fact you should have this file to stop google indexing several pointless pages where there is zero or useless content .
__________________
"The fool doth think he is wise, but the wise man knows himself to be a fool.".

TemplateCodes.com for 68C, Version 4 Templates & Modules
seymourjames is offline   Reply With Quote
Old 09-17-2009, 06:23 AM   #8
Junior Member
 
Join Date: May 2009
Location: Dublin, Ireland
Posts: 22
Rep Power: 11
tidy is on a distinguished road
Default

Hi HorseOptions,

A great tool for identifying where broken links on your site are is Xenu's Link Sleuth.
You can find out more and download it at Find broken links on your site with Xenu's Link Sleuth (TM)

As James has said, once you know where the broken links are, you can fix them and then Google will stop trying to crawl them. Also check that you don't have any broken links in your Google sitemap file (sitemap.xml) if you are using one.
__________________
Janine
Tidy.ie freelance web developers
68 Classifieds Version: 4.1.6 Developer with custom template
tidy is offline   Reply With Quote
Old 09-17-2009, 10:21 AM   #9
Junior Member
 
Join Date: Jul 2009
Posts: 15
Rep Power: 10
nashford is on a distinguished road
Default Ref: My Issue

This is what confuses me....

The sitemap generates this: (i replace my domain name in this posting before someone says that cant be accessed)

- <url>
<loc>http://www.mysite.com/listing/27/APPLE_IPOD_30_GB.html</loc>
<lastmod>2009-09-17</lastmod>
<changefreq>monthly</changefreq>
<priority>0.2</priority>
</url>

and google gives me this error and accordingly wont submit the sitemap. The issue is not with categories, only with listings. The listings are the issues.

1089 Invalid URL
This is not a valid URL. Please correct it and resubmit. URL: http://listing/27/.htmlParent tag: url
Tag: loc
Problem detected on: Sep 17, 2009

How did google truncuate this or otherwise. Is the module at fault or is google and either way how do i fix this?!? I need my listings to appear obviously.
nashford is offline   Reply With Quote
Old 09-17-2009, 10:54 AM   #10
All Hands On Deck
 
 
Join Date: Mar 2008
Posts: 3,433
Rep Power: 87
seymourjames is a jewel in the rough
Default

Don't know. Our site map module does not do this. Interesting if you find out.
__________________
"The fool doth think he is wise, but the wise man knows himself to be a fool.".

TemplateCodes.com for 68C, Version 4 Templates & Modules
seymourjames is offline   Reply With Quote
Reply

Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Free Useful Web Tools jj30 Technical Support 3 10-02-2008 03:39 AM
Free SEO TOOLS anna245 Site Marketing 1 07-23-2008 10:09 AM
Where do I find the tools mentioned in the tutorial? Kateedyd Templates, HTML, CSS, and Design Help 11 05-31-2006 05:36 AM


All times are GMT -4. The time now is 04:44 AM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2011, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.2.0