Support Forums

Robots.txt Question - Hide viewmember.php?

This is a discussion on Robots.txt Question - Hide viewmember.php? within the Site Marketing forums, part of the General category; I have noticed an issued where Google is spidering my viewmember.php and indexing my clients with their phone numbers. This ...


Go Back   68 Classifieds Forums > General > Site Marketing

Reply
 
Thread Tools Display Modes
Old 11-12-2006, 09:19 AM   #1
Senior Member
 
bgordon's Avatar
 
Join Date: Aug 2006
Location: Georgian Bay, Ontario Canada
Posts: 170
Rep Power: 24
bgordon is on a distinguished road
Default Robots.txt Question - Hide viewmember.php?

I have noticed an issued where Google is spidering my viewmember.php and indexing my clients with their phone numbers. This is not a desired action. I have a line in my robots.txt disallowing /viewmember.php but it does not stop recursion so /viewmember.php?member=whatever still gets indexed.

Any ideas how to stop this?

I support an statement like if the current user is a guest, don't show any phone fields might fix it (don't know the syntax) but there might be another way in the robots.txt.

Any ideas?
__________________
B. Gordon
v.4.0.9 Developer
bgordon is offline   Reply With Quote
Old 11-12-2006, 11:11 AM   #2
curmudgeon
 
Join Date: Mar 2006
Posts: 5,413
Rep Power: 138
Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light
Default

Quote:
Originally Posted by bgordon
I have noticed an issued where Google is spidering my viewmember.php and indexing my clients with their phone numbers. This is not a desired action. I have a line in my robots.txt disallowing /viewmember.php but it does not stop recursion so /viewmember.php?member=whatever still gets indexed.

Any ideas how to stop this?

I support an statement like if the current user is a guest, don't show any phone fields might fix it (don't know the syntax) but there might be another way in the robots.txt.

Any ideas?
If your using the SEO mod you may have to change the file name in robots.txt.

For hiding phone numbers from non-registered users, you can do that in admin under user groups.
__________________
Larry

Knowledge learned is more valuable than knowledge given.
Lhotch is offline   Reply With Quote
Old 11-12-2006, 03:41 PM   #3
Senior Member
 
bgordon's Avatar
 
Join Date: Aug 2006
Location: Georgian Bay, Ontario Canada
Posts: 170
Rep Power: 24
bgordon is on a distinguished road
Default

Quote:
Originally Posted by Lhotch
If your using the SEO mod you may have to change the file name in robots.txt.

For hiding phone numbers from non-registered users, you can do that in admin under user groups.
The phone number is hidden (as defined for guests in user groups) on the viewlisting page but the link to the member (viewmember.php) which takes them to the member's detail page, the telephone number is viewable there and does not seem to care that I I have turned it off for guests.

I suspect that if this is the default behaviour that all our clients personal details and telephone numbers are getting spidered.

I need to either add intelligence to the viewmember page to hide the field or add something to the usergroup hook that turns off ALL instances of the telephone number. The alternative is a way to hide it from spidering in robots.txt

I don't see that the SEO mod is affecting this page's url...
__________________
B. Gordon
v.4.0.9 Developer
bgordon is offline   Reply With Quote
Old 11-12-2006, 03:53 PM   #4
curmudgeon
 
Join Date: Mar 2006
Posts: 5,413
Rep Power: 138
Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light Lhotch is a glorious beacon of light
Default

Quote:
Originally Posted by bgordon
I suspect that if this is the default behaviour that all our clients personal details and telephone numbers are getting spidered.
That is correct. You also need to go into admin -> User View Settings and select the fields that are viewable.
__________________
Larry

Knowledge learned is more valuable than knowledge given.
Lhotch is offline   Reply With Quote
Reply

Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Last question... I hope Jake Pre Sales Questions 5 10-31-2006 11:05 AM


All times are GMT -4. The time now is 08:51 PM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2011, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.2.0