I want to exclude tag links from been crawled by the auditor. I know I can do it by adding each tag separately but is it possible to do with a wildcard?
eg www.mysite.com/tag/* I tried this way but it was ignored
Moderators: sendtogeo, hellow0rld, eugene
Users browsing this forum: No registered users and 13 guests