web crawlers really need an option to just consider all "?something" urls as the same as the base URL and skip over them...
Anyone know if you can use #Burpsuite or similar to force a HTTP-301/302 redirect of them back to the base URL?
web crawlers really need an option to just consider all "?something" urls as the same as the base URL and skip over them...
Anyone know if you can use #Burpsuite or similar to force a HTTP-301/302 redirect of them back to the base URL?