I want to exclude a php script in my robots.txt but it uses things like view_video.php?v=abc123
So would this would work?
[syntax=text]User-agent: *
Disallow: /view_video.php[/syntax]
GET and robots.txt
Re: GET and robots.txt
Bit late, but you can use wildcards
[syntax=text]Disallow: /view_video.php?v=*[/syntax]
which most search engine bots should support.
[syntax=text]Disallow: /view_video.php?v=*[/syntax]
which most search engine bots should support.