GET and robots.txt

Any help topics that don't fit in the current categories can go here.
Post Reply
User avatar
FrederickGeek8
Posts: 148
Joined: Wed Nov 30, 2011 10:31 pm

GET and robots.txt

Post by FrederickGeek8 »

I want to exclude a php script in my robots.txt but it uses things like view_video.php?v=abc123
So would this would work?
[syntax=text]User-agent: *
Disallow: /view_video.php[/syntax]
User avatar
jacek
Site Admin
Posts: 3262
Joined: Thu May 05, 2011 1:45 pm
Location: UK
Contact:

Re: GET and robots.txt

Post by jacek »

Bit late, but you can use wildcards

[syntax=text]Disallow: /view_video.php?v=*[/syntax]
which most search engine bots should support.
Image
Post Reply