User-agent: *
Disallow: /search.php
Disallow: /external
Disallow: /external-url
Disallow: /externalFrame/
Disallow: /get/
Disallow: /compare/
Disallow: /hits.php