User-agent: * Disallow: /direct.html Disallow: /direct.html/ Disallow: /ca-direct.html Disallow: /ca-direct.html/