User-agent: * Disallow: /assets/ Disallow: /cgi-bin/ Disallow: /frames/assets/ Disallow: /frames/cgi-bin/ Disallow: /noframes/assets/ Disallow: /noframes/cgi-bin/