User-agent: *
Disallow: cgi-bin/*
Disallow: media/*
Disallow: site/*
Allow: index.html
Allow: index2.html
Allow: *