User-agent: * Disallow: /index.html Disallow: /*? Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.swf$ Disallow: /*.txt$