User-agent: * Disallow: /post-*.html Disallow: /photo.jsp Disallow: /*.ajax$ Disallow: /*..html Disallow: /*.html?*