# 2019-03-28 User-agent: * Crawl-delay: 10 Disallow: /accounts/ Disallow: /site/accounts/ Disallow: /blockemail/ Disallow: /circ/ Disallow: /comments/ Disallow: /contact/ Disallow: /credit/ Disallow: /customer-comment-form/ Disallow: /digitalcredit/ Disallow: /email/ Disallow: /fragment/ Allow: /newsletters/$ Disallow: /newsletters/ Disallow: /newstart/ Disallow: /profiles/ Disallow: /search/ Disallow: /share/ Disallow: /sradmin/ Disallow: /tags/ Disallow: /xml/ #Allow: /?amp-content #Disallow: /*? User-agent: bingbot Disallow: /accounts/ Disallow: /site/accounts/ Disallow: /circ/ Disallow: /comments/ Disallow: /contact/ Disallow: /credit/ Disallow: /customer-comment-form/ Disallow: /digitalcredit/ Disallow: /email/ Disallow: /fragment/ Allow: /newsletters/$ Disallow: /newsletters/ Disallow: /newstart/ Disallow: /profiles/ Disallow: /search/ Disallow: /share/ Disallow: /sradmin/ Disallow: /tags/ Disallow: /xml/ #Disallow: /*? User-agent: TurnitinBot Disallow: / User-agent: Twitterbot Disallow: /accounts/ Disallow: /site/accounts/ Disallow: /circ/ Disallow: /comments/ Disallow: /contact/ Disallow: /credit/ Disallow: /customer-comment-form/ Disallow: /digitalcredit/ Disallow: /email/ Disallow: /fragment/ Allow: /newsletters/$ Disallow: /newsletters/ Disallow: /newstart/ Disallow: /profiles/ Disallow: /search/ Disallow: /share/ Disallow: /sradmin/ Disallow: /tags/ Disallow: /xml/