User-agent: * Disallow: *.pdf User-agent: AhrefsBot Disallow: /