# file to prevent robots indexing all directories and files User-agent: * Disallow: /pdfs/news06.pdf