# CorneliOS default robots.txt - www.cornelios.org User-agent: Mediapartners-Google Disallow: User-agent: * Crawl-Delay: 3 Disallow: /pdf/ Disallow: /resources/encyclopedia/ Disallow: /images/users/ Disallow: /app/ Disallow: /bin/ Disallow: /etc/ Disallow: /hosts/ Disallow: /http/ Disallow: /login/ Disallow: /root/ Disallow: /sql/ Disallow: /sys/