User-agent: * Crawl-Delay: 20 Disallow: /tag/ Disallow: /category/ Disallow: /job_cat/ Disallow: /our-team/ Disallow: /author/ Disallow: /portfolio/