User-agent: *
Disallow: crb/search
Disallow: crb/files
Disallow: crb/api
Disallow: crb/feed
Disallow: crb/tags
Disallow: crb/error.htm