# Allow LinkedIn and Facebook crawlers User-agent: LinkedInBot Disallow: User-agent: facebookexternalhit Disallow: User-agent: Facebot Disallow: # Generic bot restrictions User-agent: * Disallow: /private/ Disallow : /StaticWebBackup