User-agent: * Disallow: /docs-beta/ # Allow all pages to be crawled by our docs search index User-agent: Algolia Crawler Disallow: Sitemap: https://plaid.com/sitemap.xml