Some users prefer to hide their Webflow site from search engines. If this option is turned on, CryoLayer will also hide the Vercel site since it copies the same robots.txt file. Follow these instructions to allow robots on your Vercel site while keeping your Webflow site hidden.

  1. In your Netlify site's dashboard, click the "Site settings" tab.
  2. Click on "Build & deploy" on the left-hand side.
  3. Scroll down to where it says "Environment Variables".
  4. Click the "Edit variables" button.
  5. Click the "New variable" button.
  6. Input "REPLACE_ROBOTS_TXT" for the variable name, and "yes" for the value, without the quotes.
  7. Now just publish your Webflow site again.

Now the robots.txt file on your Netlify site should be empty, allowing robots to crawl your site.