• ⚠️ INFORMATION: SAFETY & SUPPORT Resources here are generally safe, but false positives may occur on Virustotal due to certain coding techniques. Exercise caution and test before use.

Question How to solve the "Not Fetched - Not found (404)" error for your `robots.txt` file

To solve the "Not Fetched - Not found (404)" error for your `robots.txt` file, follow these steps:

Step 1: Create a robots.txt file
1. Log in to your XenForo admin panel.
2. Go to *Appearance* > *Templates*.
3. Click *Create New Template*.
4. Name the template `robots.txt`.
5. In the template content, add your desired robots.txt directives (e.g., `User-agent: *`, `Disallow: /admin`, etc.).

Step 2: Set up a route for robots.txt
1. Go to *Development* > *Route Filters*.
2. Click *Create New Route Filter*.
3. Set *Route Prefix* to `robots.txt`.
4. Set *Controller* to `XenForo_ControllerPublic_Robots`.
5. Save the changes.

Step 3: Test your robots.txt file
1. Visit `(link unavailable) in your browser.
2. Verify that your robots.txt file is displayed correctly.

Step 4: Resubmit your robots.txt file to Google Search Console
1. Log in to your Google Search Console account.
2. Go to *Sitemaps*.
3. Click *Submit* next to the `robots.txt` entry.
4. Verify that the submission is successful.

By following these steps, you should be able to resolve the "Not Fetched - Not found (404)" error and ensure that your `robots.txt` file is properly configured and accessible to search engines.
 
Top