To solve the "Not Fetched - Not found (404)" error for your `robots.txt` file, follow these steps:
Step 1: Create a robots.txt file
1. Log in to your XenForo admin panel.
2. Go to *Appearance* > *Templates*.
3. Click *Create New Template*.
4. Name the template `robots.txt`.
5. In the template content, add your desired robots.txt directives (e.g., `User-agent: *`, `Disallow: /admin`, etc.).
Step 2: Set up a route for robots.txt
1. Go to *Development* > *Route Filters*.
2. Click *Create New Route Filter*.
3. Set *Route Prefix* to `robots.txt`.
4. Set *Controller* to `XenForo_ControllerPublic_Robots`.
5. Save the changes.
Step 3: Test your robots.txt file
1. Visit `(link unavailable) in your browser.
2. Verify that your robots.txt file is displayed correctly.
Step 4: Resubmit your robots.txt file to Google Search Console
1. Log in to your Google Search Console account.
2. Go to *Sitemaps*.
3. Click *Submit* next to the `robots.txt` entry.
4. Verify that the submission is successful.
By following these steps, you should be able to resolve the "Not Fetched - Not found (404)" error and ensure that your `robots.txt` file is properly configured and accessible to search engines.
Step 1: Create a robots.txt file
1. Log in to your XenForo admin panel.
2. Go to *Appearance* > *Templates*.
3. Click *Create New Template*.
4. Name the template `robots.txt`.
5. In the template content, add your desired robots.txt directives (e.g., `User-agent: *`, `Disallow: /admin`, etc.).
Step 2: Set up a route for robots.txt
1. Go to *Development* > *Route Filters*.
2. Click *Create New Route Filter*.
3. Set *Route Prefix* to `robots.txt`.
4. Set *Controller* to `XenForo_ControllerPublic_Robots`.
5. Save the changes.
Step 3: Test your robots.txt file
1. Visit `(link unavailable) in your browser.
2. Verify that your robots.txt file is displayed correctly.
Step 4: Resubmit your robots.txt file to Google Search Console
1. Log in to your Google Search Console account.
2. Go to *Sitemaps*.
3. Click *Submit* next to the `robots.txt` entry.
4. Verify that the submission is successful.
By following these steps, you should be able to resolve the "Not Fetched - Not found (404)" error and ensure that your `robots.txt` file is properly configured and accessible to search engines.