WordPress robots.txt location. In the previous article, I explained what robots.txt is for. What can be hidden from indexing. I also gave examples of robots.txt. Today I will show where this file should be located.
This is a simple operation. But before I get to the explanations – I’ll tell you why I prefer to put the robots.txt file myself and not use the WordPress plugins. And as we ourselves know, plugins for WordPress make things a lot simpler. I simply prefer to have control over many things. At the same time, I do not like to burden my web site with many plugins. Anyway, one plug-in update can seriously damage your website.
Therefore, the less plugins for WordPress are:
- Faster website
- More stable website
- Clearer admin background in WordPress
WordPress robots.txt location
If you do not use WordPress plugins that help you create and manage a robots.txt file – you need to upload the robots.txt file to the server where you keep your website.
You can use different methods to upload files (or delete them):
- from the management of the domain and server on which it is hosted
- from a program offering ftp service
I’m using FileZilla to have access to file sharing (but I do it very rarely – basically only with new web pages). No matter what method you use – just have a look at the folders and files. Below the picture shows the distribution of files and folders WordPress (You can see WordPress robots.txt location).
So in summary – the robots.txt file should be in the main WordPress folder. As you can see it is not difficult. A robots.txt file is important for a number of reasons. Most of the time, I’ve already made it known. Here is another one.
Do I need robots.txt?
So when you are checking your website’s SEO using paid or free services – the final result is dependent on whether you have or do not have robots.txt.
Actually – it does not matter if you have a robots.txt file where you allow to crawl all or do not have a robots.txt file. The result is the same – everything is indexed.
Nevertheless – checking your intranet site’s SEO in the absence of a robots.txt file may result in a lower score than if you have a robots.txt file.
That’s why it’s a good idea to have a robots.txt – you can see the real true result when you are checking the SEO of your web site.
- You can create and upload a robots.txt file yourself
- You can use another, additional plugin to create and manage a robots.txt file
- You can use a plugin that has many needed options (in this plugin is also an option to create and manage a robots.txt file). In my opinion this is the best situation (you do not have to use another plugin for WordPress, creating and managing a robots.txt file is much simpler).