WordPress robots.txt location

Wordpress robots.txt location

WordPress robots.txt location. In the previous article, I explained what robots.txt is for. What can be hidden from indexing. I also gave examples of robots.txt. Today I will show where this file should be located.


This is a simple operation. But before I get to the explanations – I’ll tell you why I prefer to put the robots.txt file myself and not use the WordPress plugins. And as we ourselves know, plugins for WordPress make things a lot simpler. I simply prefer to have control over many things. At the same time, I do not like to burden my web site with many plugins.
Anyway, one plug-in update can seriously damage your website.


Therefore, the less plugins for WordPress are:

  • Faster website
  • More stable website
  • Clearer admin background in WordPress
  • etc

 

WordPress robots.txt location

If you do not use WordPress plugins that help you create and manage a robots.txt file – you need to upload the robots.txt file to the server where you keep your website.


You can use different methods to upload files (or delete them):

  • from the management of the domain and server on which it is hosted
  • from a program offering ftp service


I’m using FileZilla to have access to file sharing (but I do it very rarely – basically only with new web pages).
No matter what method you use – just have a look at the folders and files. Below the picture shows the distribution of files and folders WordPress (You can see WordPress robots.txt location).

Wordpress robots.txt location FileZilla

 

So in summary – the robots.txt file should be in the main WordPress folder. As you can see it is not difficult. A robots.txt file is important for a number of reasons. Most of the time, I’ve already made it known. Here is another one.

Do I need robots.txt?

So when you are checking your website’s SEO using paid or free services – the final result is dependent on whether you have or do not have robots.txt.
Actually – it does not matter if you have a robots.txt file where you allow to crawl all or do not have a robots.txt file. The result is the same – everything is indexed.
Nevertheless – checking your intranet site’s SEO in the absence of a robots.txt file may result in a lower score than if you have a robots.txt file.
That’s why it’s a good idea to have a robots.txt – you can see the real true result when you are checking the SEO of your web site.

Summary:

  • You can create and upload a robots.txt file yourself
  • You can use another, additional plugin to create and manage a robots.txt file
  • You can use a plugin that has many needed options (in this plugin is also an option to create and manage a robots.txt file). In my opinion this is the best situation (you do not have to use another plugin for WordPress, creating and managing a robots.txt file is much simpler).

Rithven

Zapisz

Zapisz

Zapisz

Zapisz

Zapisz

Zapisz