Thanks for the robots.txt tutorial, I wanted to see where I can edit it in RankMath, could you update the Wordpress default-blocked part? It seems that changed in the last 3 years
Hello, thank you for your comment, To edit your robots.txt file in Rank Math, you can follow these updated steps in this tutorial: rankmath.com/kb/cant-edit-robots-txt/ Don’t hesitate to get in touch if you have any other questions.
Should I not leave an asterik * and instead add "googlebot" as I want it to crawl and index my website. I just don't understand why would i leave "user-agent" with an asterik when all I want is my website to be crawled and index? Please clarify this.
Hello, Thank you for your comment. The "User-agent" directive specifies the user-agent (search engine bot) the rule applies to. When using an asterisk (*) as the user-agent, it serves as a wildcard, meaning the rule covers all user-agents, including Googlebot. If you specifically want to target only Googlebot, you can mention "Googlebot" instead of using the asterisk (*). If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
@RankMath Thanks, one more thing, please. Does it become necessary to add this code to the website if you get the error message from the G Search console that "indexing blocked by robots.txt"?
Hello, thank you for your comment. If you're noticing useful pages on your website are being marked as blocked by robots.txt then we would suggest you to follow this tutorial to identify the specific rule that is blocking them rankmath.com/kb/fix-submitted-url-blocked-by-robots-txt-error/ Once identified you can adjust the rule to resolve the issue. If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
Hello big brother I've been trying to work on the Yandex webmaster, but it keeps telling me Rughts has not been verified. Meta tag not found, what should I do?
Hello, and thank you for your comment. We have a detailed tutorial that walks through site verification at Yandex: ua-cam.com/video/ePrKAHn3t9U/v-deo.html If you face issue even after you follow this tutorial, then please open a support ticket here rankmath.com/support/ and our support team will closely into that closely. Looking foward to helping you.
Hello, thank you for your comment. You can check the following lessons from our blog page: SEO Basics: rankmath.com/blog/category/seo-basics/ Technical SEO: rankmath.com/blog/category/technical-seo/ If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
Hello, for the Rank Math’s robots.txt to work, you should delete the robots.txt that is in your website’s root folder. Once you delete that, robots.txt created using Rank Math will start taking effect and then it won’t matter if your physical robots.txt file is writeable or not.
Hello, You can use FTP or your web hosting file manager to access the root folder of your website. It is the same folder that houses wp-content, wp-includes, wp-admin folder. If you are not sure, please ask your web host or open a ticket on our support forum at rankmath.com/support/ Hope that helps.
Hello, thank you for your comment. To fix the issue where the contents are locked because a robots.txt file is present in the root folder, you can follow these steps: 1. Identify the Physical Robots.txt File: Log into your WordPress root directory using cPanel or an FTP application. Check if there is a file named robots.txt in the root directory. 2. Delete the Physical Robots.txt File: If a robots.txt file is found, select it and click Delete. This action will remove the conflicting physical robots.txt file from the root directory. 3. Clear Cache and Test: After deleting the file, clear your website and server-level cache. Test your robots.txt URL again to ensure that the issue is resolved. If you need visual guidance, you can refer to the images provided in the knowledgebase tutorial on fixing common robots.txt issues with Rank Math: rankmath.com/kb/cant-edit-robots-txt/ Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.
Hello, thank you for your comment. Please refer to this tutorial to troubleshoot the issue: rankmath.com/kb/cant-edit-robots-txt/ Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Hello, thank you for your comment. The robots.txt rule you've provided will block search engine bots from accessing the /impressum/ directory on your website. If this is your intended action, then the rule is correct. If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
Hello, thank you for your comment. Here is a more recent video from us on using robots.txt: ua-cam.com/video/qRlQ965pGCA/v-deo.html Hope this help, and please do not hesitate to let us know if you need our assistance with anything else.
Thanks for the robots.txt tutorial, I wanted to see where I can edit it in RankMath, could you update the Wordpress default-blocked part? It seems that changed in the last 3 years
Hello, thank you for your comment,
To edit your robots.txt file in Rank Math, you can follow these updated steps in this tutorial:
rankmath.com/kb/cant-edit-robots-txt/
Don’t hesitate to get in touch if you have any other questions.
Thanks, Kate! This is was very helpful:)
Hello, and thanks for your comment. Glad that helped. Feel free to get in touch if you have questions.
Should I not leave an asterik * and instead add "googlebot" as I want it to crawl and index my website. I just don't understand why would i leave "user-agent" with an asterik when all I want is my website to be crawled and index? Please clarify this.
Hello, Thank you for your comment.
The "User-agent" directive specifies the user-agent (search engine bot) the rule applies to. When using an asterisk (*) as the user-agent, it serves as a wildcard, meaning the rule covers all user-agents, including Googlebot.
If you specifically want to target only Googlebot, you can mention "Googlebot" instead of using the asterisk (*).
If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
@RankMath Thanks, one more thing, please. Does it become necessary to add this code to the website if you get the error message from the G Search console that "indexing blocked by robots.txt"?
Hello, thank you for your comment.
If you're noticing useful pages on your website are being marked as blocked by robots.txt then we would suggest you to follow this tutorial to identify the specific rule that is blocking them
rankmath.com/kb/fix-submitted-url-blocked-by-robots-txt-error/
Once identified you can adjust the rule to resolve the issue.
If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
Hello big brother
I've been trying to work on the Yandex webmaster, but it keeps telling me Rughts has not been verified. Meta tag not found, what should I do?
Hello, and thank you for your comment.
We have a detailed tutorial that walks through site verification at Yandex: ua-cam.com/video/ePrKAHn3t9U/v-deo.html
If you face issue even after you follow this tutorial, then please open a support ticket here rankmath.com/support/ and our support team will closely into that closely.
Looking foward to helping you.
You are Great explan the method without take more time .. i hope you explan course from beginning about seo
Hello, thank you for your comment.
You can check the following lessons from our blog page:
SEO Basics: rankmath.com/blog/category/seo-basics/
Technical SEO: rankmath.com/blog/category/technical-seo/
If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
but my promblem is (robots.txt file is not writable) how I edit this
Hello, for the Rank Math’s robots.txt to work, you should delete the robots.txt that is in your website’s root folder. Once you delete that, robots.txt created using Rank Math will start taking effect and then it won’t matter if your physical robots.txt file is writeable or not.
@@RankMath thanx for help but where I can access root folder
Hello, You can use FTP or your web hosting file manager to access the root folder of your website. It is the same folder that houses wp-content, wp-includes, wp-admin folder. If you are not sure, please ask your web host or open a ticket on our support forum at rankmath.com/support/
Hope that helps.
@@RankMath thanx for the help
Contents are locked because a robots.txt file is present in the root folder ... how to fix this
Hello, thank you for your comment.
To fix the issue where the contents are locked because a robots.txt file is present in the root folder, you can follow these steps:
1. Identify the Physical Robots.txt File:
Log into your WordPress root directory using cPanel or an FTP application.
Check if there is a file named robots.txt in the root directory.
2. Delete the Physical Robots.txt File:
If a robots.txt file is found, select it and click Delete.
This action will remove the conflicting physical robots.txt file from the root directory.
3. Clear Cache and Test:
After deleting the file, clear your website and server-level cache.
Test your robots.txt URL again to ensure that the issue is resolved.
If you need visual guidance, you can refer to the images provided in the knowledgebase tutorial on fixing common robots.txt issues with Rank Math: rankmath.com/kb/cant-edit-robots-txt/
Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.
i can't edit file robots ! even though it has been opened advened mode
Hello, thank you for your comment.
Please refer to this tutorial to troubleshoot the issue: rankmath.com/kb/cant-edit-robots-txt/
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
i want that my Impressum with all my date will be not Crawled by all the bots. Can you give me some a code pls i can pass in Rank math?
or is tis way better?
User-agent: *
Disallow: /impressum/
Hello, thank you for your comment.
The robots.txt rule you've provided will block search engine bots from accessing the /impressum/ directory on your website. If this is your intended action, then the rule is correct.
If you encounter any issues with Rank Math, you can always raise your question here rankmath.com/support/ and our support team would be happy to assist you.
Okey this is not working anymore with rankmath. you guys need to make a update video on how to edit robots txt file with rankmath.
Hello, thank you for your comment.
Here is a more recent video from us on using robots.txt: ua-cam.com/video/qRlQ965pGCA/v-deo.html
Hope this help, and please do not hesitate to let us know if you need our assistance with anything else.
really helpfull
Hello and thanks for your comment. You are always welcome. Feel free to get in touch if you have questions.
thanks helpfull
Hello, and thanks for your comment. Glad that helped. Feel free to get in touch if you have questions.
Thanks mam
Hello, and thanks for your comment. Glad that helped. Feel free to get in touch if you have questions.