BREAKING

6/recent/ticker-posts

Header Ads Widget

Responsive Advertisement

How to include robots.txt on Blogger | robot.txt generator - digonsure

We have told in our last class. How to create seo friendly blog posts? 

If you have read my previous post, we hope so. That you must have come to know about making seo friendly blog posts

Today we stand to share this with you. That how to include robots.txt file on Blogspot.

By the way, robots.txt is also called by the name of custom robots.txt file. And what is this? Will discuss this too. 

The importance of this in a blog website will be understood by the robots.txt with example. 

We know, it may take your time to read this post. But the time spent here will help to submit your blog in the search engine of robots.txt.

What is seo? How to generate robots.txt file? your all doubts will be clear.  Please make sure to read the post.


What is a robots.txt file and Google search console?

Robots.txt is a code file. That basically acts as a guide for any search engine bot visiting a website/blog.  And that informs the search engines. which of page or post on the website/blog should be indexed when. 

Google search consoles such as tools and reports help you measure your site's Search traffic and performance, fix issues, and make sure your site shines in Google Search results. 

How to generate robots.txt file for a website/blog?

If my advice works for you then please follow it. I want to tell you if that you not created your robots.txt file yet. So you should make it quick. Because it is beneficial for your blog.

To make it you need to follow some instructions.

Open google search bar 

First of all, you type the keyword in Google [ robots.txt generator for blogger ]

Click the first web link and after that paste your website URLs.



And press the generate button. after that, your robots.txt file is ready now.


By following these processes, you prepare your robot.txt file.

How to add a custom robots.txt file in blogger?

Now it's time to submit the robots.txt file to Blogger. So you guys come with us, let's take a look at it. 

Open the blogger navigation bar,  and click the setting button.

Arrow the do downside.

Chose the Crawlers the indexing. Click the arrow. 

And paste the robots.txt file code and save.

Enable custom robots.txt and custom robot header tags. 

In this way, the process of your robots.txt file is completed.

And make some necessary settings

custom robot tags for home page - All and Noodp
custom robot tags for archive and search pages - Noindex and Noodp 
custom robot tags for post and page - All and Noodp

To do so is to inform Google's bot or spider. Which page/post of the website to index. And all this necessary. This is some seo setting.  which is very valid. 

How to Rank Blogger Website In Google Search Console 2021| Gooogle Search Console.


What is the syntax of robots.txt?

In robots.txt we use some syntax that is very important to know about. 

User-Agent - The robot that follows all the rules. and in which it is suitable. 

Disallow - It means. Blocking bots to pages you don't want. That someone else would accept it.

Allow - This allows the search engine bots to crawl and index your content.

User-agent: *
Disallow: /search
Allow: /
Sitemap: https://yourwebsite.com/atom.xml?redirect=false&start-index=1&max-results=500

How to check your website robots.txt file? 

Have you ever wondered? The robots.txt file has been added to the Blogger website. So how do you check that your website has a robots.txt file submit? Or not.

So there is an example for that too if you search Site:https://Yourwebsiteurl.com/robots.txt in Google, then you can check out.

Conclusion 

So for now, that's all. Thank you for your valuable time in reading this article. I wish you are more learned with great success. We hope that if we have made any mistake then tell us in the comment box. the name of the informant -Ravi Paul 

Post a Comment

0 Comments