What is Robots.txt | How to Create Robots.txt File ? | Seo Tutorial For Beginners in Tamil | #18
Вставка
- Опубліковано 30 вер 2024
- In this video, you will learn what is a robots.txt file, why do you need it, how to SEO optimize it and how to test that search engines can access it without any problems.
#seotutorial #seotutorialforbeginners #seo
Advanced Seo Tutorial in Tamil
Technical SEO Checklist #18
1.What is robots.txt?
The robots.txt is a text file that tells to search engines which pages on your site to crawl and which pages not to crawl.
The contents of a robots.txt are publicly available in the Internet. anyone can view your robots.txt file
2.How does robots.txt work?
The robots file has a very simple structure. There are some predefined keyword combinations you can use.
The most common are:
User-agent
Disallow
Allow
Crawl-delay
Sitemap
Check out my previous videos
Technical SEO Checklist in Tamil [2020] | Seo Tutorial for Beginners in Tamil | Part-17
• Technical SEO Checklis...
What is Twitter Card Meta Tags? | How to use Twitter Card Tags for website | SEO in Tamil | #16
• What is Twitter Card M...
What is Open Graph Meta Tags? | How to use OG meta tags for website | On Page SEO in Tamil | #15
• What is Open Graph Met...
What is Meta Robots Tag? | How to use Index, Noindex, Follow, Nofollow | On Page SEO in Tamil | #14
• What is Meta Robots Ta...
What is URL Optimization? | How to do URL Optimization for SEO | On Page SEO in Tamil | Part-13
• What is URL Optimizati...
What is Image Optimization ? | How to write Alt Tags for SEO | On Page SEO in Tamil | Part-12
• What is Image Optimiza...
What's a Canonical URL Tag? | Why its important for SEO? | On Page SEO Tutorial in Tamil | Part-11
• What's a Canonical URL...
What is header Tag? | Why is the H1 H2 tag so important to improve your SEO | On Page SEO Tamil |#10
• What is header Tag? | ...
What is Meta Description Tag? | How to Write Perfect Description Tag | On Page SEO in Tamil | #09
• What is Meta Descripti...
What is Title Tag? | How to Write the Perfect Title Tag for SEO | On Page SEO in Tamil | Part-08
• What is Title Tag? | H...
What is On page SEO? | How to do on page SEO in Tamil | Guide For Beginners [2020] | Part-07
• What is On page SEO? |...
What is SEO Audit? | How to do SEO Audit ( REPORT ) for website in Tamil | SEO Tutorial in Tamil #06
• What is SEO Audit? | H...
What is Competitor Analysis in Tamil | How to do Competitor Analysis | SEO Tutorial in TAMIL | #05
• What is Competitor Ana...
What is keyword research? | How to do Keyword Research for SEO in Tamil [2020] | Part-04
• What is keyword resear...
What is On-Page SEO & Off-Page SEO in Tamil | Advanced SEO Tutorial in TAMIL 2020 | Part-03
• What is On-Page SEO & ...
Types of SEO Techniques in Tamil | Advanced SEO Tutorial in TAMIL | Part-02
• Types of SEO Technique...
What is SEO (Search Engine Optimization)? | Advanced SEO Tutorial in TAMIL 2020 | Part-01
• What is SEO (Search En...
Instagram Ads in Tamil | How To Create Instagram Ads (Step-By-Step) in 2020 | Part-01
• How To Create Instagra...
Facebook Ads Tamil | How to Create a Facebook Ads Campaign in 2020 | Simplified E-learning | Part-01
• Facebook Ads Tamil | H...
Google Search Console in Tamil | How to Set Up Google Search Console to improve your SEO | Part-01
• Google Search Console ...
Google Ads Tutorial For Beginners in Tamil 2020 Basic Campaign Creation Part-01
• Google Ads Tutorial Fo...
How To Setup Google My Business Step by step for Beginners
• How to Create & Verify...
Google Analytics in Tamil | What is Google Analytics | How does Google Analytics work? | Part-01
• What is Google Analyti...
I am seeing your videos past 5 years the things that I have learned so many things from ur videos. Really easy understanding and explanation 😎
Thanks and welcome
Sir.. distance education ug students Seo analyst ku eligible ah
Yes your eligible
@@simplifiedelearning thanks alot
robots.txt fileinject pannama vitta enna prachanai varum
This is only for controlling search engine. If you’re not done, also, it won’t make any changes on the ranking.
@@simplifiedelearning thank you bro
Bro ennaku following doubts irruku
1. What is the role of Msnbot ?
2.whether we can edit this robot.txt file of any website ?
3.hosting panel pathi oru clear ana video onnu podunga bro ...it will be more helpful ..
1. Msnbot was a web-crawling robot
2. we can see robot.txt file of any website but we can not edit those files
3. Sure Jeraled i will so soon
bro ithula core php direct file name a allow panalam but laravel la route set pani tha links work akum so na links a allow pananuma illa resource file kulla view files irukum atha allow pananuma
Bro can we use meta robots tag instead of robots.txt. Is there any difference between them
Yes you can use tag, both method will work same only
Theoretically and practically both ways your videos are easy to use.
thanks & welcome
Didn't see these kind video in any UA-cam channel. Thankyou for these informative both in word press site and other site implementation. Plz upload more informative and new treand in seo and digitalmarketing
Thank you, Sure i will upload soon
Bro, when I generate a sitemap for my website It is not crawling the files inside the folder. I have even mentioned index, follow tags, Although it is not crawling what can be the problem.. Please help me bro
delete robot.txt file and try to generate, also send your code to my facebook messenger i will check and let you know
Thanks for the clear information brother👍👍understand..
welcome
Hai sir,
It's very useful and informative..i will try to do this ,thank you...
Welcome
Very clear explanation looking forward for all technical SEO checklist video 💜 thanking you lots
Thank you Stevenson Vishal
Thank You very much, bro! Come up with new helpful videos like this often.
I'll recommend this video to my friends.
Welcome
Amazingly explained, Easy to understand
Welcome
I got what I was expecting 😊 many thanks
You're welcome 😊
thalaivaaaaa hats off to youuu
Thanks Suriya
Bro if i need to make changes in a website other than wordpress sites?? Adhayum hosting panel le upload pannanuma??
next question: for instance if i need to change my title tag, do i need to change from the source file and upload the changes it to host panel?? or else i can directly make changes on hosting panel??
please clear this doubt...
If you have static or html website then have to upload the file edited in the hosting panel bro
@@simplifiedelearningpuriyala?? Source edit pannanuma?? Or else can i make changes from the host panel is enough??
Source code edit pannanum bro aprom hosting panel la upload pannanum
Clear information... thank you for your work 🙏
Thanks and welcome Sasikumar
Thank you buddy ❤️
Welcome
Clean Explanation ❣
Thank you 🙂
Can i get this ppt???
am planning to upload all the ppt in my website soon
Clear ah explain pannureenga bro... Daily um video upload pannunga ...Thanks bro
Thank you so much bro I will try my best
Osting file ilathavanga eppudi porathu
Without hosting not possible to do
bro robot.txt kum sitemap kum ena difference?
1. purpose of a sitemap is to indicate the search engines of all the webpages that it should crawl on your website.
2. robots.txt file is to signify the search engines which pages to crawl and which pages to omit.
Ennaku seminar topic in python "urllib parser of robots.txt " , is it same as video
Am not sure about python urllib Vishnu
@@simplifiedelearning thanks for your valuable time and comment sir,
My staff gives a link of python and told to take seminar on that
docs.python.org/3/library/urllib.robotparser.html
Robots.txt files la error nu varuthu ,what solution bro
update your robots.txt file Dinesh
@@simplifiedelearning thank u
Nice video!In WordPress website la .why should have to give disallow:/wp-admin/ Allow:/wp-admin/admin-ajax.php.this is standard code for WordPress website.pls explain
This file is used in front-end and Backend by themes and plugins. For this reason allow crawling
@@simplifiedelearning Hi .why we implement disallow:/wp-admin any particular reasons?pls explain?
@Elango coz google has spider we can call simpally google bot atificle interligen thet bot work is reading our files and thet bot collect our all contents so we give permision to dont read this file when we disallow
User-agent*
Disallow/wp-admin
What happen if robots file is not given?
Another doubt - how to say google that to crawl my website every 10 minutes (is this possible)
1. Robot file missing will not make any difference in the crawling
2.there is no possibility, because nobody can predict when google bot will crawl your website
@@simplifiedelearning thank you bro
Sir intha robots.txt file epty wrok aguthuu aproo epty namba web page ku ithu Google engine thanu epty theriyuthuu ,,,other engine namba kuduthuruka condition thandi ulla varuma...vantha ena panarathuu ,,apache server la epty ithula panarathu konjo help panuga broo
Not getting your question properly, can you explain bit more
Hi Sir i need your help to remove image in Google search, it is in other website owner i requested to remove they removed the page it shows error410 , but still image is viewed ,please help me to contact you
it will take 15 to 30 day after removing