Meta Robot tags or robots.txt?
Which is
better — Meta Robot tags or robots.txt?
A Robots
Meta Tag is a piece of code that that provides crawlers instructions for
how to crawl and index web page. It is placed into the <head> section of
a web page, and looks like this:
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX,
NOFOLLOW">
</head>
A Robot Meta Tag plays an important role for SEO. The Meta Robots
Tag is usually used to prevent pages showing up in search results, despite the
fact that it has different uses
·
Internal search results
·
PPC landing pages
·
Pages about upcoming promotions, contests or product
launches
·
Duplicate content (use canonical tags to suggest the
best version for indexing)
Robots.txt
- Robots.txt is a file which is included in our website database to
instruct the search engine robots that which page should be crawled and which
are not. Robots.txt manages the accessibility of your content to crawlers, it
doesn’t tell them whether they should index the content or not.
Comments
Post a Comment