Discussion in 'OT Technology' started by pharmokan, Sep 29, 2009.
i think this is a case of precedence... robots look for robots.txt first
so it doesnt matter if i have robot meta tags in my html right?
Not at all. Bot checks robots.txt then goes on to check metas on a per page bases. Use robots meta tags when you want to deny indexing.
YOU MAD DUMB SON