HTML <meta name="robots"> 屿§å¤
robots 㯠<meta> è¦ç´ ã® name 屿§ã®å¤ã§ï¼å¤ãã®å ´åãããããã¿ã°ãã¨å¼ã°ãã¾ãï¼ãã¦ã§ãã¯ãã¼ã©ã¼ããã¼ã¸ã«å¯¾ãã¦è¡ãã¯ãã¼ã«ããã³ã¤ã³ããã¯ã¹ä½æã®åä½ãå®ç¾©ãã¾ãã
æå®ããå ´åã <meta> è¦ç´ ã® content 屿§ã«ã1 ã¤ä»¥ä¸ã®ã«ã¼ã«ãã«ã³ãã§åºåã£ããªã¹ãã¨ãã¦ãã¯ãã¼ã©ã¼ã«å¯¾ããæç¤ºãå®ç¾©ãã¾ãã
ä¾ãã°ããã¼ã¸ãæ¤ç´¢çµæã®ã¤ã³ããã¯ã¹ããé¤å¤ãããã¨ãã¯ãã¼ã©ã¼ã«æç¤ºããã«ã¯ãnoindex å¤ã使ç¨ãããã¨ãã§ãã¾ãã
<meta name="robots" content="noindex" />
ã¡ã¢: ååçãªããããã ãããã®ã«ã¼ã«ã«å¾ãã¾ãã ã¯ãã¼ã©ã¼ã¯ããããã¼ãã¡ã¿è¦ç´ ãèªã¿è¾¼ãããã«ããªã½ã¼ã¹ã«ã¢ã¯ã»ã¹ããå¿ è¦ãããã¾ãï¼X-Robots-Tag: robots.txt ã¨ã®ç¸äºä½ç¨ãåç §ãã¦ãã ããï¼ã ã¯ãã¼ã©ã¼ã«ãã帯åå¹ ã®æ¶è²»ã鲿¢ãããå ´åã¯ããªã½ã¼ã¹ã®ã¯ãã¼ã«ãå®å ¨ã«ãããã¯ããå¶éç㪠robots.txt ãã¡ã¤ã«ã®æ¹ããã¤ã³ããã¯ã¹ä½æã«ã¼ã«ããã广çã§ãã
使ç¨ä¸ã®ã¡ã¢
<meta name="robots"> è¦ç´ ã«ã¯ã次ã®è¿½å 屿§ãæå®ãããã¨ãã§ãã¾ãã
content-
content屿§ã¯å®ç¾©ããå¿ è¦ãããã¾ãããã®å±æ§ã®å¤ã¯ãååçãªæ¤ç´¢ã¨ã³ã¸ã³ããããã®ã¤ã³ããã¯ã¹ä½æããã³ã¯ãã¼ã«åä½ãè¨å®ãã¾ãã ã«ã³ãã§åºåããããªã¹ãã¨ãã¦ã次ã®ãã¼ã¯ã¼ãã 1 ã¤ä»¥ä¸åãå ¥ãã¾ããindex-
ããããããã¼ã¸ãã¤ã³ããã¯ã¹ã«ç»é²ãããã¨ã許å¯ãã¾ããããã¯æ¢å®ã®åä½ã§ãã 主è¦ãªã¯ãã¼ã©ã¼ãã¹ã¦ã§ä½¿ç¨ããã¾ãã
noindex-
ããããã«ãã¼ã¸ãã¤ã³ããã¯ã¹ã«ç»é²ããªãããã«ãªã¯ã¨ã¹ããã¾ãã 主è¦ãªã¯ãã¼ã©ã¼ãã¹ã¦ã§ä½¿ç¨ããã¾ãã
follow-
ããããããã¼ã¸ä¸ã®ãªã³ã¯ããã©ããã¨ã許å¯ãã¾ããããã¯æ¢å®ã®åä½ã§ãã 主è¦ãªã¯ãã¼ã©ã¼ãã¹ã¦ã§ä½¿ç¨ããã¾ãã
nofollow-
ããããã«å¯¾ãã¦ããã¼ã¸ä¸ã®ãªã³ã¯ããã©ããªããããªã¯ã¨ã¹ããã¾ãã 主è¦ãªã¯ãã¼ã©ã¼ãã¹ã¦ã§ä½¿ç¨ããã¾ãã
all-
index, followã¨åçã§ãã 使ç¨ããããã®: Google. none-
noindex, nofollowã¨åçã§ãã 使ç¨ããããã®: Google. noarchive-
æ¤ç´¢ã¨ã³ã¸ã³ã«ãã®ãã¼ã¸ã®å 容ããã£ãã·ã¥ããªãããè¦æ±ãã¾ãã 使ç¨ããããã®: Google, Yahoo, Bing.
nosnippet-
æ¤ç´¢ã¨ã³ã¸ã³ã®çµæã§ãã®ãã¼ã¸ã®èª¬æã®è¡¨ç¤ºãæå¶ãã¾ãã 使ç¨ããããã®: Google, Bing.
noimageindex-
ãã®ãã¼ã¸ãã¤ã³ããã¯ã¹ãããç»åã®åç §ãã¼ã¸ã¨ãã¦è¡¨ç¤ºããªãããè¦æ±ãã¾ãã 使ç¨ããããã®: Google.
nocache-
noarchiveã¨åçã§ãã 使ç¨ããããã®: Bing.
解説
robots ã¡ã¿å¤ãè¨å®ããã«ããã£ã¦ãããã¤ãã®éè¦ãªæ³¨æäºé
ãããã¾ãã
- ãããã®ã«ã¼ã«ã«å¾ãã®ã¯ãååçãªããããã®ã¿ã§ããé»åã¡ã¼ã«ã¢ãã¬ã¹ã®åéè ãªã©ã®æªæã®ããè¡çºè ããã£ã¬ã¯ãã£ããç¡è¦ãããã¨ãé²ããã¨ã¯ã§ãã¾ããã
<meta>ã¿ã°ã§å®ç¾©ããã¦ããå ´åã§ããããããã¯ãããã®ã«ã¼ã«ãèªã¿è¾¼ãããã«ãã¼ã¸ã«ã¢ã¯ã»ã¹ããå¿ è¦ãããã¾ãã帯åå¹ ãç¯ç´ããã«ã¯ã代ããã« robots.txt ãã¡ã¤ã« ã使ç¨ãããã¨ãæ¤è¨ãã¦ãã ããã<meta name="robots">ã¿ã°ã¨robots.txtã¯ç°ãªãå½¹å²ãæããã¾ããrobots.txtã¯ã¯ãã¼ã«ãå¶å¾¡ããrobotsã¡ã¿ã¿ã°ã¯ã¤ã³ããã¯ã¹ä½æããã以å¤ã®åä½ã«å½±é¿ãä¸ãã¾ããrobots.txtã«ãã£ã¦ãããã¯ããããã¼ã¸ã¯ããã以å¤ã®ã½ã¼ã¹ãããªã³ã¯ããã¦ããå ´åãã¤ã³ããã¯ã¹ã«ç»é²ãããå ´åãããã¾ããnoindexãã£ã¬ã¯ãã£ãã¯ãããããããã¼ã¸ãå訪åããå¾ã«ã®ã¿å¹æãããã¾ãããã®ãããrobots.txtãããã妨ããªãããã«ãã¦ãã ããã- å¤ã«ãã£ã¦ã¯äºãã«æä»çãªãã®ãããã¾ããä¾ãã°
indexã¨noindexãfollowã¨nofollowãªã©ã§ããç«¶åããå¤ã使ç¨ãããå ´åãåä½ã¯æªå®ç¾©ã«ãªãã¾ãã - GoogleãYahooãBing ãªã©ä¸é¨ã®ã¯ãã¼ã©ã¼ããããã§ã¯ã HTTP ãããã¼ã®
X-Robots-Tagã§æä¾ãããåãå¤ã«å¯¾å¿ãã¦ãããã®ãããã¾ããããã«ããã PDF ãç»åãªã©ã® HTML 以å¤ã®ææ¸ã§ããããã®è¦åã使ç¨ãããã¨ãã§ãã¾ãã
ä¾
>robots ãã¼ã¯ã¼ãã®ä½¿ç¨
次ã®ä¾ã§ã¯ãnofollow ã使ç¨ãã¦ãã¯ãã¼ã©ã¼ããã¼ã¸ä¸ã®ãªã³ã¯ããã©ãã¼ããªãããã«è¦æ±ããnoindex ã使ç¨ãã¦ããã®ãã¼ã¸ãã¤ã³ããã¯ã¹ããé¤å¤ããããã«è¦æ±ãã¦ãã¾ãã
<meta name="robots" content="nofollow, noindex" />
仿§æ¸
ããã¯ã©ã®æ¨æºä»æ§ã«ãå±ãã¾ããããæ¤ç´¢ããããã¦ã§ãã¯ãã¼ã©ã¼ãããã³é¡ä¼¼ã®ã¦ã¼ã¶ã¼ã¨ã¼ã¸ã§ã³ãã¨éä¿¡ããããã®äºå®ä¸ã®æ¨æºææ®µã§ãã
ãã©ã¦ã¶ã¼ã®äºææ§
ãã®æ©è½ã¯ã¯ãã¼ã©ã¼ãç£è¦ãããã¨ãæå³ãã¦ãããããããã©ã¦ã¶ã¼ãã®äºææ§ã¯é©ç¨ããã¾ããã
é¢é£æ å ±
- HTTP ã®
X-Robots-Tagãããã¼ - robots.txt ã®æ§æã¬ã¤ã
- ç¨èªéã® robots.txt
- ç¨èªéã® æ¤ç´¢ã¨ã³ã¸ã³
- RFC 9309: Robots Exclusion Protocol
- WHATWG Wiki MetaExtensions page
- Using the robots meta tag (developers.google.com)