{"id":22981,"date":"2025-03-12T16:34:00","date_gmt":"2025-03-12T09:34:00","guid":{"rendered":"https:\/\/interdata.vn\/blog\/?p=22981"},"modified":"2025-07-14T17:13:29","modified_gmt":"2025-07-14T10:13:29","slug":"robots-txt-la-gi","status":"publish","type":"post","link":"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/","title":{"rendered":"Robots.txt l\u00e0 g\u00ec? C\u00f4ng d\u1ee5ng &#038; C\u00e1ch t\u1ea1o robots.txt Website A-Z"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-white ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">N\u1ed8I DUNG<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Robotstxt-la-gi\" >Robots.txt l\u00e0 g\u00ec?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Muc-dich-chinh-cua-file-Robotstxt\" >M\u1ee5c \u0111\u00edch ch\u00ednh c\u1ee7a file Robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Robotstxt-van-hanh-nhu-the-nao\" >Robots.txt v\u1eadn h\u00e0nh nh\u01b0 th\u1ebf n\u00e0o?<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cong-dung-cua-robotstxt-la-gi-trong-SEO\" >C\u00f4ng d\u1ee5ng c\u1ee7a robots.txt l\u00e0 g\u00ec trong SEO<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Chan-bot-tim-kiem-khi-website-dang-xay-dung\" >Ch\u1eb7n bot t\u00ecm ki\u1ebfm khi website \u0111ang x\u00e2y d\u1ef1ng<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Khai-bao-Sitemap-voi-bot-tim-kiem\" >Khai b\u00e1o Sitemap v\u1edbi bot t\u00ecm ki\u1ebfm<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Ngan-chan-bot-quet-backlink-it-hieu-qua\" >Ng\u0103n ch\u1eb7n bot qu\u00e9t backlink (\u00edt hi\u1ec7u qu\u1ea3)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Chan-cac-thu-muc-can-bao-mat\" >Ch\u1eb7n c\u00e1c th\u01b0 m\u1ee5c c\u1ea7n b\u1ea3o m\u1eadt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Chan-cac-ma-doc-hai\" >Ch\u1eb7n c\u00e1c m\u00e3 \u0111\u1ed9c h\u1ea1i<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Chan-bo-doi-voi-cac-trang-thuong-mai-dien-tu\" >Ch\u1eb7n b\u1ecd \u0111\u1ed1i v\u1edbi c\u00e1c trang th\u01b0\u01a1ng m\u1ea1i \u0111i\u1ec7n t\u1eed<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#File-robotstxt-duoc-dat-o-vi-tri-nao-tren-mot-website\" >File robots.txt \u0111\u01b0\u1ee3c \u0111\u1eb7t \u1edf v\u1ecb tr\u00ed n\u00e0o tr\u00ean m\u1ed9t website?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cac-vi-du-ve-file-Robotstxt-thuong-gap\" >C\u00e1c v\u00ed d\u1ee5 v\u1ec1 file Robots.txt th\u01b0\u1eddng g\u1eb7p<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Nhung-han-che-cua-robotstxt-nen-chu-y\" >Nh\u1eefng h\u1ea1n ch\u1ebf c\u1ee7a robots.txt n\u00ean ch\u00fa \u00fd<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Mot-vai-trinh-duyet-tim-kiem-khong-ho-tro-cac-lenh-trong-tep-robotstxt\" >M\u1ed9t v\u00e0i tr\u00ecnh duy\u1ec7t t\u00ecm ki\u1ebfm kh\u00f4ng h\u1ed7 tr\u1ee3 c\u00e1c l\u1ec7nh trong t\u1ec7p robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cac-trinh-du-lieu-co-cu-phap-phan-tich-du-lieu-rieng\" >C\u00e1c tr\u00ecnh d\u1eef li\u1ec7u c\u00f3 c\u00fa ph\u00e1p ph\u00e2n t\u00edch d\u1eef li\u1ec7u ri\u00eang<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Bi-tep-robotstxt-chan-nhung-van-co-the-index-Google\" >B\u1ecb t\u1ec7p robots.txt ch\u1eb7n nh\u01b0ng v\u1eabn c\u00f3 th\u1ec3 index Google<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cac-lenh-duoc-ho-tro-boi-Googlebot-trong-robotstxt\" >C\u00e1c l\u1ec7nh \u0111\u01b0\u1ee3c h\u1ed7 tr\u1ee3 b\u1edfi Googlebot trong robots.txt<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Lenh-User-agent\" >L\u1ec7nh User-agent<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Lenh-Disallow\" >L\u1ec7nh Disallow<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-20\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Lenh-Allow\" >L\u1ec7nh Allow<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-21\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Lenh-Sitemap\" >L\u1ec7nh Sitemap<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-22\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cach-kiem-tra-website-co-file-robotstxt-hay-khong\" >C\u00e1ch ki\u1ec3m tra website c\u00f3 file robots.txt hay kh\u00f4ng<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-23\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Huong-dan-tao-file-robotstxt-don-gian\" >H\u01b0\u1edbng d\u1eabn t\u1ea1o file robots.txt \u0111\u01a1n gi\u1ea3n<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-24\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cach-1-Su-dung-Yoast-SEO\" >C\u00e1ch 1: S\u1eed d\u1ee5ng Yoast SEO<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-25\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cach-2-Qua-bo-Plugin-All-in-One-SEO\" >C\u00e1ch 2: Qua b\u1ed9 Plugin All in One SEO<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-26\" href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/#Cach-3-Tao-roi-upload-file-robotstxt-qua-FTP\" >C\u00e1ch 3: T\u1ea1o r\u1ed3i upload file robots.txt qua FTP<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<p>B\u1ea1n \u0111\u00e3 bao gi\u1edd nghe \u0111\u1ebfn &#8220;robots.txt&#8221; nh\u01b0ng ch\u01b0a th\u1ef1c s\u1ef1 hi\u1ec3u r\u00f5 v\u1ec1 n\u00f3? B\u1ea1n mu\u1ed1n <a href=\"https:\/\/interdata.vn\/blog\/website-la-gi\/\">website<\/a> c\u1ee7a m\u00ecnh th\u00e2n thi\u1ec7n h\u01a1n v\u1edbi c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm nh\u01b0 Google? N\u1ebfu c\u00e2u tr\u1ea3 l\u1eddi l\u00e0 &#8220;C\u00f3&#8221;, th\u00ec b\u00e0i vi\u1ebft n\u00e0y ch\u00ednh x\u00e1c l\u00e0 d\u00e0nh cho b\u1ea1n! H\u00e3y c\u00f9ng InterData kh\u00e1m ph\u00e1 t\u1ea5t t\u1ea7n t\u1eadt v\u1ec1 robots.txt l\u00e0 g\u00ec t\u1eeb c\u00e1ch th\u1ee9c ho\u1ea1t \u0111\u1ed9ng \u0111\u1ebfn c\u00e1c h\u01b0\u1edbng d\u1eabn t\u1ea1o file robots.txt tr\u00ean website. T\u00ecm hi\u1ec3u ngay!<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Robotstxt-la-gi\"><\/span>Robots.txt l\u00e0 g\u00ec?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><a href=\"https:\/\/interdata.vn\/blog\/robots-txt-la-gi\/\"><strong>Robots.txt<\/strong><\/a> l\u00e0 m\u1ed9t file text (.txt) \u0111\u01a1n gi\u1ea3n nh\u01b0ng mang tr\u1ecdng tr\u00e1ch quan tr\u1ecdng, n\u00f3 n\u1eb1m ngay t\u1ea1i th\u01b0 m\u1ee5c g\u1ed1c c\u1ee7a website. File Robots.txt c\u00f3 nhi\u1ec7m v\u1ee5 nh\u01b0 l\u00e0 \u201cng\u01b0\u1eddi g\u00e1c c\u1ed5ng\u201d hay &#8220;b\u1ea3n h\u01b0\u1edbng d\u1eabn&#8221; d\u00e0nh ri\u00eang cho c\u00e1c con b\u1ecd t\u00ecm ki\u1ebfm (c\u00f2n g\u1ecdi l\u00e0 web crawlers hay robots) c\u1ee7a c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm nh\u01b0 Googlebot c\u1ee7a Google, Bingbot c\u1ee7a Bing.<\/p>\n<figure id=\"attachment_22990\" aria-describedby=\"caption-attachment-22990\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Robots.txt-la-gi-1.png\" alt=\"Robots.txt l\u00e0 g\u00ec?\" width=\"800\" height=\"500\" class=\"size-full wp-image-22990\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Robots.txt-la-gi-1.png 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Robots.txt-la-gi-1-300x188.png 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Robots.txt-la-gi-1-768x480.png 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Robots.txt-la-gi-1-750x469.png 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22990\" class=\"wp-caption-text\">Robots.txt l\u00e0 g\u00ec?<\/figcaption><\/figure>\n<p>C\u00e1c con b\u1ecd t\u00ecm ki\u1ebfm tr\u00ean s\u1ebd tu\u00e2n th\u1ee7 c\u00e1c quy t\u1eafc c\u1ee7a t\u1ec7p robots.txt \u0111\u1ec3 thu th\u1eadp d\u1eef li\u1ec7u ph\u00f9 h\u1ee3p.<\/p>\n<p>Ch\u00fang ta th\u01b0\u1eddng hay nh\u1ea7m l\u1eabn gi\u1eefa sitemap v\u00e0 robots.txt, tuy nhi\u00ean, \u0111\u00e2y l\u00e0 2 lo\u1ea1i t\u1ec7p ho\u00e0n to\u00e0n kh\u00e1c nhau. Sitemap s\u1ebd gi\u00fap c\u00e1c con b\u1ecd d\u1ec5 d\u00e0ng thu th\u1eadp d\u1eef li\u1ec7u tr\u00ean <a href=\"https:\/\/interdata.vn\/blog\/page-la-gi\/\">trang web<\/a> h\u01a1n. C\u00f2n robots.txt s\u1ebd \u0111\u01b0a ra c\u00e1c quy t\u1eafc \u0111\u1ec3 gi\u1edbi h\u1ea1n quy\u1ec1n thu th\u1eadp d\u1eef li\u1ec7u c\u1ee7a ch\u00fang.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Muc-dich-chinh-cua-file-Robotstxt\"><\/span>M\u1ee5c \u0111\u00edch ch\u00ednh c\u1ee7a file Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>M\u1ee5c \u0111\u00edch ch\u00ednh c\u1ee7a file robots.txt l\u00e0 ki\u1ec3m so\u00e1t ho\u1ea1t \u0111\u1ed9ng thu th\u1eadp d\u1eef li\u1ec7u c\u1ee7a c\u00e1c con b\u1ecd t\u00ecm ki\u1ebfm, kh\u00f4ng cho ch\u00fang thu th\u1eadp d\u1eef li\u1ec7u \u1edf c\u00e1c th\u01b0 m\u1ee5c ho\u1eb7c c\u00e1c li\u00ean k\u1ebft ch\u1ec9 \u0111\u1ecbnh. C\u1ee5 th\u1ec3, file robots.txt c\u00f3 c\u00e1c m\u1ee5c \u0111\u00edch ch\u00ednh sau:<\/p>\n<ul>\n<li><strong>Ng\u0103n ch\u1eb7n thu th\u1eadp d\u1eef li\u1ec7u<\/strong>: Cho ph\u00e9p b\u1ea1n ch\u1ec9 \u0111\u1ecbnh nh\u1eefng ph\u1ea7n n\u00e0o c\u1ee7a website m\u00e0 b\u1ea1n kh\u00f4ng mu\u1ed1n c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm thu th\u1eadp th\u00f4ng tin. V\u00ed d\u1ee5: c\u00e1c trang \u0111ang trong qu\u00e1 tr\u00ecnh ph\u00e1t tri\u1ec3n, trang \u0111\u0103ng nh\u1eadp qu\u1ea3n tr\u1ecb, ho\u1eb7c c\u00e1c th\u01b0 m\u1ee5c ch\u1ee9a th\u00f4ng tin n\u1ed9i b\u1ed9.<\/li>\n<li><strong>T\u1ed1i \u01b0u h\u00f3a &#8220;Crawl Budget&#8221; (Ng\u00e2n s\u00e1ch thu th\u1eadp d\u1eef li\u1ec7u)<\/strong>: M\u1ed7i website c\u00f3 m\u1ed9t &#8220;ng\u00e2n s\u00e1ch thu th\u1eadp d\u1eef li\u1ec7u&#8221; nh\u1ea5t \u0111\u1ecbnh t\u1eeb c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm. B\u1eb1ng c\u00e1ch ch\u1eb7n c\u00e1c trang kh\u00f4ng quan tr\u1ecdng, b\u1ea1n gi\u00fap bot t\u1eadp trung thu th\u1eadp d\u1eef li\u1ec7u c\u00e1c trang quan tr\u1ecdng h\u01a1n, c\u1ea3i thi\u1ec7n hi\u1ec7u qu\u1ea3 <a href=\"https:\/\/interdata.vn\/blog\/seo-la-gi\/\">SEO<\/a>.<\/li>\n<li><strong>Tr\u00e1nh tr\u00f9ng l\u1eb7p n\u1ed9i dung<\/strong>: Ng\u0103n ch\u1eb7n c\u00e1c phi\u00ean b\u1ea3n tr\u00f9ng l\u1eb7p c\u1ee7a trang web (v\u00ed d\u1ee5: phi\u00ean b\u1ea3n in, phi\u00ean b\u1ea3n d\u00e0nh cho thi\u1ebft b\u1ecb di \u0111\u1ed9ng) b\u1ecb thu th\u1eadp v\u00e0 l\u1eadp ch\u1ec9 m\u1ee5c.<\/li>\n<li><strong>Ch\u1ec9 \u0111\u1ecbnh v\u1ecb tr\u00ed Sitemap<\/strong>: Gi\u00fap c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm d\u1ec5 d\u00e0ng t\u00ecm th\u1ea5y sitemap XML c\u1ee7a website, t\u1eeb \u0111\u00f3 thu th\u1eadp d\u1eef li\u1ec7u v\u00e0 l\u1eadp ch\u1ec9 m\u1ee5c trang web c\u1ee7a b\u1ea1n \u0111\u1ea7y \u0111\u1ee7 v\u00e0 nhanh ch\u00f3ng h\u01a1n.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"Robotstxt-van-hanh-nhu-the-nao\"><\/span>Robots.txt v\u1eadn h\u00e0nh nh\u01b0 th\u1ebf n\u00e0o?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Robots.txt ho\u1ea1t \u0111\u1ed9ng nh\u01b0 th\u1ebf n\u00e0o? C\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm \u0111\u1ea3m nh\u1eadn hai nhi\u1ec7m v\u1ee5 ch\u00ednh:<\/p>\n<ul>\n<li>\u00a0Crawl (thu th\u1eadp\/ph\u00e2n t\u00edch) d\u1eef li\u1ec7u tr\u00ean website nh\u1eb1m kh\u00e1m ph\u00e1 n\u1ed9i dung.<\/li>\n<li>\u00a0L\u1eadp ch\u1ec9 m\u1ee5c n\u1ed9i dung \u0111\u1ec3 ph\u1ee5c v\u1ee5 c\u00e1c y\u00eau c\u1ea7u t\u00ecm ki\u1ebfm t\u1eeb ph\u00eda ng\u01b0\u1eddi d\u00f9ng.<\/li>\n<\/ul>\n<p>\u0110\u1ec3 thu th\u1eadp d\u1eef li\u1ec7u t\u1eeb website, c\u00e1c c\u00f4ng c\u1ee5 s\u1ebd l\u1ea7n theo c\u00e1c li\u00ean k\u1ebft t\u1eeb trang n\u00e0y sang trang kh\u00e1c. Cu\u1ed1i c\u00f9ng, d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c thu th\u1eadp t\u1eeb h\u00e0ng t\u1ef7 trang web kh\u00e1c nhau.<\/p>\n<p>Qu\u00e1 tr\u00ecnh thu th\u1eadp d\u1eef li\u1ec7u n\u00e0y c\u00f2n \u0111\u01b0\u1ee3c g\u1ecdi b\u1eb1ng m\u1ed9t t\u00ean kh\u00e1c l\u00e0 \u201c<strong>Spidering<\/strong>\u201d. Khi ti\u1ebfp c\u1eadn m\u1ed9t trang web, tr\u01b0\u1edbc khi ti\u1ebfn h\u00e0nh spidering, c\u00e1c bot c\u1ee7a Google s\u1ebd t\u00ecm ki\u1ebfm file robots.txt trong <a href=\"https:\/\/interdata.vn\/blog\/wordpress-la-gi\/\">WordPress<\/a>. N\u1ebfu ph\u00e1t hi\u1ec7n file robots.txt, ch\u00fang s\u1ebd \u0111\u1ecdc t\u1ec7p n\u00e0y tr\u01b0\u1edbc khi th\u1ef1c hi\u1ec7n c\u00e1c b\u01b0\u1edbc ti\u1ebfp theo.<\/p>\n<p>File robots.txt bao g\u1ed3m th\u00f4ng tin h\u01b0\u1edbng d\u1eabn c\u00e1ch Google thu th\u1eadp d\u1eef li\u1ec7u t\u1eeb website.\u00a0T\u1ea1i \u0111\u00e2y, c\u00e1c bot s\u1ebd nh\u1eadn \u0111\u01b0\u1ee3c th\u00eam c\u00e1c ch\u1ec9 d\u1eabn chi ti\u1ebft ph\u1ee5c v\u1ee5 qu\u00e1 tr\u00ecnh thu th\u1eadp d\u1eef li\u1ec7u.<\/p>\n<p>N\u1ebfu file robots.txt kh\u00f4ng c\u00f3 ch\u1ec9 th\u1ecb n\u00e0o d\u00e0nh cho User-agent ho\u1eb7c b\u1ea1n kh\u00f4ng t\u1ea1o file n\u00e0y cho website, c\u00e1c bot s\u1ebd t\u1ef1 \u0111\u1ed9ng thu th\u1eadp nh\u1eefng th\u00f4ng tin kh\u00e1c tr\u00ean trang web.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cong-dung-cua-robotstxt-la-gi-trong-SEO\"><\/span>C\u00f4ng d\u1ee5ng c\u1ee7a robots.txt l\u00e0 g\u00ec trong SEO<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Robots.txt c\u00f3 \u1ea3nh h\u01b0\u1edfng \u0111\u1ebfn seo kh\u00f4ng? Robots.txt tuy ch\u1ec9 l\u00e0 m\u1ed9t file text \u0111\u01a1n thu\u1ea7n, nh\u01b0ng l\u1ea1i c\u00f3 c\u00f4ng d\u1ee5ng \u0111\u1eb7c bi\u1ec7t trong SEO. D\u01b0\u1edbi \u0111\u00e2y l\u00e0 m\u1ed9t s\u1ed1 c\u00f4ng d\u1ee5ng tuy\u1ec7t v\u1eddi m\u00e0 robots.txt mang l\u1ea1i cho website c\u1ee7a b\u1ea1n.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Chan-bot-tim-kiem-khi-website-dang-xay-dung\"><\/span>Ch\u1eb7n bot t\u00ecm ki\u1ebfm khi website \u0111ang x\u00e2y d\u1ef1ng<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Khi website c\u1ee7a b\u1ea1n c\u00f2n \u0111ang trong giai \u0111o\u1ea1n &#8220;thai ngh\u00e9n&#8221;, ch\u01b0a ho\u00e0n thi\u1ec7n, b\u1ea1n ch\u1eafc ch\u1eafn kh\u00f4ng mu\u1ed1n c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm thu th\u1eadp d\u1eef li\u1ec7u v\u00e0 l\u1eadp ch\u1ec9 m\u1ee5c, \u0111\u1ec3 l\u1ed9 nh\u1eefng th\u00f4ng tin ch\u01b0a ho\u00e0n ch\u1ec9nh. L\u00fac n\u00e0y, robots.txt s\u1ebd l\u00e0 &#8220;v\u1ec7 s\u0129&#8221; \u0111\u1eafc l\u1ef1c, gi\u00fap b\u1ea1n t\u1ea1m th\u1eddi &#8220;\u0111\u00f3ng c\u1eeda&#8221; website v\u1edbi c\u00e1c con b\u1ecd t\u00ecm ki\u1ebfm.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Khai-bao-Sitemap-voi-bot-tim-kiem\"><\/span>Khai b\u00e1o Sitemap v\u1edbi bot t\u00ecm ki\u1ebfm<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Sitemap gi\u1ed1ng nh\u01b0 m\u1ed9t &#8220;b\u1ea3n \u0111\u1ed3&#8221; chi ti\u1ebft c\u1ee7a website, gi\u00fap c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm d\u1ec5 d\u00e0ng kh\u00e1m ph\u00e1 v\u00e0 l\u1eadp ch\u1ec9 m\u1ee5c to\u00e0n b\u1ed9 c\u00e1c trang. B\u1eb1ng c\u00e1ch khai b\u00e1o sitemap trong file robots.txt, b\u1ea1n \u0111\u00e3 &#8220;d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i&#8221; cho c\u00e1c con b\u1ecd, gi\u00fap ch\u00fang thu th\u1eadp d\u1eef li\u1ec7u website c\u1ee7a b\u1ea1n m\u1ed9t c\u00e1ch nhanh ch\u00f3ng v\u00e0 hi\u1ec7u qu\u1ea3 h\u01a1n bao gi\u1edd h\u1ebft.<\/p>\n<figure id=\"attachment_22991\" aria-describedby=\"caption-attachment-22991\" style=\"width: 900px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cong-dung-cua-robots.txt-la-gi-trong-SEO.png\" alt=\"C\u00f4ng d\u1ee5ng c\u1ee7a robots.txt l\u00e0 g\u00ec trong SEO\" width=\"900\" height=\"680\" class=\"size-full wp-image-22991\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cong-dung-cua-robots.txt-la-gi-trong-SEO.png 900w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cong-dung-cua-robots.txt-la-gi-trong-SEO-300x227.png 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cong-dung-cua-robots.txt-la-gi-trong-SEO-768x580.png 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cong-dung-cua-robots.txt-la-gi-trong-SEO-750x567.png 750w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><figcaption id=\"caption-attachment-22991\" class=\"wp-caption-text\">C\u00f4ng d\u1ee5ng c\u1ee7a robots.txt l\u00e0 g\u00ec trong SEO<\/figcaption><\/figure>\n<h3><span class=\"ez-toc-section\" id=\"Ngan-chan-bot-quet-backlink-it-hieu-qua\"><\/span>Ng\u0103n ch\u1eb7n bot qu\u00e9t backlink (\u00edt hi\u1ec7u qu\u1ea3)<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>M\u1ed9t s\u1ed1 ng\u01b0\u1eddi d\u00f9ng l\u1ee3i d\u1ee5ng robots.txt \u0111\u1ec3 ng\u0103n ch\u1eb7n bot t\u00ecm ki\u1ebfm truy c\u1eadp c\u00e1c backlink. Tuy nhi\u00ean, c\u00e1c chuy\u00ean gia SEO \u0111\u00e1nh gi\u00e1 c\u00e1ch l\u00e0m n\u00e0y l\u00e0 \u00edt hi\u1ec7u qu\u1ea3 v\u00e0 khuy\u00ean ch\u00fang ta kh\u00f4ng n\u00ean l\u00e0m.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Chan-cac-thu-muc-can-bao-mat\"><\/span>Ch\u1eb7n c\u00e1c th\u01b0 m\u1ee5c c\u1ea7n b\u1ea3o m\u1eadt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>N\u1ebfu website c\u1ee7a b\u1ea1n c\u00f3 nh\u1eefng th\u01b0 m\u1ee5c ch\u1ee9a th\u00f4ng tin nh\u1ea1y c\u1ea3m, c\u1ea7n \u0111\u01b0\u1ee3c b\u1ea3o m\u1eadt nh\u01b0 trang qu\u1ea3n tr\u1ecb, trang thanh to\u00e1n, trang ch\u1ee9a d\u1eef li\u1ec7u kh\u00e1ch h\u00e0ng,&#8230; th\u00ec robots.txt ch\u00ednh l\u00e0 &#8220;\u1ed5 kh\u00f3a&#8221; an to\u00e0n, gi\u00fap b\u1ea1n ng\u0103n ch\u1eb7n c\u00e1c con b\u1ecd t\u00ecm ki\u1ebfm &#8220;t\u00f2 m\u00f2&#8221; gh\u00e9 th\u0103m.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Chan-cac-ma-doc-hai\"><\/span>Ch\u1eb7n c\u00e1c m\u00e3 \u0111\u1ed9c h\u1ea1i<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Robots.txt c\u00f3 th\u1ec3 gi\u00fap b\u1ea1n ch\u1eb7n c\u00e1c con b\u1ecd \u0111\u1ed9c h\u1ea1i, ng\u0103n ch\u00fang qu\u00e9t v\u00e0 thu th\u1eadp th\u00f4ng tin t\u1eeb website c\u1ee7a b\u1ea1n, h\u1ea1n ch\u1ebf nguy c\u01a1 b\u1ecb t\u1ea5n c\u00f4ng v\u00e0 \u0111\u00e1nh c\u1eafp d\u1eef li\u1ec7u. Tuy nhi\u00ean, c\u1ea7n l\u01b0u \u00fd r\u1eb1ng robots.txt kh\u00f4ng ph\u1ea3i l\u00e0 m\u1ed9t gi\u1ea3i ph\u00e1p b\u1ea3o m\u1eadt to\u00e0n di\u1ec7n, b\u1ea1n n\u00ean k\u1ebft h\u1ee3p v\u1edbi c\u00e1c bi\u1ec7n ph\u00e1p b\u1ea3o m\u1eadt kh\u00e1c \u0111\u1ec3 b\u1ea3o v\u1ec7 website t\u1ed1t h\u01a1n.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Chan-bo-doi-voi-cac-trang-thuong-mai-dien-tu\"><\/span>Ch\u1eb7n b\u1ecd \u0111\u1ed1i v\u1edbi c\u00e1c trang th\u01b0\u01a1ng m\u1ea1i \u0111i\u1ec7n t\u1eed<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0110\u1ed1i v\u1edbi c\u00e1c trang th\u01b0\u01a1ng m\u1ea1i \u0111i\u1ec7n t\u1eed, robots.txt c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng \u0111\u1ec3 ch\u1eb7n c\u00e1c con b\u1ecd thu th\u1eadp d\u1eef li\u1ec7u t\u1eeb c\u00e1c trang nh\u01b0 gi\u1ecf h\u00e0ng, trang thanh to\u00e1n, trang t\u00e0i kho\u1ea3n c\u00e1 nh\u00e2n,&#8230; Vi\u1ec7c n\u00e0y gi\u00fap t\u1ed1i \u01b0u h\u00f3a &#8220;crawl budget&#8221;, \u0111\u1ec3 c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm t\u1eadp trung thu th\u1eadp d\u1eef li\u1ec7u c\u00e1c trang s\u1ea3n ph\u1ea9m, danh m\u1ee5c s\u1ea3n ph\u1ea9m, t\u1eeb \u0111\u00f3 c\u1ea3i thi\u1ec7n th\u1ee9 h\u1ea1ng SEO.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"File-robotstxt-duoc-dat-o-vi-tri-nao-tren-mot-website\"><\/span>File robots.txt \u0111\u01b0\u1ee3c \u0111\u1eb7t \u1edf v\u1ecb tr\u00ed n\u00e0o tr\u00ean m\u1ed9t website?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Khi b\u1ea1n x\u00e2y d\u1ef1ng website WordPress, h\u1ec7 th\u1ed1ng s\u1ebd t\u1ef1 \u0111\u1ed9ng t\u1ea1o file robots.txt v\u00e0 \u0111\u1eb7t n\u00f3 \u1edf th\u01b0 m\u1ee5c g\u1ed1c c\u1ee7a <a href=\"https:\/\/interdata.vn\/blog\/may-chu-server-la-gi\/\">server<\/a>.<\/p>\n<p>Ch\u1eb3ng h\u1ea1n, n\u1ebfu website c\u1ee7a b\u1ea1n n\u1eb1m trong th\u01b0 m\u1ee5c g\u1ed1c t\u1ea1i \u0111\u1ecba ch\u1ec9 interdata.vn, b\u1ea1n c\u00f3 th\u1ec3 truy c\u1eadp file robots.txt th\u00f4ng qua \u0111\u01b0\u1eddng d\u1eabn interdata.vn\/robots.txt, v\u1edbi n\u1ed9i dung ban \u0111\u1ea7u nh\u01b0 sau:<\/p>\n<pre>User-agent: *\r\nDisallow: \/wp-admin\/\r\nDisallow: \/wp-includes\/<\/pre>\n<p>Nh\u01b0 \u0111\u00e3 \u0111\u1ec1 c\u1eadp, d\u1ea5u * sau User-agent: bi\u1ec3u th\u1ecb r\u1eb1ng quy t\u1eafc \u00e1p d\u1ee5ng cho t\u1ea5t c\u1ea3 c\u00e1c lo\u1ea1i bot tr\u00ean to\u00e0n b\u1ed9 website. Trong t\u00ecnh hu\u1ed1ng n\u00e0y, file robots.txt s\u1ebd ch\u1ec9 d\u1eabn c\u00e1c bot kh\u00f4ng \u0111\u01b0\u1ee3c truy c\u1eadp v\u00e0o c\u00e1c th\u01b0 m\u1ee5c wp-admin v\u00e0 wp-includes. \u0110i\u1ec1u n\u00e0y r\u1ea5t h\u1ee3p l\u00fd, b\u1edfi hai th\u01b0 m\u1ee5c tr\u00ean l\u01b0u tr\u1eef nhi\u1ec1u t\u1ec7p th\u00f4ng tin nh\u1ea1y c\u1ea3m.<\/p>\n<figure id=\"attachment_22992\" aria-describedby=\"caption-attachment-22992\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/File-robots.txt-nam-o-dau-tren-mot-website.webp\" alt=\"File robots.txt n\u1eb1m \u1edf \u0111\u00e2u tr\u00ean m\u1ed9t website\" width=\"800\" height=\"371\" class=\"size-full wp-image-22992\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/File-robots.txt-nam-o-dau-tren-mot-website.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/File-robots.txt-nam-o-dau-tren-mot-website-300x139.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/File-robots.txt-nam-o-dau-tren-mot-website-768x356.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/File-robots.txt-nam-o-dau-tren-mot-website-750x348.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22992\" class=\"wp-caption-text\">File robots.txt n\u1eb1m \u1edf \u0111\u00e2u tr\u00ean m\u1ed9t website<\/figcaption><\/figure>\n<p>L\u01b0u \u00fd r\u1eb1ng \u0111\u00e2y l\u00e0 m\u1ed9t file \u1ea3o, \u0111\u01b0\u1ee3c WordPress thi\u1ebft l\u1eadp t\u1ef1 \u0111\u1ed9ng trong qu\u00e1 tr\u00ecnh c\u00e0i \u0111\u1eb7t v\u00e0 kh\u00f4ng th\u1ec3 ch\u1ec9nh s\u1eeda (d\u00f9 n\u00f3 v\u1eabn ho\u1ea1t \u0111\u1ed9ng b\u00ecnh th\u01b0\u1eddng). Th\u00f4ng th\u01b0\u1eddng, file robots.txt chu\u1ea9n c\u1ee7a WordPress \u0111\u01b0\u1ee3c l\u01b0u trong th\u01b0 m\u1ee5c g\u1ed1c, th\u01b0\u1eddng \u0111\u01b0\u1ee3c g\u1ecdi l\u00e0 public_html, <a href=\"https:\/\/interdata.vn\/blog\/world-wide-web\/\">www<\/a>, ho\u1eb7c t\u00ean website.<\/p>\n<p>\u0110\u1ec3 thi\u1ebft l\u1eadp m\u1ed9t file robots.txt ri\u00eang, b\u1ea1n c\u1ea7n t\u1ea1o m\u1ed9t file m\u1edbi v\u00e0 thay th\u1ebf file c\u0169 trong th\u01b0 m\u1ee5c g\u1ed1c.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cac-vi-du-ve-file-Robotstxt-thuong-gap\"><\/span>C\u00e1c v\u00ed d\u1ee5 v\u1ec1 file Robots.txt th\u01b0\u1eddng g\u1eb7p<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>D\u01b0\u1edbi \u0111\u00e2y l\u00e0 m\u1ed9t s\u1ed1 v\u00ed d\u1ee5 v\u1ec1 file robots.txt ph\u1ed5 bi\u1ebfn m\u00e0 b\u1ea1n c\u00f3 th\u1ec3 tham kh\u1ea3o:<\/p>\n<p>Cho ph\u00e9p t\u1ea5t c\u1ea3 c\u00e1c bot truy c\u1eadp to\u00e0n b\u1ed9 website:<\/p>\n<pre>User-agent: *\r\nAllow: \/<\/pre>\n<p>Ch\u1eb7n t\u1ea5t c\u1ea3 c\u00e1c bot truy c\u1eadp to\u00e0n b\u1ed9 website:<\/p>\n<pre>User-agent: *\r\nDisallow: \/<\/pre>\n<p>Ch\u1eb7n bot truy c\u1eadp v\u00e0o th\u01b0 m\u1ee5c \/admin\/ v\u00e0 file \/private.html:<\/p>\n<pre>User-agent: *\r\nDisallow: \/admin\/\r\nDisallow: \/private.html<\/pre>\n<p>Ch\u1ec9 cho ph\u00e9p Googlebot truy c\u1eadp v\u00e0o th\u01b0 m\u1ee5c \/public\/, c\u00f2n l\u1ea1i ch\u1eb7n t\u1ea5t c\u1ea3:<\/p>\n<pre>User-agent: Googlebot\r\nAllow: \/public\/\r\n\r\nUser-agent: *\r\nDisallow: \/<\/pre>\n<p>Khai b\u00e1o sitemap:<\/p>\n<pre>User-agent: *\r\nAllow: \/\r\n\r\nSitemap: <a href=\"https:\/\/interdata.vn\/blog\/giao-thuc-https-la-gi\/\">https<\/a>:\/\/www.example.com\/sitemap.xml\r\nSitemap: https:\/\/www.example.com\/sitemap_index.xml<\/pre>\n<h2><span class=\"ez-toc-section\" id=\"Nhung-han-che-cua-robotstxt-nen-chu-y\"><\/span>Nh\u1eefng h\u1ea1n ch\u1ebf c\u1ee7a robots.txt n\u00ean ch\u00fa \u00fd<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>M\u1eb7c d\u00f9 robots.txt l\u00e0 m\u1ed9t c\u00f4ng c\u1ee5 h\u1eefu \u00edch, nh\u01b0ng n\u00f3 c\u0169ng c\u00f3 m\u1ed9t s\u1ed1 h\u1ea1n ch\u1ebf nh\u1ea5t \u0111\u1ecbnh m\u00e0 b\u1ea1n c\u1ea7n l\u01b0u \u00fd:<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Mot-vai-trinh-duyet-tim-kiem-khong-ho-tro-cac-lenh-trong-tep-robotstxt\"><\/span>M\u1ed9t v\u00e0i tr\u00ecnh duy\u1ec7t t\u00ecm ki\u1ebfm kh\u00f4ng h\u1ed7 tr\u1ee3 c\u00e1c l\u1ec7nh trong t\u1ec7p robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Kh\u00f4ng ph\u1ea3i tr\u00ecnh duy\u1ec7t t\u00ecm ki\u1ebfm n\u00e0o c\u0169ng &#8220;nghe l\u1eddi&#8221; robots.txt. M\u1ed9t s\u1ed1 tr\u00ecnh duy\u1ec7t t\u00ecm ki\u1ebfm, \u0111\u1eb7c bi\u1ec7t l\u00e0 c\u00e1c tr\u00ecnh duy\u1ec7t nh\u1ecf ho\u1eb7c c\u00e1c bot \u0111\u1ed9c h\u1ea1i, c\u00f3 th\u1ec3 ph\u1edbt l\u1edd c\u00e1c ch\u1ec9 th\u1ecb trong file robots.txt v\u00e0 v\u1eabn thu th\u1eadp d\u1eef li\u1ec7u website c\u1ee7a b\u1ea1n nh\u01b0 b\u00ecnh th\u01b0\u1eddng.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Cac-trinh-du-lieu-co-cu-phap-phan-tich-du-lieu-rieng\"><\/span>C\u00e1c tr\u00ecnh d\u1eef li\u1ec7u c\u00f3 c\u00fa ph\u00e1p ph\u00e2n t\u00edch d\u1eef li\u1ec7u ri\u00eang<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>M\u1ed7i tr\u00ecnh thu th\u1eadp d\u1eef li\u1ec7u (crawler) c\u00f3 th\u1ec3 di\u1ec5n gi\u1ea3i c\u00e1c l\u1ec7nh trong robots.txt theo c\u00e1ch ri\u00eang c\u1ee7a ch\u00fang, kh\u00f4ng ho\u00e0n to\u00e0n gi\u1ed1ng nhau. \u0110i\u1ec1u n\u00e0y c\u00f3 th\u1ec3 d\u1eabn \u0111\u1ebfn vi\u1ec7c m\u1ed9t s\u1ed1 bot hi\u1ec3u sai ch\u1ec9 th\u1ecb c\u1ee7a b\u1ea1n, d\u1eabn \u0111\u1ebfn thu th\u1eadp d\u1eef li\u1ec7u kh\u00f4ng nh\u01b0 \u00fd mu\u1ed1n.<\/p>\n<figure id=\"attachment_22993\" aria-describedby=\"caption-attachment-22993\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhung-han-che-cua-robots.txt-nen-chu-y.png\" alt=\"Nh\u1eefng h\u1ea1n ch\u1ebf c\u1ee7a robots.txt n\u00ean ch\u00fa \u00fd\" width=\"800\" height=\"500\" class=\"size-full wp-image-22993\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhung-han-che-cua-robots.txt-nen-chu-y.png 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhung-han-che-cua-robots.txt-nen-chu-y-300x188.png 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhung-han-che-cua-robots.txt-nen-chu-y-768x480.png 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhung-han-che-cua-robots.txt-nen-chu-y-750x469.png 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22993\" class=\"wp-caption-text\">Nh\u1eefng h\u1ea1n ch\u1ebf c\u1ee7a robots.txt n\u00ean ch\u00fa \u00fd<\/figcaption><\/figure>\n<h3><span class=\"ez-toc-section\" id=\"Bi-tep-robotstxt-chan-nhung-van-co-the-index-Google\"><\/span>B\u1ecb t\u1ec7p robots.txt ch\u1eb7n nh\u01b0ng v\u1eabn c\u00f3 th\u1ec3 index Google<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0110i\u1ec1u n\u00e0y nghe c\u00f3 v\u1ebb v\u00f4 l\u00fd, nh\u01b0ng l\u1ea1i ho\u00e0n to\u00e0n c\u00f3 th\u1ec3 x\u1ea3y ra. D\u00f9 b\u1ea1n \u0111\u00e3 ch\u1eb7n m\u1ed9t trang b\u1eb1ng robots.txt, Google v\u1eabn c\u00f3 th\u1ec3 l\u1eadp ch\u1ec9 m\u1ee5c trang \u0111\u00f3 n\u1ebfu n\u00f3 \u0111\u01b0\u1ee3c li\u00ean k\u1ebft \u0111\u1ebfn t\u1eeb c\u00e1c trang web kh\u00e1c.<\/p>\n<p>Trong tr\u01b0\u1eddng h\u1ee3p robots.txt ch\u1eb7n, Google s\u1ebd kh\u00f4ng thu th\u1eadp d\u1eef li\u1ec7u trang \u0111\u00f3, nh\u01b0ng v\u1eabn c\u00f3 th\u1ec3 hi\u1ec3n th\u1ecb n\u00f3 trong k\u1ebft qu\u1ea3 t\u00ecm ki\u1ebfm v\u1edbi ti\u00eau \u0111\u1ec1 v\u00e0 m\u00f4 t\u1ea3 tr\u1ed1ng. \u0110\u1ec3 ng\u0103n ch\u1eb7n vi\u1ec7c n\u00e0y, b\u1ea1n n\u00ean s\u1eed d\u1ee5ng th\u1ebb meta robots &#8220;noindex&#8221;.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cac-lenh-duoc-ho-tro-boi-Googlebot-trong-robotstxt\"><\/span>C\u00e1c l\u1ec7nh \u0111\u01b0\u1ee3c h\u1ed7 tr\u1ee3 b\u1edfi Googlebot trong robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Googlebot, &#8220;chi\u1ebfn binh&#8221; thu th\u1eadp d\u1eef li\u1ec7u c\u1ee7a Google, h\u1ed7 tr\u1ee3 m\u1ed9t s\u1ed1 l\u1ec7nh (hay c\u00f2n g\u1ecdi l\u00e0 ch\u1ec9 th\u1ecb) trong file robots.txt. Hi\u1ec3u r\u00f5 c\u00e1c l\u1ec7nh n\u00e0y s\u1ebd gi\u00fap b\u1ea1n &#8220;giao ti\u1ebfp&#8221; hi\u1ec7u qu\u1ea3 v\u1edbi Googlebot, t\u1ed1i \u01b0u h\u00f3a SEO cho website.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Lenh-User-agent\"><\/span>L\u1ec7nh User-agent<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>L\u1ec7nh User-agent d\u00f9ng \u0111\u1ec3 ch\u1ec9 \u0111\u1ecbnh bot n\u00e0o s\u1ebd tu\u00e2n theo c\u00e1c quy t\u1eafc \u0111\u01b0\u1ee3c \u0111\u1eb7t ra. M\u1ed7i bot c\u1ee7a c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm kh\u00e1c nhau s\u1ebd c\u00f3 m\u1ed9t t\u00ean user-agent ri\u00eang.<\/p>\n<p>V\u00ed d\u1ee5:<\/p>\n<ul>\n<li><strong>User-agent<\/strong>: * : \u00c1p d\u1ee5ng cho t\u1ea5t c\u1ea3 c\u00e1c bot.<\/li>\n<li><strong>User-agent<\/strong>: Googlebot: \u00c1p d\u1ee5ng cho Googlebot.<\/li>\n<li><strong>User-agent<\/strong>: Googlebot-Image: \u00c1p d\u1ee5ng cho Googlebot thu th\u1eadp h\u00ecnh \u1ea3nh.<\/li>\n<li><strong>User-agent<\/strong>: Bingbot: \u00c1p d\u1ee5ng cho bot c\u1ee7a Bing.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"Lenh-Disallow\"><\/span>L\u1ec7nh Disallow<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>L\u1ec7nh Disallow l\u00e0 &#8220;bi\u1ec3n c\u1ea5m&#8221;, d\u00f9ng \u0111\u1ec3 ng\u0103n ch\u1eb7n bot truy c\u1eadp v\u00e0o c\u00e1c th\u01b0 m\u1ee5c ho\u1eb7c trang c\u1ee5 th\u1ec3 tr\u00ean website c\u1ee7a b\u1ea1n.<\/p>\n<p>V\u00ed d\u1ee5:<\/p>\n<ul>\n<li><strong>Disallow: \/admin\/<\/strong>: Ch\u1eb7n bot truy c\u1eadp v\u00e0o th\u01b0 m\u1ee5c \/admin\/.<\/li>\n<li><strong>Disallow: \/private.html<\/strong>: Ch\u1eb7n bot truy c\u1eadp v\u00e0o file \/private.html.<\/li>\n<li><strong>Disallow: \/*.pdf$<\/strong>: Ch\u1eb7n bot truy c\u1eadp v\u00e0o t\u1ea5t c\u1ea3 c\u00e1c file c\u00f3 \u0111u\u00f4i .pdf.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"Lenh-Allow\"><\/span>L\u1ec7nh Allow<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>L\u1ec7nh Allow l\u00e0 &#8220;\u0111\u00e8n xanh&#8221;, cho ph\u00e9p bot truy c\u1eadp v\u00e0o c\u00e1c th\u01b0 m\u1ee5c ho\u1eb7c trang c\u1ee5 th\u1ec3, ngay c\u1ea3 khi ch\u00fang n\u1eb1m trong th\u01b0 m\u1ee5c \u0111\u00e3 b\u1ecb ch\u1eb7n b\u1edfi l\u1ec7nh Disallow. L\u1ec7nh Allow th\u01b0\u1eddng \u0111\u01b0\u1ee3c d\u00f9ng \u0111\u1ec3 ghi \u0111\u00e8 (override) l\u1ec7nh Disallow.<\/p>\n<p>V\u00ed d\u1ee5:<\/p>\n<ul>\n<li><strong>Disallow<\/strong>: \/admin\/<\/li>\n<li>\u00a0<strong>* `Allow<\/strong>: \/admin\/public\/`: Ch\u1eb7n t\u1ea5t c\u1ea3 c\u00e1c th\u01b0 m\u1ee5c, file trong \/admin\/ ngo\u1ea1i tr\u1eeb th\u01b0 m\u1ee5c \/admin\/public\/.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"Lenh-Sitemap\"><\/span>L\u1ec7nh Sitemap<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>L\u1ec7nh Sitemap d\u00f9ng \u0111\u1ec3 khai b\u00e1o v\u1ecb tr\u00ed c\u1ee7a sitemap XML tr\u00ean website c\u1ee7a b\u1ea1n. Sitemap gi\u1ed1ng nh\u01b0 m\u1ed9t b\u1ea3n \u0111\u1ed3 chi ti\u1ebft, gi\u00fap c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm d\u1ec5 d\u00e0ng kh\u00e1m ph\u00e1 v\u00e0 l\u1eadp ch\u1ec9 m\u1ee5c t\u1ea5t c\u1ea3 c\u00e1c trang tr\u00ean website.<\/p>\n<p>V\u00ed d\u1ee5:<\/p>\n<ul>\n<li><strong>Sitemap<\/strong>: https:\/\/www.example.com\/sitemap.xml<\/li>\n<li><strong>Sitemap<\/strong>: https:\/\/www.example.com\/sitemap_index.xml<\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Cach-kiem-tra-website-co-file-robotstxt-hay-khong\"><\/span>C\u00e1ch ki\u1ec3m tra website c\u00f3 file robots.txt hay kh\u00f4ng<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0110\u1ec3 ki\u1ec3m tra xem website c\u1ee7a b\u1ea1n c\u00f3 t\u1ec7p robots.txt hay kh\u00f4ng, b\u1ea1n ch\u1ec9 c\u1ea7n nh\u1eadp <a href=\"https:\/\/interdata.vn\/blog\/domain-la-gi\/\">t\u00ean mi\u1ec1n<\/a> g\u1ed1c (Root Domain) c\u1ee7a website, sau \u0111\u00f3 th\u00eam &#8220;<strong>\/robots.txt<\/strong>&#8221; v\u00e0o cu\u1ed1i \u0111\u1ecba ch\u1ec9 URL. N\u1ebfu tr\u00ecnh duy\u1ec7t kh\u00f4ng hi\u1ec3n th\u1ecb n\u1ed9i dung c\u1ee7a t\u1ec7p .txt, \u0111i\u1ec1u \u0111\u00f3 c\u00f3 ngh\u0129a l\u00e0 website c\u1ee7a b\u1ea1n ch\u01b0a \u0111\u01b0\u1ee3c thi\u1ebft l\u1eadp t\u1ec7p robots.txt. Thao t\u00e1c n\u00e0y r\u1ea5t \u0111\u01a1n gi\u1ea3n!<\/p>\n<p>V\u00ed d\u1ee5, \u0111\u1ec3 ki\u1ec3m tra xem website interdata.vn c\u00f3 t\u1ec7p robots.txt hay kh\u00f4ng, b\u1ea1n c\u0169ng th\u1ef1c hi\u1ec7n t\u01b0\u01a1ng t\u1ef1:<\/p>\n<p><strong>B\u01b0\u1edbc 1<\/strong>: Nh\u1eadp t\u00ean mi\u1ec1n g\u1ed1c (v\u00ed d\u1ee5: interdata.vn).<\/p>\n<p><strong>B\u01b0\u1edbc 2<\/strong>: Th\u00eam &#8220;<strong>\/robots.txt<\/strong>&#8221; v\u00e0o cu\u1ed1i (interdata.vn\/\/robots.txt]).<\/p>\n<p><strong>B\u01b0\u1edbc 3<\/strong>: Nh\u1ea5n <strong>Enter<\/strong>.<\/p>\n<p>K\u1ebft qu\u1ea3 hi\u1ec3n th\u1ecb s\u1ebd cho b\u1ea1n bi\u1ebft website \u0111\u00f3 c\u00f3 t\u1ec7p robots.txt hay kh\u00f4ng.<\/p>\n<figure id=\"attachment_22982\" aria-describedby=\"caption-attachment-22982\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cach-kiem-tra-website-co-file-robots.txt-hay-khong.png\" alt=\"C\u00e1ch ki\u1ec3m tra website c\u00f3 file robots.txt hay kh\u00f4ng\" width=\"500\" height=\"236\" class=\"size-full wp-image-22982\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cach-kiem-tra-website-co-file-robots.txt-hay-khong.png 500w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Cach-kiem-tra-website-co-file-robots.txt-hay-khong-300x142.png 300w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><figcaption id=\"caption-attachment-22982\" class=\"wp-caption-text\">C\u00e1ch ki\u1ec3m tra website c\u00f3 file robots.txt hay kh\u00f4ng<\/figcaption><\/figure>\n<h2><span class=\"ez-toc-section\" id=\"Huong-dan-tao-file-robotstxt-don-gian\"><\/span>H\u01b0\u1edbng d\u1eabn t\u1ea1o file robots.txt \u0111\u01a1n gi\u1ea3n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>T\u1ea1o file robots.txt kh\u00f4ng h\u1ec1 kh\u00f3 nh\u01b0 b\u1ea1n ngh\u0129. Vi\u1ec7c t\u1ea1o file robots.txt WordPress mang l\u1ea1i cho qu\u1ea3n tr\u1ecb vi\u00ean s\u1ef1 linh ho\u1ea1t v\u00e0 ch\u1ee7 \u0111\u1ed9ng trong vi\u1ec7c quy\u1ebft \u0111\u1ecbnh cho ph\u00e9p ho\u1eb7c ng\u0103n c\u1ea3n c\u00e1c bot c\u1ee7a Google index nh\u1eefng ph\u1ea7n c\u1ee5 th\u1ec3 tr\u00ean website.<\/p>\n<p>N\u1ebfu ki\u1ec3m tra v\u00e0 ph\u00e1t hi\u1ec7n website c\u1ee7a b\u1ea1n kh\u00f4ng c\u00f3 file robots.txt, h\u00e3y tham kh\u1ea3o 3 c\u00e1ch t\u1ea1o robots.txt cho WordPress d\u01b0\u1edbi \u0111\u00e2y.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Cach-1-Su-dung-Yoast-SEO\"><\/span>C\u00e1ch 1: S\u1eed d\u1ee5ng Yoast SEO<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><strong>\u00a0B\u01b0\u1edbc 1<\/strong>: Truy c\u1eadp v\u00e0o website c\u1ee7a b\u1ea1n tr\u00ean WordPress, sau khi \u0111\u0103ng nh\u1eadp, giao di\u1ec7n <strong>WordPress Dashboard<\/strong> s\u1ebd hi\u1ec7n ra.<\/p>\n<p><strong>\u00a0B\u01b0\u1edbc 2<\/strong>: \u0110i t\u1edbi m\u1ee5c <strong>SEO<\/strong>, sau \u0111\u00f3 ch\u1ecdn <strong>Tools<\/strong>.<\/p>\n<figure id=\"attachment_22983\" aria-describedby=\"caption-attachment-22983\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Chon-muc-SEO-Chon-Tools.webp\" alt=\"Ch\u1ecdn m\u1ee5c SEO - Ch\u1ecdn Tools\" width=\"800\" height=\"484\" class=\"size-full wp-image-22983\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Chon-muc-SEO-Chon-Tools.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Chon-muc-SEO-Chon-Tools-300x182.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Chon-muc-SEO-Chon-Tools-768x465.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Chon-muc-SEO-Chon-Tools-750x454.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22983\" class=\"wp-caption-text\">Ch\u1ecdn m\u1ee5c SEO &#8211; Ch\u1ecdn Tools<\/figcaption><\/figure>\n<p><strong>\u00a0B\u01b0\u1edbc 3<\/strong>: Nh\u1ea5p v\u00e0o <strong>File editor<\/strong>.<\/p>\n<figure id=\"attachment_22985\" aria-describedby=\"caption-attachment-22985\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhap-vao-File-editor.webp\" alt=\"Nh\u1ea5p v\u00e0o File editor\" width=\"800\" height=\"450\" class=\"size-full wp-image-22985\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhap-vao-File-editor.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhap-vao-File-editor-300x169.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhap-vao-File-editor-768x432.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Nhap-vao-File-editor-750x422.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22985\" class=\"wp-caption-text\">Nh\u1ea5p v\u00e0o File editor<\/figcaption><\/figure>\n<p>L\u00fac n\u00e0y, b\u1ea1n s\u1ebd nh\u00ecn th\u1ea5y m\u1ee5c robots.txt v\u00e0 <a href=\"https:\/\/interdata.vn\/blog\/file-htaccess-la-gi\/\">file .htaccess<\/a>, \u0111\u00e2y l\u00e0 n\u01a1i b\u1ea1n c\u00f3 th\u1ec3 t\u1ea1o file robots.txt.<\/p>\n<figure id=\"attachment_22986\" aria-describedby=\"caption-attachment-22986\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Muc-robots.txt-va-file-.htaccess.webp\" alt=\"M\u1ee5c robots.txt v\u00e0 file .htaccess\" width=\"800\" height=\"486\" class=\"size-full wp-image-22986\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Muc-robots.txt-va-file-.htaccess.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Muc-robots.txt-va-file-.htaccess-300x182.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Muc-robots.txt-va-file-.htaccess-768x467.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Muc-robots.txt-va-file-.htaccess-750x456.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22986\" class=\"wp-caption-text\">M\u1ee5c robots.txt v\u00e0 file .htaccess<\/figcaption><\/figure>\n<h3><span class=\"ez-toc-section\" id=\"Cach-2-Qua-bo-Plugin-All-in-One-SEO\"><\/span>C\u00e1ch 2: Qua b\u1ed9 Plugin All in One SEO<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><a href=\"https:\/\/interdata.vn\/blog\/plugin-la-gi\/\">Plugin<\/a> All in One SEO l\u00e0 m\u1ed9t c\u00f4ng c\u1ee5 ti\u1ec7n \u00edch \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00f9ng, cho ph\u00e9p b\u1ea1n t\u1ea1o file robots.txt WordPress m\u1ed9t c\u00e1ch nhanh ch\u00f3ng. D\u01b0\u1edbi \u0111\u00e2y l\u00e0 c\u00e1c b\u01b0\u1edbc \u0111\u1ec3 t\u1ea1o file robots.txt WordPress b\u1eb1ng plugin n\u00e0y:<\/p>\n<p><strong>\u00a0B\u01b0\u1edbc 1<\/strong>: M\u1edf giao di\u1ec7n ch\u00ednh c\u1ee7a plugin <strong>All in One SEO Pack<\/strong>. N\u1ebfu ch\u01b0a c\u00e0i \u0111\u1eb7t plugin, b\u1ea1n c\u00f3 th\u1ec3 t\u1ea3i v\u1ec1 <a href=\"https:\/\/vi.wordpress.org\/plugins\/all-in-one-seo-pack\/\" rel=\"nofollow noopener\" target=\"_blank\">t\u1ea1i \u0111\u00e2y<\/a>.<\/p>\n<p><strong>B\u01b0\u1edbc 2<\/strong>: V\u00e0o m\u1ee5c <strong>All in One SEO<\/strong>, ch\u1ecdn <strong>Feature Manager<\/strong>, sau \u0111\u00f3 nh\u1ea5p v\u00e0o <strong>Activate<\/strong> t\u1ea1i m\u1ee5c <strong>Robots.txt<\/strong>.<\/p>\n<figure id=\"attachment_22987\" aria-describedby=\"caption-attachment-22987\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Thuc-hien-theo-huong-dan.webp\" alt=\"Th\u1ef1c hi\u1ec7n theo h\u01b0\u1edbng d\u1eabn\" width=\"800\" height=\"413\" class=\"size-full wp-image-22987\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Thuc-hien-theo-huong-dan.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Thuc-hien-theo-huong-dan-300x155.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Thuc-hien-theo-huong-dan-768x396.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Thuc-hien-theo-huong-dan-750x387.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22987\" class=\"wp-caption-text\">Th\u1ef1c hi\u1ec7n theo h\u01b0\u1edbng d\u1eabn<\/figcaption><\/figure>\n<p><strong>\u00a0B\u01b0\u1edbc 3<\/strong>: T\u1ea1o v\u00e0 ch\u1ec9nh s\u1eeda file robots.txt WordPress.<\/p>\n<figure id=\"attachment_22988\" aria-describedby=\"caption-attachment-22988\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Tao-va-chinh-sua-file-robots.txt-WordPress.webp\" alt=\"T\u1ea1o v\u00e0 ch\u1ec9nh s\u1eeda file robots.txt WordPress\" width=\"800\" height=\"542\" class=\"size-full wp-image-22988\" title=\"\" srcset=\"https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Tao-va-chinh-sua-file-robots.txt-WordPress.webp 800w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Tao-va-chinh-sua-file-robots.txt-WordPress-300x203.webp 300w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Tao-va-chinh-sua-file-robots.txt-WordPress-768x520.webp 768w, https:\/\/interdata.vn\/blog\/wp-content\/uploads\/2025\/01\/Tao-va-chinh-sua-file-robots.txt-WordPress-750x508.webp 750w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-22988\" class=\"wp-caption-text\">T\u1ea1o v\u00e0 ch\u1ec9nh s\u1eeda file robots.txt WordPress<\/figcaption><\/figure>\n<p><strong>L\u01b0u \u00fd<\/strong>: Kh\u00e1c v\u1edbi Yoast SEO, plugin All in One SEO l\u00e0m h\u1ea1n ch\u1ebf quy\u1ec1n ch\u1ec9nh s\u1eeda tr\u1ef1c ti\u1ebfp file robots.txt. \u0110i\u1ec1u n\u00e0y c\u00f3 th\u1ec3 g\u00e2y b\u1ea5t ti\u1ec7n, nh\u01b0ng l\u1ea1i gi\u00fap gi\u1ea3m thi\u1ec3u r\u1ee7i ro t\u1eeb c\u00e1c <a href=\"https:\/\/interdata.vn\/blog\/malware-la-gi\/\">Malware<\/a> bots l\u00e0m t\u1ed5n h\u1ea1i \u0111\u1ebfn website.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Cach-3-Tao-roi-upload-file-robotstxt-qua-FTP\"><\/span>C\u00e1ch 3: T\u1ea1o r\u1ed3i upload file robots.txt qua FTP<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>N\u1ebfu kh\u00f4ng mu\u1ed1n d\u00f9ng plugin, b\u1ea1n c\u00f3 th\u1ec3 t\u1ef1 tay t\u1ea1o file robots.txt cho WordPress c\u1ee7a m\u00ecnh.\u00a0\u0110\u1ec3 t\u1ea1o file robots.txt th\u1ee7 c\u00f4ng b\u1eb1ng c\u00e1ch upload qua <a href=\"https:\/\/interdata.vn\/blog\/ftp-la-gi\/\">FTP<\/a>, h\u00e3y l\u00e0m theo c\u00e1c b\u01b0\u1edbc d\u01b0\u1edbi \u0111\u00e2y:<br \/>\n<strong><\/strong><\/p>\n<p><strong>B\u01b0\u1edbc 1<\/strong>: S\u1eed d\u1ee5ng <strong>Notepad<\/strong> ho\u1eb7c <strong>Textedit<\/strong> \u0111\u1ec3 so\u1ea1n th\u1ea3o file robots.txt m\u1eabu.<\/p>\n<p><strong>B\u01b0\u1edbc 2<\/strong>: Truy c\u1eadp <strong>FTP<\/strong>, \u0111i\u1ec1u h\u01b0\u1edbng \u0111\u1ebfn th\u01b0 m\u1ee5c <strong>public_html<\/strong>, ch\u1ecdn file <strong>robots.txt<\/strong> v\u00e0 nh\u1ea5n <strong>Upload<\/strong>.<\/p>\n<p>Robots.txt l\u00e0 m\u1ed9t file tuy \u0111\u01a1n gi\u1ea3n nh\u01b0ng l\u1ea1i \u0111\u00f3ng vai tr\u00f2 quan tr\u1ecdng trong vi\u1ec7c ki\u1ec3m so\u00e1t c\u00e1ch c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm thu th\u1eadp d\u1eef li\u1ec7u website c\u1ee7a b\u1ea1n. Hy v\u1ecdng qua b\u00e0i vi\u1ebft n\u00e0y, b\u1ea1n \u0111\u00e3 hi\u1ec3u r\u00f5 robots.txt l\u00e0 g\u00ec, c\u00e1ch th\u1ee9c ho\u1ea1t \u0111\u1ed9ng, c\u00f4ng d\u1ee5ng, c\u00e1ch t\u1ea1o file robots.txt tr\u00ean trang web c\u1ee7a m\u00ecnh.<\/p>\n<p>H\u00e3y \u00e1p d\u1ee5ng nh\u1eefng ki\u1ebfn th\u1ee9c n\u00e0y \u0111\u1ec3 t\u1ed1i \u01b0u h\u00f3a SEO cho website, gi\u00fap website c\u1ee7a b\u1ea1n th\u00e2n thi\u1ec7n h\u01a1n v\u1edbi c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm v\u00e0 \u0111\u1ea1t th\u1ee9 h\u1ea1ng cao h\u01a1n tr\u00ean b\u1ea3ng x\u1ebfp h\u1ea1ng k\u1ebft qu\u1ea3 t\u00ecm ki\u1ebfm (SERP). \u0110\u1eebng qu\u00ean th\u01b0\u1eddng xuy\u00ean ki\u1ec3m tra v\u00e0 c\u1eadp nh\u1eadt file robots.txt \u0111\u1ec3 \u0111\u1ea3m b\u1ea3o website c\u1ee7a b\u1ea1n lu\u00f4n \u0111\u01b0\u1ee3c thu th\u1eadp d\u1eef li\u1ec7u m\u1ed9t c\u00e1ch hi\u1ec7u qu\u1ea3 nh\u1ea5t.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>B\u1ea1n \u0111\u00e3 bao gi\u1edd nghe \u0111\u1ebfn &#8220;robots.txt&#8221; nh\u01b0ng ch\u01b0a th\u1ef1c s\u1ef1 hi\u1ec3u r\u00f5 v\u1ec1 n\u00f3? B\u1ea1n mu\u1ed1n website c\u1ee7a m\u00ecnh th\u00e2n thi\u1ec7n h\u01a1n v\u1edbi c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm nh\u01b0 Google? N\u1ebfu c\u00e2u tr\u1ea3 l\u1eddi l\u00e0 &#8220;C\u00f3&#8221;, th\u00ec b\u00e0i vi\u1ebft n\u00e0y ch\u00ednh x\u00e1c l\u00e0 d\u00e0nh cho b\u1ea1n! H\u00e3y c\u00f9ng InterData kh\u00e1m ph\u00e1 t\u1ea5t t\u1ea7n t\u1eadt<\/p>\n","protected":false},"author":11,"featured_media":22995,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[100],"tags":[],"class_list":["post-22981","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-website"],"_links":{"self":[{"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/posts\/22981","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/comments?post=22981"}],"version-history":[{"count":3,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/posts\/22981\/revisions"}],"predecessor-version":[{"id":31799,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/posts\/22981\/revisions\/31799"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/media\/22995"}],"wp:attachment":[{"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/media?parent=22981"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/categories?post=22981"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/interdata.vn\/blog\/wp-json\/wp\/v2\/tags?post=22981"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}