ct/public/robots.txt
WindowBird d44ca3fa15 feat: 瀹屾垚鍏充簬鎴戜滑椤甸潰鍜孲EO浼樺寲
- 鍒涘缓瀹屾暣鐨勫叧浜庢垜浠〉闈㈢粍浠?- 娣诲姞鍝嶅簲寮忚璁★紝鏀寔绉诲姩绔拰PC绔?- 瀹炵幇瀹屾暣鐨凷EO閰嶇疆锛屽寘鎷琺eta鏍囩銆佺粨鏋勫寲鏁版嵁
- 娣诲姞sitemap鍜宺obots.txt鏀寔
- 瀹夎@nuxtjs/sitemap妯″潡
- 娣诲姞PWA manifest.json閰嶇疆
- 浣跨敤Tailwind CSS鏍峰紡鍜孨uxt UI缁勪欢
2025-10-07 10:19:41 +08:00

19 lines
303 B
Plaintext

User-agent: *
Allow: /
# 网站地图
Sitemap: https://ccttiot.com/sitemap.xml
# 禁止爬取的目录
Disallow: /admin/
Disallow: /api/
Disallow: /_nuxt/
Disallow: /node_modules/
# 允许爬取的重要页面
Allow: /
Allow: /about
Allow: /sharedSolutions/
# 爬取延迟(可选)
Crawl-delay: 1