12 lines
181 B
Plaintext
12 lines
181 B
Plaintext
# 1818AI robots.txt
|
|
User-agent: *
|
|
Allow:/
|
|
|
|
# 禁止爬虫访问的路径
|
|
Disallow:/api/
|
|
Disallow:/admin/
|
|
Disallow:/login/
|
|
|
|
# 站点地图
|
|
Sitemap:https://www.1818ai.com/sitemap.txt
|