Add robots.txt

rehlds · Nov 9, 2024 · 2c9d0f3 · 2c9d0f3
1 parent 6b4719d
commit 2c9d0f3
Showing 1 changed file with 12 additions and 0 deletions.
diff --git a/static/robots.txt b/static/robots.txt
@@ -0,0 +1,12 @@
+User-agent: *
+Allow: /
+
+User-agent: Yandex 
+Allow: /
+
+User-agent: Googlebot
+Allow: /
+
+Host: rehlds.dev
+
+Sitemap: https://rehlds.dev/sitemap.xml