adding robots.txt file

This commit is contained in:
priyanshuvish
2025-08-19 12:38:53 +05:30
parent 119714eff3
commit b7af3d0566
2 changed files with 7 additions and 0 deletions

6
public/robots.txt Normal file
View File

@@ -0,0 +1,6 @@
User-agent: *
Disallow: /admin/
Disallow: /cgi-bin
Allow: /
Sitemap: https://www.wdipl.com/sitemap.xml