User-agent: * Disallow: /api/ Disallow: /2fa/ Disallow: /cgi-bin/ Disallow: /selenium/ Disallow: /example.txt Sitemap: https://tarantulasmm.com/sitemap.xml