User-agent: * Allow: / # Optional: keep admin/API endpoints out of crawling Disallow: /api/ Disallow: /_next/ Disallow: /private/ # Sitemaps (use the canonical host) Sitemap: https://www.trendingtags.io/sitemap.xml Sitemap: https://www.trendingtags.io/tools_sitemap.xml Sitemap: https://www.trendingtags.io/blog/sitemap-index.xml