sitemaprobots.txtиндексация
sitemap.xml and robots.txt for Google and Yandex
Dynamic sitemap generation and robots rules for multilingual Next.js sites.
7 min
Sitemap is a priority map, not a ranking guarantee. robots.txt tells crawlers what to fetch — mistakes delay new pages for weeks.
Implementation
- app/sitemap.ts from routes, blog and services with real lastmod
- hreflang alternates per URL entry
- robots: Host for Yandex, Sitemap line, disallow /api only
Submit to Search Console and Yandex Webmaster after deploy; check coverage reports within a week.
Read also
- IndexNow: instant indexing for Yandex and BingNotify search engines about new or updated URLs in seconds, not weeks.
- Free mockup before payment reduces project riskOne hero screen after brief — aligns on style before the main contract.
- Telegram bot for lead captureQualify in messenger, push to CRM with UTM deep links and after-hours auto-reply.
- SEO vs paid ads budget splitNew site: heavier on ads. Mature organic: shift spend but keep paid for predictability. Track CAC by channel.