Glossary term
What is robots.txt? Meaning for developers
A file that asks crawlers which paths not to visit. It does not hide a page and is not security.
Learn it properly · Next.js App RouterLesson 7: Metadata, SEO, Images and FontsThe Metadata API, sitemap and robots, Open Graph images, next/image and next/font, and Core Web Vitals habits.