pleroma/priv/static/robots.txt

User-agent: *
Disallow: /

User-agent: FediIndex
Allow: /nodeinfo/2.0
Allow: /nodeinfo/2.1
Allow: /nodeinfo/2.2
Disallow: /
Allow FediIndex 2025-10-29 16:47:59 +00:00			`User-agent: *`
			`Disallow: /`

			`User-agent: FediIndex`
			`Allow: /nodeinfo/2.0`
			`Allow: /nodeinfo/2.1`
			`Allow: /nodeinfo/2.2`
			`Disallow: /`