11 Commits

Author	SHA1	Message	Date
fiatjaf	d406058d8c	unblock bing and apple bots.	2025-01-27 22:37:25 -03:00
fiatjaf	a5dac15262	block more bots.	2024-10-06 15:55:09 -03:00
fiatjaf	567fdbb619	block more user-agents.	2024-09-26 12:30:28 -03:00
fiatjaf	ab34bde883	sitemaps of sitemaps of profile sitemaps.	2024-06-16 16:27:24 -03:00
Daniele Tonon	cd19675596	Fix domains output in robots.txt	2024-01-03 11:16:41 +01:00
fiatjaf	a04f82764a	rename variable CanonicalHost to Domain.	2023-10-21 07:47:37 -03:00
fiatjaf	4b1dddebae	make robots.txt rendering a simple string thing.	2023-10-19 21:11:26 -03:00
fiatjaf	7293103fc7	first step in the migration to templ.	2023-10-19 21:11:26 -03:00
fiatjaf	637cfa55e9	make "s" (Settings) a global template function so we don't have to pass it around everywhere.	2023-10-07 08:20:10 -03:00
fiatjaf	a082efc45d	delete explicit mentions to njump.me and use s.CanonicalHost	2023-09-24 13:57:42 -03:00
Daniele Tonon	c4bad18ee5	Add robots.txt	2023-09-11 01:42:17 +02:00