Banana (talk | contribs)
Andrew V (talk | contribs)
 
Line 11: Line 11:


:Hey! Thanks for pointing this out. I know some services specifically block archiving thru robots.txt or proxy settings. I'll find out what to use later as currently we deprecated archive.today and still need good alternative for reddit and some sites that block archiving. Ping me if you have any issues with how stuff is archived and what would you suggest to change in how bot works. Thanks! [[User:Banana|Banana]] ([[User talk:Banana|talk]]) 05:35, 23 February 2026 (UTC)
:Hey! Thanks for pointing this out. I know some services specifically block archiving thru robots.txt or proxy settings. I'll find out what to use later as currently we deprecated archive.today and still need good alternative for reddit and some sites that block archiving. Ping me if you have any issues with how stuff is archived and what would you suggest to change in how bot works. Thanks! [[User:Banana|Banana]] ([[User talk:Banana|talk]]) 05:35, 23 February 2026 (UTC)
== There is a list of Sites excluded from the Internet Archive ==
You might want your bot to use a different archiving service for those sites, the list can be found [[Internet Archive/Blocked companies|here]] [[User:Andrew V|Andrew V]] ([[User talk:Andrew V|talk]]) 02:34, 3 April 2026 (UTC)