Fix fetching public keys with authorized fetch enabled