Create an OAuth app only when needed