Since other roles often rely on this not an actual new caddy server installation we should probably have it as its own little role.