With ou without desktop env?

Do I need to install the desktop env when installing a distro or do I need to install blank Linux and install a clean desktop env later? Thank you! 😃👌