Hi,
Yes, you need to install all your assets for each new project, Unity fresh projects doesn't included anything by default.
Simply go to the asset store, and click on the icon "download manager" and you have your purchased assets ready to "import" right from there from your local drive ( they are cached, so you don't need to redownload them, only download update them when required)
bye,
Jean