Not many conifers apart from junipers/arborvitae that will thrive in alkaline soil. There are some broad-leaved evergreens that will live.
The alkalinity of your subsoil means more maintenance, but doesn't mean you can't successfully grow acid loving plants on top. Acid loving plants have an underdeveloped root system, and obtain nutrients from symbiotic bacteria/fungi that thrive in acid soil, so these plants don't do well in too high pH, and show signs of nutrient deprivation, even when fertilized.
And also of note: most acid-loving evergreens have very shallow root systems, so if you can provide a highly organic, acidic layer in the top 6" of soil, and feed it with compost, and/or fertilizer (organic is more effective in this case), you can grow very nice conifers.
See here for more info.
If you aren't able to do this, I'll make a list of evergreens that will grow in a soil pH of 7.0, in zone 4. There aren't many that come to mind.:
I've left out the cedars (genus Cedrus) as per your question. However, these do not grow quite as well as Thuja in alkaline conditions anyway.
Your soil are wrong for most coniferous evergreens, and the hardiness zone is wrong for most broadleaved ones. If none of the listed plants will work, and you cannot work on the conditions as described above, you may have to leave evergreens and plant deciduous shrubs/trees instead.