Yes, you are good to cut away the dead growth (and want to do it soon, before new growth makes it difficult.) The tops die back each year and new growth comes up from the roots each year.
"Ornamental grass" is a more common catch-all phrase for these.