I looked at the pictures and think this is Jack in the pulpit or Arisaema Triphyllum.
The identification keys are that:
- native to eastern North America from Nova Scotia to Florida and including USDA zone 4 where I live
- close relative, Arisaema dracontium, has quite a different leaf shape but overlaps the range
- cluster of bright red berries in the fall
- the spadix and spathe that flower are only seen from May to June (Thanks Jurp!)
- leaves appear to be trifoliate
As alephzero has pointed out the plant is toxic if ingested due to the calcium oxalate (which is also found in tea leaves and kiwi fruit). You would probably have to eat the whole plant underlining that the dose makes the poison.
I have one in my garden and find that even if you try and spread the berries it takes many years before you see a mature plant. It does not spread aggressively and seems quite happy in dry shade.