The structural problems that silver maples usually have include:
If you consistently trim the width over the next four or five years to promote vertical growth and you remove any branches with narrow angles or included bark you can reduce the risk of branches breaking off in wind or ice storms. This guide is for fruit trees but the ideas apply to what you want to do.
The other issue to address is how close is the tree to any structures or parking areas? Urban areas are unnatural for trees. The soil is different and they are not planted with the same density as a forest. In a forest a tree can depend on it's neighbours to buffer high winds. This is not true in urban environments and silver maples can blow over and break things like your house or car.
Lastly the issue of water seeking roots. Tree roots cannot drill through metal or plastic. However, depending on the age of pipes there may be pinpoint leaks at the joins. Where there is water ----> roots will go. Roots can go into a pipe where there is the tiniest gap.
Only you can do a complete analysis of whether this tree should be kept or not. Talk to a local arborist and get some costs:
- how much to remove it now?
- how much to give it some structural pruning on a yearly or bi yearly basis for four or five years?
- how much to remove a full grown silver maple (assume full grown after fifty years)
- what could it fall on and how much would it cost to fix? Are you insured?
- has your area had high wind storms or ice storms in the last ten years?
If the silver maple clogs your water pipes fifteen years from now how much could it cost to get new pipe laid?
I know this answer sounds like it's all about money but as a homeowner you will be responsible for what happens to the tree. If you are unsure hire an arborist for an opinion and estimate now. It's much cheaper to spend a little money now than a lot of money later.