Picking up debris is just fine. It will help reduce fires, (which are completely natural, normal and necessary)...really tough question. But picking up debris, getting it away from your home and building some debris piles for the wild animals. Is the best one can do. Leave the 'duff' alone if you can. It is organic matter in the process of decomposition, crucial for great soil...even if you won't be alive to enjoy the soil, your progeny will.
Keep an eye on the duff. I have seen first hand that fire can travel through thick duff without a puff of smoke. Then burst into flame...taking days, weeks before igniting. Get trees away from your home (you don't happen to have a true log home do you)?, wood storage, fuel, batteries. If you have a true log home you are a very lucky person. A true log home with 12 to 18" diameter logs is the safest place to be in a forest fire. They've actually saved lives of fire fighters. Also great in floods, hurricanes, tornadoes, earth quakes...seriously.