It should be completely OK, if the temperature is above 10C. Ficus trees grow outside in warm climate without any issues with wind, so the information you met must be about colder climate problem with cold draft from window in winter (yes, it can harm many pot plants).
Also, if your fan is a heater, don’t direct it onto the plant obviously.