Anastrozole and Immune System

I had breast cancer in both breasts and a double mastectomy mid September 2019. I did not have to have chemo or radiation and was put on Anastrozole. I have been on it for almost 2 months. I got a cold last week and haven't had one for awhile. I have had asthma for years and tale inhalers. We had a New York City trip planned for next week. Now the fear of Corona virus has me wondering if should reschedule? Do you find your immune system is lower taking AI and not having chemo or radiation. My oncologist said I shouldn't be at more of a risk then anyone else, but don't know if believe this. I have been tired and still trying to get all my strength back. Thoughts please