Soy for Estrogen+ people...the eternal question

As you can see in my diagnosis info, I'm ER+/PR-/HER2-. I've used soy milk (about a cup a day) for decades and, as I eat a primarily plant-based diet (for the past year and a half), I eat a little tofu once or twice a week. That's it fo my soy consumption.

Now that I have breast cancer - as of April - I have to question the wisdom of consuming dietary soy. I have had one introductory meeting with my MO (I see him again later this week) and when I asked him about soy, he said that because I consume it in moderation (I do), it is not an issue.

Of course, with time to sit around and stew and wonder during this interval between radiation and MO, I have to worry about SOMETHING, so today it's soy.

Is there a consensus on the advisability of moderate to light consumption of dietary soy for post-menopausal early stage ER+ cancer patients? Or not? If it's iffy, do I flip a coin? No, I"d probably bug my MO for a concrete answer. Right now I'm leaning towards giving up the soy milk and tofu (but my inner voice is whining "but I LIKE it").

Any thoughts?