Cellulitis vs IBC

I'm sure I'm probably in the "overthinking" boat, but... about a week ago I started having breast tenderness, like PMS symptoms (I've had a hysterectomy so not typical for me) then on July 24th my left breast was really sore, much larger and heavier, and pink (at least 45% of my breast). On the 25th it was much worse. To touch it hurt like fire, it burned and was more red and swollen. I went to my PCP who thought it was odd but since I'd had a mammogram and ultrasound 7 months ago didn't thing imaging was necessary. She put me on antibiotics commonly used for mastitis. Yesterday I woke up (this is after 4 doses of antibiotics) and my breast was even bigger and fire red. I felt pretty fatigued and crappy, low grade fever. I went to the ER, got an ultrasound to check for abscesses and was all clear. I mentioned IBC but that was shrugged off. He did refer me to a breast surgeon next week. He put me on Keflex and after 2 doses I feel a bit better. Breast is still pink/red, heavy but not as large, and now itches. I can feel a hardened area at the top of my breast going into my nipple. The skin that is red looked a little ridged compared to my other breast. I guess my question is has anyone been diagnosed with breast cellulitis and then found they have IBC? I'm 41 and also have 8 year old breast implants, hysterectomy but not menopausal yet.