It’s incredible to me that the bedrock of modern physics is hand-waved away

Nothing is waved away. It’s just a point the math breaks down, just like black holes. That all evidence so far supports the math doesn’t help explaining what exactly is/has been happening there.