An external reality would need to be describable in terms not tied to human language. Maths is our only way of communicating these abstractions, so to believe in an external reality that exists without us is to accept that the universe is fundamentally mathematical.