It's simple. Physics uses mathematics to construct equations that describe properties of physics.
The difference is physics has reality to test against - observations that can be measured. Math does not have this. Math's only metric against itself is itself.
Could you explain what you mean by that?