What's the difference between grumble, mumble, murmur and mutter?

The big difference is the spelling. The other difference is the attitude, Grumble and mutter tend to mean that you are unsatisfied, Murmer and Mumble are more relaxed.