Goku was being a lot more careful than Vegeta and he could tell that Kid Buu is pure chaos even if he is half the size of everyone else