I was thinking the same thing. I think its a first that I've agreed with him...
I have had almost 300 fights and I've maybe declined 10 offers. The majority of them, I was just looking to train more, the fight was too soon, and I agreed to it on a later date anyways. Either that or I was offered a fight with an alliance-mate, which I will always refuse to take unless its in a tournament.