He doesn't answer, because he doesn't feel worthy - but he knows Ragnar will only feel he has to argue if he says that.
Other options:
no subject
He doesn't answer, because he doesn't feel worthy - but he knows Ragnar will only feel he has to argue if he says that.