You really need Maria or at least Herja to work with him to keep up his morale.
think you mean his health? not morale? In banish i think its a non issue (in pvp/HR/quest its an issue)
personally only using him in banish atm full time (occasional HR/quest/royal/etc) where a maria is needed.