You can tell whether it adds power to your Mage by looking at the overall power gauge, rather than the spirit itself. Adding and removing sapphires will change the power of the spirit, but not the Mage.

I keep a lv2 chip on my spirit to prevent myself from accidentally selling it when I'm switching gear. It doesn't, however increase my Shayd or smoulders magic attack.