Personally, I really like it when the magic is connected to the temper / nature of the wizard, it adds to the flavor of the character and sets a general atmosphere. And a good character atmosphere is hard to create but so easily shattered 🙂
With the danger of sounding like some fashion guy: A sea wizard’s spells for example should never have a red or yellow color, its just….wrong!