I think fish would spoil faster, especially if the brains were enclosed in the skull still. Less exposure to oxygen, etc. Also, fish muscle is a wetter and less dense tissue, I think.