If the bits are actually in the soap then I would say Irishlass most likely got it right. It is probably bits of solidified steric acid. When you melt the palm oil (or any solid oil) make sure it goes clear in your pot. I find if I get the oils to go clear without any fuzzy look, then I can let them cool to about 90 - 100 degrees without any problem of them solidifying later.
Keep it and let it cure for awile. If it still zaps....you'll know then that it's lye. You will still be able to rebatch it then if you want. Just add some extra oil in a crock pot with the grated soap and heat it until it goes clear.
