Hey Scard, first off, that's some awesome soap design.
As for the spots? I've had problems with lavender FO in the past. I had oil spots once, from me not blending in completely. Not positive that's what's going on here. My bet it is the FO and most likely the lavender. Some are just stubborn...