I added the EOs after cooking, and just before I put in the mold. I was whisking it to incorporate through the batch, and it was then that I noticed the ricing. I put in lavender EO, lemon EO and rosemary EO. I'm not sure if they are the cause or not.
I'm still pleased with the batch...