I've found that any time I use a good amount of TD, I have to let the soap sit in the mold a little longer. It's kind of soft at first. The only batch I've ever ruined with any additive was glitter. I put way too much and my soap crumbled. Maybe you can try leaving some in the mold longer and see how it works for you.