Yeah, it should work just fine I think.
I infuse in castor primarily because I use it in 3 different recipes. I still have to infuse in olive, coconut, and sunflower to cover all my recipes so far. @curlycoat2 has way more experience in the infusion realm than I do. Her soap and knowledge are...