I'd go ahead and use it as-is, I have several pounds of unrefined shea butter that has a very distinct and noticeable "smoky" scent to it, and that scent has never come through in a single batch of soap, not even in an unscented batch that was 75% CO and 25% shea.