When I first started soaping, I tried various butters and luxury oils. I found they didn't add enough to the soap for me to continue their use. I can tell a difference between a recipe with shea and one without but it only affects the lather, it doesn't make my skin feel different.
The one exception is argan oil. I made a small batch with 10% and I really like it. Its a nice gentle face bar that makes my skin feel soft. I'd never use it in gift soaps or sale soaps but for my personal luxury bar, I don't mind spending a bit extra once a year for a batch.
I was using avocado instead of OO since my skin doesn't like OO but I recently switched to HO safflower. Its cheap, easy to find and works great in soap.