I can't really give advice on the minimum amount because I love castor and have never used less than 8%.
When I first started making soap I used castor at 15%. The lather was great but the bars were short lived. I don't think it was just the castor that made the bars melt fast though...I was using an all veggie recipe with high coconut and no palm so it was a perfect storm of meltiness. I loved the lather but my first bars were definitely not my best.
I have since revamped my recipe to include lard and dropped the castor to 8-10%. The lather is still great and the bars last much longer.