The lye don't lie ... but don't forget the story that the math has to tell.
Let's say you want to fragrance your soap at a rate of 3% per pound of oils and your recipe calls for 1000 g of base oils. The fragrance dose would thus be: 1000 * 3 / 100 = 30 grams.
If you infuse an oil and use it, say, as a 5% superfat after the HP cook, you would be adding 1000 * 5 / 100 = 50 g of superfat for this recipe.
Is it realistic to infuse 30 g of fragrance (citrus oil or what have you) in 50 g total of infused oil?