Mistral, theoretically that will work. But a lot depends on how much of 'too much' you used, what fragrance you actually used and how hot you get the rebatch. Some fragrances take a lot of work to soften or dilute them using this method because they are very strong to begin with. Some fade quickly with this method.
Do you know the percentage you did use for the batch size you made and if that is within the 'safe use' range given by the supplier for soap? If not, how much over the safe usage range is the resulting soap? Or is it the fragrance is too strong and you want to tone it down?