darken

Is there any trick to adding honey to my goat milk soap that will keep it from darkening the soap? It does lighten up some as it sets up but would like a lighter color bar. I use the honey with oatmeal.