Oh my goodness, you sound like me the first time I made lye solution.
I had little tiny lye dust specs that seemed to want to go everywhere. I was making my solution outside bc I thought it might be safer, but because I live in Florida, the air was humid it was reacting with the lye as I was pouring it. >.<
It definitely resulted in a lot of anxiety and overthinking. In my case, having some chemistry knowledge was making it a little worse.
Like you, I came here to see what other's experiences were. You're in good hands here.
Over the past year, I've come to realize what I think you're already suspecting and what others have said.
Yes, it does carry a danger. Yes, you do have to be careful.
No, a tiny spec or bit of dry lye is not going to cause horrible irreparable damage.
One of the things that I worried about the most was those little bits. My bottle had quite a bit of superfine particles and it was initially static-y and we don't use dryer sheets. I worried that I'd miss one while cleaning or etc etc.
But I learned something that helped me feel a bit at ease regarding those.
Because lye is SO hydrophilic (water loving), it will pull moisture out of the air, react with that AND with the carbon dioxide to form washing soda which is still caustic but much less so. A full flake or bead of lye will take some time to do that, but a tiny dust like speck would be faster.
I also have a plastic sheet or freezer paper under the area where I'm weighing lye, rinse my mixing spoon and the cup that held the dry lye VERY well, and then set it aside in dishpan to wash with soap later, and wipe down my work area afterward with vinegar.
I also wear sneakers when I soap, partially because I have foot problems that result in a lot of pain if I'm barefoot on hard floors for more than a few minutes, but also because I don't want to take chances.
Now I'm far less intimidated by lye(although very much respectful of it) and instead have focused my anxious energies on making the soap itself.
Be careful, methodical, and mindful, and keep learning as you are, and you'll be ok!