This is a very niche topic (because topical fin is not FDA approved, very few people administer it and there is no standard product with a common vehicle which everyone uses), so I personally doubt even doctors would give you a definitive answer (you should still ask though if you can find an expert). In my humble opinion, maybe don't take it so as to not risk your children's health? Or at least wait until they are old enough that you don't physically interact with them as much?
Obviously pills are better in this regard, but you must've taken the path of topical to avoid side effects for yourself. I don't see an easy way around this. Edit: nvm just read that you said you're going to try pills now.