If you feel that you don't love your husband anymore because your found a new man.
Just let him know that you don't love him anymore, you found a new man, ask him for a divorce,
and don't just run away with your new man without telling anybody.
If you have kids, think about your kids too...