When it comes down to your family, they’ll get over it. They are probably just disappointed right now (my mother was) and as for your fiance’, if he loves you he’ll support your decision just like you supported him by being with him and he has a daughter. Stay strong.
