I don't know how to handle this...?

When you have a child invovled, you cant waste time. You can talk to him about anything you are concerned with. You have that right. You gotta think about you and your daughter first!