Do NOT, under any circumstance give him the guilt of not being able to give you time. However, if there is no such situation, then you are simply in love with a man who is more dedicated to his work than you can be okay with! Try to make your guy see what is happening. Signs of an Affair. If that doesn't gel with you, don't change your own notions.