“Too busy” is a myth.
People make time for the things that are really important to them.
When dealing with a friend, a lover, a boyfriend, a girlfriend, picture them naked. And by naked I mean without money, jewelry, cars, remove sex and look at who they are.
Their character, mindset, lifestyle, values, morals, beliefs. If you are still feeling them, then stay. If not, then I suggest you walk away. We do not need unnecessary people in our lives. The ones you should keep close are the ones you want around your family, friends, children, siblings, and spouses.