If you always feel drained, judged, or used after meeting them, it is time to let go. Friendship should bring peace, not stress. Walking away is better for mental health.