One has to take responsibility for the influences in their life. 

Outsiders cannot differentiate us from our friends or group. 

Some people and relationships are toxic and are OK to walk away from.

If in the end you find yourself alone

It might just mean that you have fostered yourself a toxic environment. 

Collect the good people, let go of the rest.