When people rub you the wrong way do not let it effect you're path in life. As I was reading 2 Samuel this is what happened. Abner who was on the side of Joab turned against him to fight for the reign of David because Joab said something that he didn't like. For this story Abner's decision of joining the other side was a benefit to him because it was the more just side. But all the time we will not be as lucky as Abner.
People turn away from the good things in life because they do not like what someone said to them. What people say or do against you should not make you want to abandon what you have already started. It's a lot of work in that because when you switch you it shows weakness. The other side will know you are vulnerable is certain ways and will devour you off of that alone and the side that you left will simply say you weren't cut out for what laid ahead. So really you'll have no one to turn to.
Keep going forward until you run into a brick wall which will be a lesson learned. One brick wall can symbolize people who are not for you, people who hate you. Just back up a few steps and find another route to go and once you run into another brick wall just repeat the process. But never give up on the road of success. Jesus has your back the whole way.