If you are meant to be a photographer, you will become one. That means finding confidence in the fact that you are the only person occupying your spatial and temporal location, and it comes with a responsibility. You are compelled to capture and share your perspective through sensibilities. It is your duty to communicate what you see can capture. Abandon the idea that a photo may one day be seen by anyone else (because you never know what your audience will be), or that you can/should predict the thoughts and feelings that an image might evoke in others. It’s just you and your singular vision at that moment. Own it and let it go, simultaneously. A dearth of self-confidence in your vision is never justifiable or excusable, and any attempt would be self-defeatist.
We’re all different. We all see the world in our own uniquely ephemeral way. We are all correct in our solipsistic, esoteric, subjective pursuit of truth. However, the diet of empathy and compassion we need in order to thrive is what gives our work value, allows it to transcend, and connects us with what we shoot. You cannot remain apart from that which you shoot. You must embrace it, understand it, and appreciate it—even if it’s grotesque—at least while you shooting.
If you walk to the beat of your own drum, it will either affect others or it won’t. If you aren’t affecting others, then you’re not living your life the right way. If you are affecting others, it’s either positively or negatively. Neutrality is worse than scorn. You must believe in your heart that your work is correct, by any definition. You must have conviction, resignation. While one’s work can polarize an audience, it’s still better than creating inoffensive, mundane, uninspired work. You have found yourself there (wherever that may be) with your camera, for a reason. So get to work. Don’t think; just pay attention and shoot. Shoot for yourself. The reason will become tack-sharp in time, as will the gratification.