The Victim: by Saul Bellow

Leventhal, a man plagued by self-doubt and insecurity, encounters a disheveled stranger in the park who accuses him of ruining his life. Leventhal, unsure of his own worth, is torn between disbelief and the nagging suspicion that the stranger might be right.