Do I have defamation of character case?

I am applying with a police department who is doing a background investigation on me. A previous employer told the background investigator I quit due to a sexual harrasement issue, when the investigator pulled my file from this company there was no documentation of the fact.

I worked for this company 5 years ago and a month in I was talked to about sexual harrasement by asking a lady who worked there"I notice you are wearing a ring are you happily married?" She replied yes and I proceeded to talk about me and my fiancée."
I felt like I did not overstep any boundaries but I wasn't wrote up for it or anything. 4 months later I was offered another job and resigned accordingly which had absolutely nothing to do with the sexual harrasement accusation.


I was questioned about this and was asked if I put you on a polygraph will you pass this when it's asked.

Due to this false accusation with no proof presented when the background investigator asked for it I feel like due to this accusation has caused the police department to question my character.