You certainly can establish a claim against both the Social Security Administration and the Internal Revenue Service, based on their respective acts of fraud in connection with the issuance of a SSN to you.
However, establishing a claim and winning a lawsuit are not the same things. In order to get your money back, you will probably have to spend half your time in U.S. District Court and even then, the likelihood you will win is slim, at best, due to the massive corruption of our judicial system. Remember, if they give you back your money, then they have to give back
money to 50-60 million people who have discovered the truth, and they are not going to do that, no matter how the law reads.
It is unfair that you should be defrauded of your money in this way, but that is precisely what has occurred. I dealt with this issue by reframing the entire matter: I consider the money fraudulently taken from me by the SSA and IRS to be the price of my freedom education, and when I think of it that way, I realize that I got a bargain!