Deed and loan

My husband and I purchased our home in 1999 together . We are both on the loan and deed . We did refinance a few times, he had a stroke in 2005 and it effected his decision making . 2006 my husband wanted to refinance again, someone put him in touch with a young man who came to our home and had the paper work all ready for us to sign . When I looked at the amount and interest rate . I told him we can not do this. And the young man looked at my husband and said you don't need her on this refinance, you/ my husband is the bread winner compared to your wifes pocket Change . So I walked out of the room. And my husband went thru with signing and the loan. the young man told my husband that when he got back to his office he would change the paper work for the loan to be in his name only . and the mortgage was only in his name. So my question is where is it or shouldn't that been recorded in our county land records ? With just him on that refinance ? And I never signed off for that to happen. Yes I'm still with my husband . Since then he has had more health issue and he's on disability and I don't work and we haven't made a payment in over 4 years . Cause we do not have the income that we did. With all this being said is it wroth fighting for. ( Show me the note ) or was it all fraud ? Our loan servicer is SPS , but our mortgage is owned by 5 different investors ????