Can I take my name off the loan but keep my name on the title?

The co-signer needs to refinance, your name can not simply be removed from a contract. The contract you have must be paid off with another loan that the co-signer obtains on their own. It is then up to the bank giving the new loan if they will accept partial ownership from someone not on the loan.