Is there a fee to remove an escrow account from a mortgage?

Yes, but the process to remove it will depend upon your mortgage servicer. Mortgage servicers might require you to have a certain loan to value or on-time payment history.