The disgraced royal is facing pressure to give up the Royal Lodge mansion where he has lived with his ex-wife Sarah Ferguson ...