Family fights to keep convicted rapist in prison