A Perth man is accused of abducting a vulnerable Warrnambool girl years after a judge ruled he posed no danger to the community, despite sexually penetrating a teenager.