Hundreds of people on south Vancouver Island forced from their homes by flooding have been allowed to return, but most won't be able to stay because of damage to their houses.