As soon as they saw it, Sue and James knew that the Victorian brick and limestone cottage in Fremantle was the house in which they wanted to raise their family.