The house on the lowermost left should be unlocked! They all unlock one by one as you find each hand. If the first isn't unlocked, I'll have a look at any possible bugs with this.
Sorry for the delay and the trouble! ;v;