Old Covenant Mentality

As recorded in the Old Testament, the presence of God usually resided in a building called a temple. The believers in Israel needed to go to Jerusalem. In John 4 when Jesus encounters a Samaritan woman seeking water, a conversation ensues in which she says that her people worship on this mountain and you Jews say we should worship in Jerusalem. Jesus responds that a time is coming when people won't be required to worship in either place. John 7:38-39 explains that the Holy Spirit had not yet been given because Jesus was not yet glorified. Jesus is now glorified with His resurrection, ascension and seating at the right hand of the Father. Yet we still retain this idea of holy buildings. We speak of going to church rather than true believers in Christ are the church. Does the building make us holy or is it the indwelling of the Holy Spirit?