"Do you really think "church" refers to just the building?"

Of course not, I consider the church the entire spiritual community connected with it. And the criticisms are of the behavior of Jeremiah Wright, which is bigoted and hateful and may violate federal law. And by extension, the criticisms are of a presidential candidate who participated in and donated to this pastor's ministry for 17 years. Not the church. Why don't you understand the difference? It is legitimate criticism and investigation, and should be pursued.