did they only show their house in the episode where Buddy walked out on her cause he thought she was having an affair?

I believe so. He was shown in numerous other locations but this was our only glimpse of his house.