Is it The House Where Evil Dwells?
http://www.imdb.com/title/tt0084096/
It is early '80s and about an American couple that moves into a haunted house in Japan. This is a movie I really didn't care for all that much, but it might be the one you are thinking of. If not, I am also stumped.