I defy or gall,
by house or by wall.
I defy or gall
To spite means to go against someone's command or wishes with the intent to annoy or inconvenience them, and is often performed with gall.
by house or by wall
A spite house or wall is constructed for the simple purpose of annoying the neighbors or city members (Thanks to @Rubio)