Context #1
Bob: I really hate it when people throw their dirty cigarette butts on the ground.
Joe: I know! It drives me up the wall too.
Context #2
Sarah: My boyfriend is always late. If he says he'll pick me up at 2, that means 2:30 or even later sometimes.
Becky: That would drive me up the wall!
Meaning: To drive someone up the wall is an expression used to express that someone feels really frustrated, annoyed or even angry.
http://idiomstudy.blogspot.com/