Yes. You are right, your 3rd vanishing point is too low.....For your wife.
However everything seems to be lining up just fine with your construction setup you have. Your aesthetic does make for a bit of a fish eye distorted view, without the curving of the perspective lines a fish eye lens has.
If you raise it (the third vanishing point) and straighten it out a bit it will just make your 3rd vanishing point will make your picture more "normal" like a two point perspective.
The question should be, do you the composer want that or not. The second opinion you got sounds like it might have been more about personal appeal than technicality. But don't tell them I said that.
If you make the door and the tree straight they will stand out like a sore thumb and make for a very strange composition, and become the focal points because of their perspective contrast with the environment.