Personally I believe the best thing here would of been as bullitt said, stay behind lock door and call law enforcement, at least there would of been a record that you and your family felt threatened.
We have had inebriated individuals walk up to our place in the middle of nowhere, I first phone sheriff then tell them their ride is on it's way, takes law enforcement around 30 to 45 min to show up if they hurry.
When confronting them I CC , non threatening and it's something I do all the time, if my life was threatened and I had to bring gun into play, I would not of grabbed a gun just to answer the door because it's always on me.
(edit wrong case)
Still bad idea to interject gun into argument.