I tend to agree that had he put his fist through your window that you could safely argue you were in fear of imminent serious bodily injury. I wouldn't even wait for the "tried to punch me" part. The simple act of violently breaching your personal space enclosed by your vehicle with his FIST proves intent.
just my opinion