Defending your manhood was a big deal on the floor of Congress back in those days, so Lyon replied that he had been in many a fight with people from Griswold's state. Griswold's answer ("with your wooden sword?") was followed by Lyon spitting in Griswold's face.
It was on.
Despite having just mocked the man about that whole "wooden sword" business, Griswold immediately rushed for the unarmed Lyon with a hickory walking stick. Lyon was subsequently forced to endure the humiliating experience we all know of being clobbered by a piece of wood while at work.
However, the man's presumably cocaine-heightened 18th-century senses worked just as well for him as the Force. Lyon rushed for a nearby fireplace and equipped himself with a pair of iron tongs, which turned the tables of the battle, to the delight of the Vermont delegation.
The dude in the armchair appears to be having the time of his life.
The two were broken up but continued the fight a few minutes later in the halls outside the House chamber. Despite Lyon catching Griswold unarmed this time around, the reports show Griswold undoubtedly won the fight.