it would be along the same lines as wearing proper footwear or not in that 3 mile commute, if your ok with your ankle being ground off then by all means wear your running shoes...
but all over your legs...
no need to get full racing leathers but getting into the habit of gearing up for even the shortest ride will pay off, safety first.
We don't gear up for the ride anyways, we gear up for the crash
