Someone on another forum said it's the hardware wearing out, he said his is the same way and he just wrapped some zip ties around the bolts to tighten it up and hold it tight in place. I'll do the same.
I got the rest of the wiring hooked up and modified the levers last night so either tonight or tomorrow night will get the master cylinder, levers, brake line, and cables hooked up. That leaves sunday to finish by putting the plastics on, etc. and still am planning on riding for at least a short ride sunday sometime.