Well, I finally went to microcenter and exchanged the CPU. So far the system hasn't kernel panic'd once. I've recompiled lots of packages, with the other cpu, it was panicing if I tried to build two things at once. Its weird that a CPU would 'work' but be flakey.. usually they either work or they dont.
So that means for this computer, I exchanged the original motherboard (because it didnt support 3.2ghz), the ram (it was bad), and the CPU (it was flakey), so far, the case and the floppy drive i bought were the only two things to 'work'.. though i can't really say that i've tested the floppy drive =)