Remove graphice card completely, then retry. Some motherboards will automatically try to use an added graphics card and bypass the onboard if it has one.
If the added card is duff, it will still try and use it.
Sounds like the board is (mostly) working if all the lights come on...even if they don't stop.
Ooh, I just remembered, I had something like this due to knackered SATA drive cable of all things. Only certain way is to strip it down and try adding one bit at a time.