Honestly, if I were going to do this, I would use a paintable canvas and draw the entire thing.
Here is an example from sometime ago that does something similar (although I don't think you need to deal with the mouse), perhaps it can provide some insight.
Maybe, I will throw something together later today if I get a chance.