Is it possible that I would have main image with basic XPSP2, Novell
Client, Zen agent.. and use hardware specific "driver" add on images to
push correct drivers to systems?

I have used sysprep so far but most problems occure on laptops with
different kind of wlan and bluetooth driver/software combinations.