How big is the battery?
What type of battery is it (car, sealed gel or AGM)?
Does the battery have anything draining it (car alarm, immobiliser, radio, etc), or is it just a maintenance charge (i.e. just to offset the battery self discharge)?
where is your 5w panel (in the window or outside in the sun, facing the south, etc)?
if it's just a car/leisure battery up to 100Ah, then if you are really getting 5W (0.4A ish at 12v) then that ought to be OK for maintenance charging. Having said that, is you panel a good quality one or a cheap amorphous one? (the good ones will charge the battery even when it's overcast, the cheap ones need full sunshine to produce enough volts)?
Oh, and one more question: does your panel have a blocking diode (stops the battery draining though the panel when it's dark)?