You need to strip or rather separate the stantion from the lower fork tube, this is fairly easy, if you've got the tools and the experience, they can be pigs at times. You will then need a fork seal puller, yes you can use a screw driver but if it tight and I think yours is likely to be based on what you've described thus far, you could well end up damaging the rebate.
Don't whatever you do, follow the below advice
use a mixture of heat white spririt to desolve the rubber and get a picking tool or fork seal puller tool its basicly just a curved hook........ it took me 5 hours a few weeks ago and that what i did used white spririt to disolve the ruber and pick out the bits between the metal ring and the outer stanchion then hooked it with a hooked tool
As with most things in life it's easy when you know how, without experience and correct tools things can very quickly go very, very wrong and permanent irreversible damaged caused which can turn out to be very expensive
I see a lot of DIY damage often from owners following U Tube and internet forums. If you've not got the know how/experience or tools take it to someone who has. I'm sure there is someone near you, who someone else on this forum will recommend.