You need to key back the surrounding paint to bare metal first mate, would've been better if you did that with the filler area too, but you should be ok. Filler work is time consuming and hard, I've just finished doing my quarter, its no where near perfect, but looks a lot better than it is, but I'm changing cars toward the end of the year hopefully so I wont worry about getting it redone perfectly lol