Ok, so it was rather easy after all.
Took both panels off cut the old ones and connected 2 new JVC ones.
Simple with duct tape, a bit more decent sound.
Next step is to run 2 oval speakers to the back like the ones @Logsdon has.
Last step is to get the old Clarion unit off and replace it with a modern one.