Yup, leave that centre bolt alone. Remove the 4 hex bolts, tap with rubber mallet. A bit of PB Blaster overnight can help if there's a lot of rust.