I doubt you would be able to swing it out enough.
I've seen pictures of people using soft clamps and holding the pump pulley to the belt so that they don't have to re-time the cam but I have no idea how well this works, or if it even does. You would need to retime the pump though, that's a for sure.