This is an old revision of the document!
Why I thought this was an easy problem to solve I do not know. CPU checkpoint/restart has come a long way with DMTCP for serial and parallel jobs (including multi-host).
A good overview of the history of GPU checkpoint/restart efforts can be found at this presentation