Effectively, this function resets the temporary buffer flags. Currently, this
only used in the context of the parallel SpMV call in in MatMult_MPIAIJCUDA
or MatMult_MPIAIJCUDAARSE. Once the MatMultAdd is finished, the GPU temporary
buffers used for messaging are no longer valid.