The actor, who portrayed Wilson in the biopic Love & Mercy, reflects on his cherished time with the musician