His recently departed Labor secretary will be remembered more for misconduct allegations than doing anything for unions.