Minister says his comments on Indigenous consultation ‘eroded’ trust