”We don’t know if AGI will happen…”
Sure, but nobody can explain the engineering or physics of why it should.
It’s the same as saying we don’t know if adding compute to a Roomba will lead to it giving birth to a dustbuster.
We just don’t know. So it must be important to mitigate this.