We are at a stage in human history where huge trust is placed in statistical machines, that are unpredictable and easily manipulated, for important business – and personal – decisions.
Blown away when people respond to screenshots of failed responses with screenshots of successful responses, as if the tool has "learned" the correct response.
As if it can't just as easily provide an incorrect response again.
It's unsettling to me that people don't understand how the tools work, yet decide to trust them because the language reminds them of their own language.
When this bubble bursts it will be very painful for a great many people, in many different ways.