AI is currently demonstrating outstanding performance in some aspects of the health and science sectors, and significant developments continue. I envisage that future AI will go on to make fantastic contributions to these sectors.
Good suggestions are proposed in the above post and the associated comments.
As trust in the ability of AI increases we need to be careful not to blindly trust it 100% of the time - it is important that AI indicates its level of confidence, so that when AI is unsure a professional can be alerted to pay specific attention to the case in question. Similarly, for potential bias (e.g. when the data-set is weaker for dealing with some scenarios). As stated above, an explanation of why an AI produces each prediction and/or recommendation will be useful.
It’s worth remembering that correlation does not (always) imply causation. The best of today’s AI is very good at the former, and poor at the latter. It can identify patterns in data and use these to make predictions or a diagnosis - but it does not (yet) understand the underlying processes that cause things to happen.
In terms of social impact, this means that we should be very careful when AI is involved in complex life changing situations. For those a combination of multiple (independently developed and trained) AI systems and humans might be the best approach. We don’t want to follow the hypothetical scenario of the Minority Report.
AI also lacks “common sense” - or wide ranging experience of most aspects of the real-world. A system that has excellent abilities in a specific narrow field is still susceptible to making mistakes, when a real-world event outside of its knowledge has a significant impact on the scenario in question. This is why general purpose AI systems (or subsystems or AI networks) could help to make AI more robust. Interestingly, at least one company has announced this week that it is making a significant effort to develop a general purpose AI, with the aim of exceeding the ability of experts. Such an audacious goal sounds like a potential XPRIZE challenge to me