The public increasingly doesn’t trust businesses to effectively police themselves, while temptation for politicians around the world to impose their own oversight is growing.
AI and ethics
One message that came through clearly was that data comes with temptation: it can be hard to resist the opportunity to use the information gathered for one purpose and apply it for another. But the risk of alienating customers by using their data in ways to which they did not consent is significant.
Data owners will increasingly expect companies to seek their consent over how their data will be used. Therefore, data inherently creates a tension between the ever-expanding ability that technologies such as AI offer to improve products, services and processes, and the ever-increasing risk of pushback from consumers.
The risks AI bring do not stop there. If a company uses AI in hiring decisions, they could inadvertently trigger discrimination laws when biased data sets are used for input or models are flawed. While it is always important to understand how a decision is arrived at when defending certain positions — it is not always easy, or even possible, to trace the decision tree when AI is used.
Finally, while machines can be more reliable than humans in many instances, it is also true that they can fail miserably when they encounter unexpected situations. Bill Hibbard, a machine intelligence scientist, argues that because AI will have such a profound effect on humanity, AI developers too are considered the representatives of future humanity. And so, they also have an ethical obligation to be transparent in their efforts.
Are we reaching the limits of what we can do with data?
With both regulators and consumers struggling to keep up with the pace of technological change – and also, with the crooks and bad actors often one step ahead of them – there is a need for the industry to come together to understand and manage the data integrity risks.
Having begun the evening with a stark picture of the challenge involved in managing data integrity risks, we ended on a more optimistic note by recognizing that collaborating transparently across industries and with the government can at least help find agreement on the way forward to manage these risks effectively.
This article was first published on FT BrandSuite.
Summary
Data inherently creates a tension between the ever-expanding ability that technologies such as AI offer to improve products, services and processes, and the ever-increasing risk of pushback from consumers. Data integrity, therefore, must be on your agenda.