Lets say that an administration use IA to determine taxes for houses.
Let's say again that house A has to pay 1000$ per year, and house B has to pay 1500$ per year.

Now the owner of house A complains saying that the two houses are virtually identical, and the plots on which they are build are similar/identical.

He requires a justification for the different evaluations, and an explanation why.

Does IA know how to explain decisions taken ?