What is black box?

A system whose inner workings are hard for people to understand or inspect. For AI, this can make it difficult to explain a particular result.

Also called Black-box AI.

For example: A tool gives an applicant a low score without a clear reason.