Ultimately AI is only as good as the training data that it was fed.

There are numerous examples that highlighted this, like getting an AI to diagnose skin cancer. Only afterwards did they figure out that the AI had associated a ruler being present in the photograph of the melanoma with a positive diagnosis of cancer.

There's other stuff like x-ray images of hands, and AI seems to be able to predict the ethnicity of the person.
Another is the ability to determine the sex of person just from a picture of their eye.

No one knew there things were possible, but seems the AI has "learnt" something, but what we cannot know.