If a user has RSA, ECDSA, and ED25519 private keys present on their system then the ssh client will offer all of these to the server and they may not get a chance to try password auth before it fails.
It seems I had imported the stock one from a default install, but I never configured it.
OpenSSH version is 7.9p1-10.