doveadm auth test doesn't authenticate users I created with setup email add

[unlucio]

While trying to debug this problem, doveadm auth test fails for a user added by setup dovecot-master add or setup email add.

It looks like dovecot doesn't like users added by setup?:

$ setup dovecot-master add test@mydomain.com aaaa
$ doveadm auth test test@mydomain.com aaaa
passdb: test@mydomain.com auth failed
extra fields:
  user=test@mydomain.com

$ setup email add test@mydomain.com aaaa 
$ doveadm auth test test@mydomain.com aaaa
passdb: test@mydomain.com auth failed
extra fields:
  user=test@mydomain.com

Bug report: #4098

[polarathene]

For reference, this discussion is being addressed in the associated issue #4098

Status so far is that a minimal setup cannot reproduce the problem.

@unlucio has not confirmed yet if either of these reproductions below work for them, so it is unclear if it's due to their config or deployment environment.

Docker CLI

$ docker run --rm -it --hostname mail.example.test --name dms mailserver/docker-mailserver:edge

# In another terminal, shell into the DMS container to attempt reproduction:
$ docker exec -it dms bash
$ setup email add hello@example.test secret

$ doveadm auth test hello@example.test secret
passdb: hello@example.test auth succeeded
extra fields:
  user=hello@example.test

Docker Compose

services:
  test:
    image: mailserver/docker-mailserver:edge
    container_name: dms
    hostname: example.test

$ docker compose up -d
$ docker exec -it dms bash

# In the DMS container now:
$ setup email add hello@example.test secret
$ doveadm auth test hello@example.test secret
passdb: hello@example.test auth succeeded
extra fields:
  user=hello@example.test