It appears it is not possible to connect to vault agent using a unix domain socket.
We like to have vault agent run with only
listener "unix" {
address = "/run/vault.sock"
tls_disable = true
}
but it seems this library doesn't support it and we have to enable a tcp listener too.