zincati::strategy lock-manager pre-reboot failure: server-side error, code 500: all 1 semaphore slots currently locked

[sgohl]

Hi,

I'm not sure this is a bug; there's so little documentation on how this works

I use Fedora CoreOS with a zincati config like this:

[identity]
rollout_wariness = 1.0
group = "default"

[updates]
strategy = "fleet_lock"

[updates.fleet_lock]
base_url = "http://192.168.55.200:3333/"

[[updates.fleet_lock.window]]
days = [ "Mon" ]
start_time = "01:00"
length_minutes = 30

And my airlock config is this:

            [status]
            enabled = true
            address = \"0.0.0.0\"
            port = 2222
            tls = false

            [service]
            address = \"0.0.0.0\"
            port = 3333
            tls = false

            [etcd3]
            endpoints = [ \"http://dutch_etcd:2379\" ]

            [lock]
            default_group_name = \"default\"
            default_slots = 99

            [[lock.groups]]
            name = \"cluster\"
            slots = 1

In belief that the default group has 99 slots, so I think 99 machines can reboot simultaneously.
However, I always get this error message

Sep 18 09:59:20 rdbops zincati[3964]: [ERROR zincati::strategy] lock-manager pre-reboot failure: server-side error, code 500: all 1 semaphore slots currently locked

How could I query the airlock api for possible servers that caused the semaphore lock?
Do I possibly misunderstand what a slot is?
What if default_slots is missing? Does it mean "only one server can reboot" or "no limit on servers that can reboot" ?

[sgohl]

is it possible to query this via airlock api ?

> etcdctl get --prefix=true ""
com.coreos.airlock/groups/cluster/v1/semaphore
{"total_slots":1,"holders":[]}
com.coreos.airlock/groups/default/v1/semaphore
{"total_slots":99,"holders":["0042ab9500f34ee48946f2f86f8781f3","0310f2198fb047fc96dde49e6dd52941","06fbbafca1ac477890bbc7ee4474eb62","11fbc3fd044a4ee28366802db43b507e","14996c8e95ca46519e91b7ad5c9f0298","14e2b76cbcd44af5b9c835254e661b8c","20c022ec7a544c6ea9634bb07a079a7c","24b3dbcfc8684188a221eed6a89b1d38","271c75e466ab467fa4e244405163c12b","2b3e58e5820f4a10831e9fa4bf1e2360","3cf5fd755278449194c117ea21bc7055","40d2407fbb044649b42486d540305228","4daac4a458ab4e5aa35918bb92b9c9d7","6349def4876f439e93da0e7e3ac0cf7a","6fa26936fa49474c940455b5859b4f28","74764ebeb10240c8a849ab93633f6804","775d4150e82c4e22a92a2abe341f4f0d","8203b73d5f5a4d1c87899a717c6133b4","83cd1d3fc3be43fdb9d8cc8d34a85192","8d488f8e91044029931a8e76d83def30","9061c1722a644e029480067d5c80af14","98b6565d843c4dcc85d2767168e33cc2","a6c6ad6d4c4140aea0f617ebc264e36e","abff9d9ffac448ac90f5a03a4ff87a52","b4f817b568c540af9fcdc2aa614a386b","cab599120b774322875e639a3e416b53","d655fa70d1c14babb1d6d7d71f727971","da74d30309ba43ec9eab3c816cf6511b","e5a50cdd32cb43fab7741998c8467a64"]}