651-700 of 10000 results (26ms)
2026-11-05 §
02:24 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1027.eqiad.wmnet [production]
02:23 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1027.eqiad.wmnet [production]
02:23 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1026.eqiad.wmnet [production]
02:23 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1026.eqiad.wmnet [production]
02:22 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97334 and previous config saved to /var/cache/conftool/dbconfig/20261105-022159-ladsgroup.json [production]
02:11 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97333 and previous config saved to /var/cache/conftool/dbconfig/20261105-021157-ladsgroup.json [production]
02:10 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1026.eqiad.wmnet [production]
02:09 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1026.eqiad.wmnet [production]
02:09 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1025.eqiad.wmnet [production]
02:09 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1025.eqiad.wmnet [production]
02:09 <mwpresync@deploy2003> Finished scap build-images: Publishing wmf/next image (duration: 07m 31s) [production]
02:01 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97332 and previous config saved to /var/cache/conftool/dbconfig/20261105-020155-ladsgroup.json [production]
02:01 <mwpresync@deploy2003> Started scap build-images: Publishing wmf/next image [production]
02:01 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1025.eqiad.wmnet [production]
01:51 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97331 and previous config saved to /var/cache/conftool/dbconfig/20261105-015153-ladsgroup.json [production]
01:31 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1025.eqiad.wmnet [production]
01:31 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1024.eqiad.wmnet [production]
01:31 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1024.eqiad.wmnet [production]
01:22 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1024.eqiad.wmnet [production]
00:52 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1024.eqiad.wmnet [production]
00:52 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1023.eqiad.wmnet [production]
00:52 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1023.eqiad.wmnet [production]
00:51 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Depooling db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97330 and previous config saved to /var/cache/conftool/dbconfig/20261105-005129-ladsgroup.json [production]
00:51 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2228.codfw.wmnet with reason: Maintenance [production]
00:51 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97329 and previous config saved to /var/cache/conftool/dbconfig/20261105-005107-ladsgroup.json [production]
00:41 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1023.eqiad.wmnet [production]
00:41 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97328 and previous config saved to /var/cache/conftool/dbconfig/20261105-004105-ladsgroup.json [production]
00:31 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97327 and previous config saved to /var/cache/conftool/dbconfig/20261105-003103-ladsgroup.json [production]
00:21 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97326 and previous config saved to /var/cache/conftool/dbconfig/20261105-002101-ladsgroup.json [production]
00:13 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Depooling db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97325 and previous config saved to /var/cache/conftool/dbconfig/20261105-001358-ladsgroup.json [production]
00:13 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2222.codfw.wmnet with reason: Maintenance [production]
00:13 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97324 and previous config saved to /var/cache/conftool/dbconfig/20261105-001336-ladsgroup.json [production]
00:11 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1023.eqiad.wmnet [production]
00:11 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1022.eqiad.wmnet [production]
00:11 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1022.eqiad.wmnet [production]
00:05 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1022.eqiad.wmnet [production]
00:04 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet [production]
00:04 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet [production]
00:04 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet [production]
00:03 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97323 and previous config saved to /var/cache/conftool/dbconfig/20261105-000334-ladsgroup.json [production]
00:00 <root@deploy2003> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync [production]
00:00 <root@deploy2003> helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync [production]
00:00 <root@deploy2003> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync [production]
00:00 <root@deploy2003> helmfile [staging] START helmfile.d/services/shellbox-timeline: sync [production]
00:00 <root@deploy2003> helmfile [staging] DONE helmfile.d/services/shellbox: sync [production]
00:00 <root@deploy2003> helmfile [staging] START helmfile.d/services/shellbox: sync [production]
2026-11-04 §
23:57 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1021.eqiad.wmnet [production]
23:53 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97322 and previous config saved to /var/cache/conftool/dbconfig/20261104-235332-ladsgroup.json [production]
23:43 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97321 and previous config saved to /var/cache/conftool/dbconfig/20261104-234330-ladsgroup.json [production]
23:36 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Depooling db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97320 and previous config saved to /var/cache/conftool/dbconfig/20261104-233620-ladsgroup.json [production]