5501-5550 of 10000 results (10ms)
2026-07-07 §
12:22 <blake@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1036.eqiad.wmnet [production]
12:22 <blake@cumin1003> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1036.eqiad.wmnet [production]
12:04 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve-ctrl1002.eqiad.wmnet [production]
12:04 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve-ctrl1002.eqiad.wmnet [production]
11:59 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve-ctrl1002.eqiad.wmnet [production]
11:59 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve-ctrl1002.eqiad.wmnet [production]
11:59 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve-ctrl1001.eqiad.wmnet [production]
11:59 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve-ctrl1001.eqiad.wmnet [production]
11:56 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve-ctrl1001.eqiad.wmnet [production]
11:56 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve-ctrl1001.eqiad.wmnet [production]
09:28 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1153: Security updates [production]
09:28 <root@cumin1003> START - Cookbook sre.mysql.depool depool db1153: Security updates [production]
08:56 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1016: Security updates [production]
08:56 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1016: Security updates [production]
08:40 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1016: Security updates [production]
08:40 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1016: Security updates [production]
07:41 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1015: Security updates [production]
07:41 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1015: Security updates [production]
06:48 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1024: Security updates [production]
06:48 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1024: Security updates [production]
06:31 <root@cumin1003> END (ERROR) - Cookbook sre.mysql.depool (exit_code=97) depool pc1024: Security updates [production]
06:21 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1024: Security updates [production]
2026-07-06 §
13:42 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve-ctrl2002.codfw.wmnet [production]
13:42 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve-ctrl2002.codfw.wmnet [production]
13:38 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve-ctrl2002.codfw.wmnet [production]
13:38 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve-ctrl2002.codfw.wmnet [production]
13:38 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve-ctrl2001.codfw.wmnet [production]
13:38 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve-ctrl2001.codfw.wmnet [production]
13:35 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve-ctrl2001.codfw.wmnet [production]
13:35 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve-ctrl2001.codfw.wmnet [production]
12:10 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2048.codfw.wmnet [production]
12:08 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2048.codfw.wmnet [production]
2026-07-02 §
17:52 <jasmine@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1005.eqiad.wmnet [production]
17:52 <jasmine@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1005.eqiad.wmnet [production]
15:45 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1023: Security updates [production]
15:45 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1023: Security updates [production]
14:53 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1021: Security updates [production]
14:53 <root@cumin1003> START - Cookbook sre.mysql.depool depool pc1021: Security updates [production]
13:55 <fceratto@cumin1003> dbctl commit (dc=all): 'Depool db2205 T430912', diff saved to https://phabricator.wikimedia.org/P94704 and previous config saved to /var/cache/conftool/dbconfig/20260702-135505-fceratto.json [production]
09:39 <fceratto@cumin1003> dbctl commit (dc=all): 'Depool db2213 T430923', diff saved to https://phabricator.wikimedia.org/P94688 and previous config saved to /var/cache/conftool/dbconfig/20260702-093859-fceratto.json [production]
09:01 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1307075|build: Update required Node version from 24.14.1 to 24.18.0]] (duration: 07m 07s) [production]
08:56 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1307075|build: Update required Node version from 24.14.1 to 24.18.0]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
08:54 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1307075|build: Update required Node version from 24.14.1 to 24.18.0]] [production]
07:44 <moritzm> installing node-lodash security updates [production]
06:25 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1244: Upgrading db1244.eqiad.wmnet [production]
06:25 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1244: Upgrading db1244.eqiad.wmnet [production]
06:11 <cwilliams@cumin1003> dbctl commit (dc=all): 'Depool db1244 T430817', diff saved to https://phabricator.wikimedia.org/P94676 and previous config saved to /var/cache/conftool/dbconfig/20260702-061059-cwilliams.json [production]
00:29 <ryankemper> T429844 [opensearch] depooled codfw search-omega/search-psi discovery records to match existing codfw search depool during OpenSearch 2.19 migration [production]
2026-07-01 §
15:55 <pt1979@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2042,2046].codfw.wmnet [production]
15:55 <pt1979@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2042,2046].codfw.wmnet [production]