51-100 of 10000 results (15ms)
2026-03-04 ยง
21:27 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1248081|Add synthetic AAA experiment (T418614)]], [[gerrit:1248080|Add synthetic AAA experiment (T418614)]] [production]
21:21 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1245473|logging: set poolcounter channel log level to info (T418612)]] (duration: 09m 04s) [production]
21:19 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_etcd_node [toolsbeta]
21:17 <tgr@deploy2002> tgr, cwhite: Continuing with sync [production]
21:16 <James_F> Zuul: [mediawiki/core] Make PHP 8.5 voting on master branch, for T411814 [releng]
21:14 <tgr@deploy2002> tgr, cwhite: Backport for [[gerrit:1245473|logging: set poolcounter channel log level to info (T418612)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:12 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1245473|logging: set poolcounter channel log level to info (T418612)]] [production]
21:10 <James_F> Zuul: [mediawiki/vendor] Make PHP 8.5 voting on master branch, for T411814 [releng]
21:07 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248007|Fix $wgJwtSessionCookieIssuer (T415007 T418999)]] (duration: 09m 55s) [production]
21:03 <tgr@deploy2002> tgr: Continuing with sync [production]
20:59 <tgr@deploy2002> tgr: Backport for [[gerrit:1248007|Fix $wgJwtSessionCookieIssuer (T415007 T418999)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:57 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1248007|Fix $wgJwtSessionCookieIssuer (T415007 T418999)]] [production]
20:10 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=0) [tools]
19:58 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:57 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) [tools]
19:56 <jhuneidi@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.18 refs T413809 [production]
19:48 <brennen> Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/96 (T419004) [releng]
19:46 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:46 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) [tools]
19:45 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:44 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=0) [tools]
19:44 <jhuneidi@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248011|CategoryViewer: Fall back to empty string in case of missing nextpage (T418934)]] (duration: 10m 47s) [production]
19:44 <cdobbins@cumin2002> conftool action : set/pooled=yes:weight=1; selector: name=cp205[0-8].codfw.wmnet [production]
19:43 <cdobbins@cumin2002> conftool action : set/pooled=yes:weight=1; selector: name=cp2049.codfw.wmnet [production]
19:40 <jhuneidi@deploy2002> zabe, jhuneidi: Continuing with sync [production]
19:35 <jhuneidi@deploy2002> zabe, jhuneidi: Backport for [[gerrit:1248011|CategoryViewer: Fall back to empty string in case of missing nextpage (T418934)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:34 <brett@puppetserver1001> conftool action : set/weight=1; selector: name=cp2043.* [production]
19:34 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp2043.* [production]
19:33 <jhuneidi@deploy2002> Started scap sync-world: Backport for [[gerrit:1248011|CategoryViewer: Fall back to empty string in case of missing nextpage (T418934)]] [production]
19:30 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:30 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2043.codfw.wmnet with OS trixie [production]
19:29 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) [tools]
19:23 <rzl@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-experimental: apply [production]
19:22 <rzl@deploy2002> helmfile [codfw] START helmfile.d/services/mw-experimental: apply [production]
19:22 <rzl@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
19:22 <rzl@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
19:14 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:14 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) [tools]
19:13 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node [tools]
19:13 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster (exit_code=99) [tools]
19:12 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster [tools]
19:12 <root@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster (exit_code=97) [tools]
19:11 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster [tools]
19:11 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster (exit_code=99) [tools]
19:10 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster [tools]
19:10 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster (exit_code=99) [tools]
19:09 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2043.codfw.wmnet with reason: host reimage [production]
19:09 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster [tools]
19:08 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster (exit_code=99) [tools]
19:07 <root@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.add_node_to_cluster [tools]