601-650 of 10000 results (33ms)
2024-02-12 ยง
15:08 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2180 (re)pooling @ 10%: testing db2194 done', diff saved to https://phabricator.wikimedia.org/P56679 and previous config saved to /var/cache/conftool/dbconfig/20240212-150810-arnaudb.json [production]
15:08 <denisse@cumin2002> START - Cookbook sre.hosts.reimage for host grafana1002.eqiad.wmnet with OS bookworm [production]
15:07 <denisse> Reimage Standby Host (grafana1002) - T352665 [production]
15:06 <ejegg> re-enabled thank you mailer and donations queue consumer [production]
15:06 <James_F> Zuul: [mediawiki/extensions/VisualData] Enable basic quibble CI [releng]
15:03 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudservices2005-dev.codfw.wmnet [production]
15:01 <James_F> Add BlueSpiceVisualEditorConnector as dependency to BlueSpiceQrCode [releng]
14:58 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
14:58 <taavi@cloudcumin1001> Added a new k8s worker-nfs tools-k8s-worker-nfs-20.tools.eqiad1.wikimedia.cloud to the cluster [tools]
14:56 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudservices2005-dev.codfw.wmnet [production]
14:56 <James_F> Zuul: [mediawiki/extensions/PlaceNewSection] Place in right section [releng]
14:56 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudservices2004-dev.codfw.wmnet [production]
14:51 <arnaudb@cumin1002> START - Cookbook sre.hosts.reimage for host db2194.codfw.wmnet with OS bookworm [production]
14:49 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudservices2004-dev.codfw.wmnet [production]
14:48 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster [tools]
14:48 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host tools-k8s-worker-62 [tools]
14:47 <denisse> Completed failover to grafana2001 - T352665 [production]
14:47 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host tools-k8s-worker-62 [tools]
14:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
14:47 <taavi@cloudcumin1001> Added a new k8s worker-nfs tools-k8s-worker-nfs-19.tools.eqiad1.wikimedia.cloud to the cluster [tools]
14:47 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet [production]
14:42 <ejegg> fundraising civicrm upgraded from c66b04bd to 684286b4 [production]
14:41 <ejegg> disabled thank you mailer and donations queue consumer [production]
14:36 <denisse> starting Upgrade Grafana hosts to Bookworm - T352665 [production]
14:35 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster [tools]
14:33 <Lucas_WMDE> UTC afternoon backport+config window done [production]
14:32 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:992379|uzwiki: remove temporary logo files (T353723)]] (duration: 09m 53s) [production]
14:27 <moritzm> installing Linux 6.1.76 on Bookworm hosts [production]
14:26 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host tools-k8s-worker-61 [tools]
14:26 <logmsgbot> lucaswerkmeister-wmde@deploy2002 anzx and lucaswerkmeister-wmde: Continuing with sync [production]
14:26 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host tools-k8s-worker-61 [tools]
14:24 <logmsgbot> lucaswerkmeister-wmde@deploy2002 anzx and lucaswerkmeister-wmde: Backport for [[gerrit:992379|uzwiki: remove temporary logo files (T353723)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:23 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Started scap: Backport for [[gerrit:992379|uzwiki: remove temporary logo files (T353723)]] [production]
14:20 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:1000601|Set $wgMinervaEnableSiteNotice for arwikisource (T356460)]] (duration: 09m 05s) [production]
14:13 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and hubaishan: Continuing with sync [production]
14:12 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and hubaishan: Backport for [[gerrit:1000601|Set $wgMinervaEnableSiteNotice for arwikisource (T356460)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:10 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Started scap: Backport for [[gerrit:1000601|Set $wgMinervaEnableSiteNotice for arwikisource (T356460)]] [production]
14:02 <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] (duration: 23m 12s) [production]
13:57 <taavi@cumin1002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol2005-dev.codfw.wmnet [production]
13:55 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
13:49 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host tools-k8s-worker-60 [tools]
13:46 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host tools-k8s-worker-60 [tools]
13:44 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcontrol2005-dev.codfw.wmnet [production]
13:44 <taavi@cumin1002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol2004-dev.codfw.wmnet [production]
13:43 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
13:43 <taavi@cloudcumin1001> Added a new k8s worker-nfs tools-k8s-worker-nfs-18.tools.eqiad1.wikimedia.cloud to the cluster [tools]
13:39 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] [production]
13:35 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet [production]
13:35 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster [tools]