1551-1600 of 10000 results (27ms)
2024-10-01 ยง
16:23 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component registry-admission [tools]
16:23 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission [toolsbeta]
16:17 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component registry-admission [toolsbeta]
16:16 <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T364077, test out new flag) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards [production]
16:11 <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T364077, test out new flag) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards [production]
16:06 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revision-models' for release 'main' . [production]
16:04 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] (duration: 09m 36s) [production]
16:03 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
16:00 <ladsgroup@deploy2002> taavi, ladsgroup: Continuing with sync [production]
15:59 <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T364077, this test transfer should succeed) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards [production]
15:58 <ladsgroup@deploy2002> taavi, ladsgroup: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:56 <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T364077, this test transfer should succeed) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards [production]
15:55 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] [production]
15:54 <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T364077, this test transfer should fail) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1023.eqiad.wmnet, repooling both afterwards [production]
15:53 <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T364077, this test transfer should fail) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1023.eqiad.wmnet, repooling both afterwards [production]
15:50 <gmodena> releasing refinery source v0.2.51 [analytics]
15:44 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:40 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) (T372814) [admin]
15:39 <ayounsi@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
15:36 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:07 <elukey@puppetserver1001> conftool action : set/pooled=yes; selector: name=aux-k8s-ctrl1003.eqiad.wmnet [production]
15:07 <elukey@puppetserver1001> conftool action : set/pooled=yes; selector: name=aux-k8s-worker1003.eqiad.wmnet [production]
15:05 <brennen@deploy2002> Finished deploy [phabricator/deployment@33a2c8d]: deploy phab1004 for T376149 (duration: 01m 07s) [production]
15:04 <brennen@deploy2002> Started deploy [phabricator/deployment@33a2c8d]: deploy phab1004 for T376149 [production]
15:03 <brennen@deploy2002> Finished deploy [phabricator/deployment@33a2c8d]: test deploy phab2002 for T376149 (duration: 00m 30s) [production]
15:03 <jelto@cumin1002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phab.wmfusercontent.org with reason: Phabricator/Phorge update [production]
15:03 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab.wmfusercontent.org with reason: Phabricator/Phorge update [production]
15:03 <brennen@deploy2002> Started deploy [phabricator/deployment@33a2c8d]: test deploy phab2002 for T376149 [production]
15:02 <jelto@cumin1002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phab.wmfusercontent.org with reason: Phabricator/Phorge update [production]
15:02 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab.wmfusercontent.org with reason: Phabricator/Phorge update [production]
15:02 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: Phabricator/Phorge update [production]
15:01 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab1004.eqiad.wmnet with reason: Phabricator/Phorge update [production]
15:01 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2002.codfw.wmnet with reason: Phabricator/Phorge update [production]
15:01 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab2002.codfw.wmnet with reason: Phabricator/Phorge update [production]
14:45 <jayme> added the taint node-role.kubernetes.io/control-plane:NoSchedule to wikikube staging apiservers - T334234 [production]
14:32 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:32 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:25 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:25 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:15 <jayme> added the label node-role.kubernetes.io/control-plane='' to all k8s apiservers - T334234 [production]
14:10 <moritzm> installing cups security updates [production]
13:49 <elukey@puppetserver1001> conftool action : set/pooled=inactive; selector: name=aux-k8s-worker1003.eqiad.wmnet [production]
13:49 <elukey@puppetserver1001> conftool action : set/pooled=inactive; selector: name=aux-k8s-ctrl1003.eqiad.wmnet [production]
13:32 <elukey@puppetserver1001> conftool action : set/weight=1; selector: name=aux-k8s-ctrl1003.eqiad.wmnet [production]
13:32 <elukey@puppetserver1001> conftool action : set/pooled=yes; selector: name=aux-k8s-ctrl1003.eqiad.wmnet [production]
13:31 <elukey@puppetserver1001> conftool action : set/weight=10; selector: name=aux-k8s-worker1003.eqiad.wmnet [production]
13:31 <elukey@puppetserver1001> conftool action : set/pooled=yes; selector: name=aux-k8s-worker1003.eqiad.wmnet [production]
13:21 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hadoop.roll-restart-masters (exit_code=0) restart masters for Hadoop analytics cluster: Restart of jvm daemons. [production]
12:36 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
12:36 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]