601-650 of 10000 results (103ms)
2024-09-11 ยง
22:41 <jforrester@deploy1003> jforrester: Continuing with sync [production]
22:41 <jforrester@deploy1003> jforrester: Backport for [[gerrit:1072305|SpecialExpandTemplates: Replace use of deprecated OutputPage::addCategoryLinks() (T373830)]], [[gerrit:1072306|SpecialExpandTemplates: Replace use of deprecated OutputPage::addCategoryLinks() (T373830)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:38 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1072305|SpecialExpandTemplates: Replace use of deprecated OutputPage::addCategoryLinks() (T373830)]], [[gerrit:1072306|SpecialExpandTemplates: Replace use of deprecated OutputPage::addCategoryLinks() (T373830)]] [production]
22:28 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ganeti1041.eqiad.wmnet with OS bookworm [production]
22:27 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:27 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:27 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2170 (T371742)', diff saved to https://phabricator.wikimedia.org/P68987 and previous config saved to /var/cache/conftool/dbconfig/20240911-222711-ladsgroup.json [production]
22:26 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1041.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1041.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ganeti1052.eqiad.wmnet with OS bookworm [production]
22:20 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1052.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:19 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1052.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:19 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1051.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:19 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1051.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:19 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1050.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:18 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1050.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:18 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:18 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1049.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:17 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1049.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:17 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1048.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:16 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1048.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:15 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1047.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:14 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1047.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:14 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1046.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:13 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1046.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:13 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1045.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:12 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1045.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:11 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:03 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1052 [production]
22:02 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1051 [production]
22:01 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1052 [production]
22:01 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1051 [production]
22:01 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1050 [production]
22:00 <bking@deploy1003> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
22:00 <bking@deploy1003> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
22:00 <bking@deploy1003> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
22:00 <bking@deploy1003> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
21:59 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1050 [production]
21:59 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1049 [production]
21:59 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072189|ZObjectFactory::validatePersistentKeys: Disable use of JsonSchema, at least temporarily (T374241)]], [[gerrit:1072190|ZObjectFactory::validatePersistentKeys: Disable use of JsonSchema, at least temporarily (T374241)]] (duration: 07m 51s) [production]
21:58 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1049 [production]
21:58 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1048 [production]
21:57 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1048 [production]
21:57 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1047 [production]
21:56 <inflatador> bking@deploy1003 test deploy of flink operator in staging cancelled with no changes T373195 [production]
21:56 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1047 [production]
21:56 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1046 [production]
21:54 <jforrester@deploy1003> jforrester: Continuing with sync [production]
21:54 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1046 [production]
21:54 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1045 [production]