201-250 of 10000 results (105ms)
2026-02-25 ยง
21:40 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2024.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:39 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2023.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:37 <cjming@deploy2002> cjming, phuedx: Continuing with sync [production]
21:37 <cjming@deploy2002> cjming, phuedx: Backport for [[gerrit:1243922|JS SDK: Added `Instrument#submitClick` for backwards compatibility]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:35 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2044.codfw.wmnet with reason: host reimage [production]
21:35 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1243922|JS SDK: Added `Instrument#submitClick` for backwards compatibility]] [production]
21:30 <cdobbins@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp2044.codfw.wmnet with reason: host reimage [production]
21:27 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-fe2024.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:26 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1243892|JS SDK: Fix instrument_name field handling]] (duration: 06m 41s) [production]
21:26 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-fe2023.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:23 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be2096.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:22 <cjming@deploy2002> phuedx, cjming: Continuing with sync [production]
21:22 <cjming@deploy2002> phuedx, cjming: Backport for [[gerrit:1243892|JS SDK: Fix instrument_name field handling]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:20 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1243892|JS SDK: Fix instrument_name field handling]] [production]
21:16 <cjming@deploy2002> mwscript-k8s job started: emptyUserGroup zhwiki accountcreator '--log-reason=[[phab:T418089]]' # T418089 [production]
21:14 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1243817|zhwiki: remove accountcreator usergroup (T418089)]] (duration: 07m 34s) [production]
21:11 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp2044.codfw.wmnet with OS trixie [production]
21:11 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply [production]
21:10 <cjming@deploy2002> cjming, anzx: Continuing with sync [production]
21:10 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply [production]
21:09 <cjming@deploy2002> cjming, anzx: Backport for [[gerrit:1243817|zhwiki: remove accountcreator usergroup (T418089)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:09 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2043.codfw.wmnet with OS trixie [production]
21:07 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1243817|zhwiki: remove accountcreator usergroup (T418089)]] [production]
20:49 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply [production]
20:49 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply [production]
20:48 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2043.codfw.wmnet with reason: host reimage [production]
20:47 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply [production]
20:47 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply [production]
20:42 <cdobbins@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp2043.codfw.wmnet with reason: host reimage [production]
20:24 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp2043.codfw.wmnet with OS trixie [production]
19:12 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.17 refs T413808 [production]
18:54 <swfrench@cumin2002> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Deploy: Fix scoping logic for haproxy DSL - swfrench@cumin2002" [production]
18:54 <swfrench@cumin2002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Deploy: Fix scoping logic for haproxy DSL - swfrench@cumin2002 [production]
18:53 <swfrench@cumin2002> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Deploy: Fix scoping logic for haproxy DSL - swfrench@cumin2002 [production]
18:53 <swfrench@cumin2002> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Deploy: Fix scoping logic for haproxy DSL - swfrench@cumin2002" [production]
18:44 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1243859|cleanup: Remove bunch of unnecessary code from ReassignMentees]] (duration: 07m 26s) [production]
18:40 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
18:39 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1243859|cleanup: Remove bunch of unnecessary code from ReassignMentees]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:36 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1243859|cleanup: Remove bunch of unnecessary code from ReassignMentees]] [production]
17:53 <oblivian@cumin1003> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "haproxy moat mode - oblivian@cumin1003" [production]
17:53 <oblivian@cumin1003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: haproxy moat mode - oblivian@cumin1003 [production]
17:52 <oblivian@cumin1003> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: haproxy moat mode - oblivian@cumin1003 [production]
17:52 <oblivian@cumin1003> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "haproxy moat mode - oblivian@cumin1003" [production]
17:38 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pki1002.eqiad.wmnet with OS trixie [production]
17:33 <aqu@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
17:32 <cgoubert@deploy2002> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:32 <aqu@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
17:31 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: sync [production]
17:31 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: sync [production]
17:30 <cgoubert@deploy2002> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]