1-50 of 10000 results (1ms)
2026-10-15 ยง
21:10 <kemayo@deploy1003> kemayo: Continuing with deployment [production]
21:08 <kemayo@deploy1003> kemayo: Backport for [[gerrit:1355871|Suggestion mode: tighten behavior of 'view more' button in publish card (T432622)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:08 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1352.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
21:06 <kemayo@deploy1003> Started scap sync-world: Backport for [[gerrit:1355871|Suggestion mode: tighten behavior of 'view more' button in publish card (T432622)]] (1.47.0-wmf.24) [production]
21:01 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1352.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
21:01 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2047.codfw.wmnet [production]
21:01 <cdobbins@cumin1004> START - Cookbook sre.hosts.remove-downtime for cp2047.codfw.wmnet [production]
21:01 <cdobbins@cumin1004> conftool action : set/pooled=yes; selector: name=cp2047.* [production]
21:01 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1352.eqiad.wmnet [production]
21:01 <cdobbins@cumin1004> END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp2047'] [production]
21:00 <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) (duration: 06m 53s) [production]
21:00 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1352.eqiad.wmnet [production]
21:00 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1351.eqiad.wmnet [production]
20:59 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1351.eqiad.wmnet [production]
20:59 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1351.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:59 <cscott@deploy1003> cscott: Continuing with deployment [production]
20:55 <cscott@deploy1003> cscott: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:54 <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) [production]
20:52 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1351.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:52 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1351.eqiad.wmnet [production]
20:52 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1351.eqiad.wmnet [production]
20:51 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1350.eqiad.wmnet [production]
20:51 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1350.eqiad.wmnet [production]
20:51 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1350.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:51 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2341.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:48 <lerickson@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
20:44 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1350.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:44 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2341.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
20:44 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1350.eqiad.wmnet [production]
20:44 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2341.codfw.wmnet [production]
20:43 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1350.eqiad.wmnet [production]
20:43 <oblivian@cumin1004> START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1350-1379].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) [production]
20:43 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2341.codfw.wmnet [production]
20:43 <oblivian@cumin1004> START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2341-2364].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
20:35 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1330-1349].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) [production]
20:35 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1349.eqiad.wmnet [production]
20:35 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1349.eqiad.wmnet [production]
20:35 <cdobbins@cumin1004> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] [production]
20:35 <cdobbins@cumin1004> conftool action : set/pooled=no; selector: name=cp2047.* [production]
20:34 <cdobbins@cumin1004> conftool action : set/pooled=yes; selector: name=cp2049.* [production]
20:34 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2049.codfw.wmnet [production]
20:34 <cdobbins@cumin1004> START - Cookbook sre.hosts.remove-downtime for cp2049.codfw.wmnet [production]
20:32 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
20:19 <cdobbins@cumin1004> START - Cookbook sre.hosts.provision for host cp2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
20:17 <kemayo@deploy1003> Finished scap sync-world: Backport for [[gerrit:1355831|VisualEditor: Precompute edit suggestion counts on 50% of enwiki (T433024)]], [[gerrit:1355188|InitialiseSettings: enable return-to-app banner on all wikis (T439746)]] (duration: 14m 43s) [production]
20:16 <lerickson@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
20:12 <kemayo@deploy1003> kemayo, cklimas: Continuing with deployment [production]
20:11 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2049.codfw.wmnet [production]
20:11 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2049.codfw.wmnet [production]
20:10 <dduvall> performing rolling restart of docker on integration-agent-docker instances to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/1355127 (T440670) [releng]