1-50 of 10000 results (3ms)
2026-09-24 ยง
23:20 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1023.eqiad.wmnet [production]
23:20 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1022.eqiad.wmnet [production]
23:20 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1022.eqiad.wmnet [production]
23:11 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1022.eqiad.wmnet [production]
22:41 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet [production]
22:41 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet [production]
22:41 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet [production]
22:28 <ryankemper> [WDQS] Expanding match in https://requestctl.wikimedia.org/pattern/ua/rocks to test a likely block candidate [production]
22:28 <wmbot~sportz@tools-bastion-15> gerrit-vue-watcher: Updating 6a90c89..02e4ca7 [tools.ultraviolet]
22:27 <egardner@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344049|ReaderExperiments: Set the preferred-sources debug flag on testwiki (T436692)]], [[gerrit:1344050|ReaderExperiments: Drop the stale ShareHighlight config var (T424764)]], [[gerrit:1344118|Enable ReadingList CTA on Minerva for our test wikis (inc beta cluster) (T438779)]], [[gerrit:1343560|Revert "Enable Reading Recommendations experiment on t [production]
22:22 <egardner@deploy1003> volker-e, egardner, jdlrobson: Continuing with deployment [production]
22:21 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1021.eqiad.wmnet [production]
22:19 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1021.eqiad.wmnet [production]
22:19 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1020.eqiad.wmnet [production]
22:19 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1020.eqiad.wmnet [production]
22:14 <egardner@deploy1003> volker-e, egardner, jdlrobson: Backport for [[gerrit:1344049|ReaderExperiments: Set the preferred-sources debug flag on testwiki (T436692)]], [[gerrit:1344050|ReaderExperiments: Drop the stale ShareHighlight config var (T424764)]], [[gerrit:1344118|Enable ReadingList CTA on Minerva for our test wikis (inc beta cluster) (T438779)]], [[gerrit:1343560|Revert "Enable Reading Recommendations experiment [production]
22:10 <egardner@deploy1003> Started scap sync-world: Backport for [[gerrit:1344049|ReaderExperiments: Set the preferred-sources debug flag on testwiki (T436692)]], [[gerrit:1344050|ReaderExperiments: Drop the stale ShareHighlight config var (T424764)]], [[gerrit:1344118|Enable ReadingList CTA on Minerva for our test wikis (inc beta cluster) (T438779)]], [[gerrit:1343560|Revert "Enable Reading Recommendations experiment on te [production]
22:04 <brett@cumin1004> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text_magru and not P{cp7001.magru.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () [production]
22:02 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1020.eqiad.wmnet [production]
22:00 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1020.eqiad.wmnet [production]
22:00 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1019.eqiad.wmnet [production]
22:00 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1019.eqiad.wmnet [production]
21:58 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp4052.* [production]
21:57 <jhuneidi@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.21 refs T438217 [production]
21:53 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1019.eqiad.wmnet [production]
21:53 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1019.eqiad.wmnet [production]
21:53 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1018.eqiad.wmnet [production]
21:53 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1018.eqiad.wmnet [production]
21:48 <brett@cumin1004> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp4052.ulsfo.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () [production]
21:46 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1018.eqiad.wmnet [production]
21:46 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1018.eqiad.wmnet [production]
21:46 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1016.eqiad.wmnet [production]
21:46 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1016.eqiad.wmnet [production]
21:45 <catrope@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344795|Catch newline character in UserMailer to prevent it from allowing bad actors to create an additional header (T434545)]] (duration: 17m 05s) [production]
21:42 <brett@cumin1004> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp4052.ulsfo.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () [production]
21:40 <catrope@deploy1003> catrope: Continuing with deployment [production]
21:35 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1016.eqiad.wmnet [production]
21:35 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1016.eqiad.wmnet [production]
21:34 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1015.eqiad.wmnet [production]
21:34 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1015.eqiad.wmnet [production]
21:34 <ejegg> payments-wiki upgraded from 375adf37 to 49e656bc [fundraising]
21:34 <brett@cumin1004> END (FAIL) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=1) rolling upgrade of Varnish on P{cp405[1-2].ulsfo.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () [production]
21:33 <catrope@deploy1003> catrope: Backport for [[gerrit:1344795|Catch newline character in UserMailer to prevent it from allowing bad actors to create an additional header (T434545)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:28 <catrope@deploy1003> Started scap sync-world: Backport for [[gerrit:1344795|Catch newline character in UserMailer to prevent it from allowing bad actors to create an additional header (T434545)]] [production]
21:27 <catrope@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344406|ext.wikimediaEvents.testKitchen: Add withContext helper (T438898)]], [[gerrit:1344716|ReaderExperiments: add dewiki and svwiki (T438072)]], [[gerrit:1344740|Image Browsing carousel: taps outside the preview dialog should close it (T439006)]], [[gerrit:1344752|Cap the dialog viewport (T439007)]] (duration: 19m 27s) [production]
21:26 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1015.eqiad.wmnet [production]
21:22 <catrope@deploy1003> cjming, mfossati, catrope, mlitn: Continuing with deployment [production]
21:12 <catrope@deploy1003> cjming, mfossati, catrope, mlitn: Backport for [[gerrit:1344406|ext.wikimediaEvents.testKitchen: Add withContext helper (T438898)]], [[gerrit:1344716|ReaderExperiments: add dewiki and svwiki (T438072)]], [[gerrit:1344740|Image Browsing carousel: taps outside the preview dialog should close it (T439006)]], [[gerrit:1344752|Cap the dialog viewport (T439007)]] synced to the testservers (see https://wi [production]
21:08 <catrope@deploy1003> Started scap sync-world: Backport for [[gerrit:1344406|ext.wikimediaEvents.testKitchen: Add withContext helper (T438898)]], [[gerrit:1344716|ReaderExperiments: add dewiki and svwiki (T438072)]], [[gerrit:1344740|Image Browsing carousel: taps outside the preview dialog should close it (T439006)]], [[gerrit:1344752|Cap the dialog viewport (T439007)]] [production]
21:04 <catrope@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344750|Revert "cirrus: Send more_like traffic to eqiad"]], [[gerrit:1344329|prv: Enable parsoid rendering for 5 wikis (T438998)]] (duration: 10m 45s) [production]