201-250 of 10000 results (126ms)
2026-07-21 §
05:43 <oblivian@cumin1003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Haproxy-only mode support - oblivian@cumin1003 [production]
05:42 <oblivian@cumin1003> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Haproxy-only mode support - oblivian@cumin1003 [production]
05:42 <oblivian@cumin1003> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Haproxy-only mode support - oblivian@cumin1003" [production]
05:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1017.eqiad.wmnet with reason: Cloning [production]
05:37 <marostegui@cumin1003> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
05:33 <marostegui@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1029.eqiad.wmnet,service=s8 [production]
05:33 <marostegui@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1029.eqiad.wmnet,service=s5 [production]
05:32 <kevinbazira@deploy2003> helmfile [ml-staging-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . [production]
05:30 <kevinbazira@deploy2003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
05:11 <aokoth@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1003.eqiad.wmnet [production]
05:04 <aokoth@cumin1003> START - Cookbook sre.hosts.reboot-single for host vrts1003.eqiad.wmnet [production]
05:00 <kevinbazira@deploy2003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
04:56 <kevinbazira@deploy2003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
04:01 <mwpresync@deploy2003> Pruned MediaWiki: 1.47.0-wmf.9 (duration: 01m 08s) [production]
03:41 <mwpresync@deploy2003> Finished scap sync-world: testwikis to 1.47.0-wmf.12 refs T430831 (duration: 36m 30s) [production]
03:05 <mwpresync@deploy2003> Started scap sync-world: testwikis to 1.47.0-wmf.12 refs T430831 [production]
03:01 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
03:01 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
03:00 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
03:00 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:45 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
02:45 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
02:45 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
02:45 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:44 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
02:44 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
02:44 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
02:44 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:43 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
02:43 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
02:43 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
02:43 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:41 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
02:41 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
02:41 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
02:41 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:36 <ssastry@deploy2003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
02:36 <ssastry@deploy2003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
02:36 <ssastry@deploy2003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
02:35 <ssastry@deploy2003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
02:16 <ryankemper@cumin2003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1023.eqiad.wmnet with OS bookworm [production]
02:07 <mwpresync@deploy2003> Finished scap build-images: Publishing wmf/next image (duration: 06m 47s) [production]
02:00 <mwpresync@deploy2003> Started scap build-images: Publishing wmf/next image [production]
00:56 <ryankemper@cumin2003> START - Cookbook sre.hosts.reimage for host wdqs1023.eqiad.wmnet with OS bookworm [production]
2026-07-20 §
23:38 <ryankemper@cumin2003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1023.eqiad.wmnet with OS bookworm [production]
23:07 <Amir1> deleting echo notifications from 2015 on group1 wikis [production]
23:07 <ladsgroup@deploy2003> Finished scap sync-world: Backport for [[gerrit:1312302|Disable MJPEG, enable MPEG-4 Part II (T358266)]] (duration: 14m 16s) [production]
23:01 <ladsgroup@deploy2003> ladsgroup: Continuing with deployment [production]
23:00 <ladsgroup@deploy2003> ladsgroup: Backport for [[gerrit:1312302|Disable MJPEG, enable MPEG-4 Part II (T358266)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:53 <ladsgroup@deploy2003> Started scap sync-world: Backport for [[gerrit:1312302|Disable MJPEG, enable MPEG-4 Part II (T358266)]] [production]