601-650 of 10000 results (35ms)
2026-07-14 §
05:07 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host gitlab1004.wikimedia.org [production]
04:01 <mwpresync@deploy2003> Pruned MediaWiki: 1.47.0-wmf.8 (duration: 01m 07s) [production]
03:39 <mwpresync@deploy2003> Finished scap sync-world: testwikis to 1.47.0-wmf.11 refs T430830 (duration: 36m 01s) [production]
03:03 <mwpresync@deploy2003> Started scap sync-world: testwikis to 1.47.0-wmf.11 refs T430830 [production]
02:45 <larssandergreen> tools upgraded from 0c0cbb37 to 93a9d78d [fundraising]
02:06 <mwpresync@deploy2003> Finished scap build-images: Publishing wmf/next image (duration: 06m 29s) [production]
02:00 <mwpresync@deploy2003> Started scap build-images: Publishing wmf/next image [production]
01:42 <larssandergreen> civicrm upgraded from 015e84b8 to 24d6e9a0 [fundraising]
01:18 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
01:06 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
01:04 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
00:53 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
00:42 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
00:29 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
00:21 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
00:10 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
2026-07-13 §
23:33 <ladsgroup@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ms-be1064.eqiad.wmnet [production]
23:33 <ladsgroup@cumin1003> START - Cookbook sre.hosts.remove-downtime for ms-be1064.eqiad.wmnet [production]
23:08 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1064.eqiad.wmnet with reason: vacuum overlarge container dbs [production]
23:06 <ladsgroup@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ms-be1069.eqiad.wmnet [production]
23:06 <ladsgroup@cumin1003> START - Cookbook sre.hosts.remove-downtime for ms-be1069.eqiad.wmnet [production]
22:46 <larssandergreen> civicrm upgraded from 171652fa to 015e84b8 [fundraising]
22:34 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1069.eqiad.wmnet with reason: vacuum overlarge container dbs [production]
21:59 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api [toolsbeta]
21:55 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
21:50 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api [toolsbeta]
21:47 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
21:47 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api [toolsbeta]
21:43 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
21:18 <maryum> Deployed security fix for T321092 [production]
20:28 <swfrench-wmf> reprepro include etcd-mirror_0.0.12-1+deb13u1 into main for trixie-wikimedia - T424266 [production]
20:26 <swfrench-wmf> reprepro include etcd-mirror_0.0.12-1+deb12u1 into main for bookworm-wikimedia - T428495 [production]
20:23 <dancy@deploy2003> Finished scap sync-world: Testing T431635 (duration: 03m 36s) [production]
20:19 <dancy@deploy2003> Started scap sync-world: Testing T431635 [production]
20:18 <dancy@deploy2003> Installation of scap version "4.274.0" completed for 3 hosts [production]
20:16 <dancy@deploy2003> Installing scap version "4.274.0" for 3 host(s) [production]
20:12 <kemayo@deploy2003> Finished scap sync-world: Backport for [[gerrit:1212157|Enable DiscussionTools visual enhancements on enwiki (T409297)]], [[gerrit:1310161|Disable mobile "exit the editor" survey phase 2 (T426135)]], [[gerrit:1304630|Add source tab to ukwikisource's "Архів" (Archive) namespace (T53980)]] (duration: 08m 25s) [production]
20:07 <kemayo@deploy2003> soda, esanders, kemayo: Continuing with deployment [production]
20:05 <kemayo@deploy2003> soda, esanders, kemayo: Backport for [[gerrit:1212157|Enable DiscussionTools visual enhancements on enwiki (T409297)]], [[gerrit:1310161|Disable mobile "exit the editor" survey phase 2 (T426135)]], [[gerrit:1304630|Add source tab to ukwikisource's "Архів" (Archive) namespace (T53980)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there [production]
20:03 <kemayo@deploy2003> Started scap sync-world: Backport for [[gerrit:1212157|Enable DiscussionTools visual enhancements on enwiki (T409297)]], [[gerrit:1310161|Disable mobile "exit the editor" survey phase 2 (T426135)]], [[gerrit:1304630|Add source tab to ukwikisource's "Архів" (Archive) namespace (T53980)]] [production]
19:48 <eileen> civicrm upgraded from 263ff140 to 171652fa [fundraising]
19:05 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on tools-cumin-2.tools.eqiad1.wikimedia.cloud [tools]
19:01 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on tools-cumin-2.tools.eqiad1.wikimedia.cloud [tools]
18:53 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=99) with prefix 'tools-cumin' [tools]
18:46 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'tools-cumin' [tools]
18:22 <cwhite> lvextend vg0/srv +500g on centrallog hosts [production]
18:19 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns7002.wikimedia.org with OS trixie [production]
17:46 <ladsgroup@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ms-be1071.eqiad.wmnet [production]
17:46 <ladsgroup@cumin1003> START - Cookbook sre.hosts.remove-downtime for ms-be1071.eqiad.wmnet [production]
17:13 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1071.eqiad.wmnet with reason: vacuum overlarge container dbs [production]