2801-2850 of 10000 results (40ms)
2024-11-28 §
22:05 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db1178 gradually with 4 steps - Maint over (T361627) [production]
15:39 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
15:39 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
15:10 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
15:10 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
14:55 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
14:55 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
14:51 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
14:51 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
11:48 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2237 gradually with 4 steps - Maint over (T379813) [production]
11:03 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db2237 gradually with 4 steps - Maint over (T379813) [production]
09:22 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.5 refs T375664 [production]
2024-11-27 §
18:37 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dns7001.wikimedia.org with reason: T380307 [production]
18:37 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on dns7001.wikimedia.org with reason: T380307 [production]
11:21 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dns7002.wikimedia.org with reason: T376737 [production]
11:21 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on dns7002.wikimedia.org with reason: T376737 [production]
11:21 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dns7001.wikimedia.org with reason: T376737 [production]
11:20 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on dns7001.wikimedia.org with reason: T376737 [production]
11:19 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs[7001-7003].magru.wmnet with reason: T376737 [production]
11:19 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on lvs[7001-7003].magru.wmnet with reason: T376737 [production]
11:19 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 16 hosts with reason: T376737 [production]
11:19 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on 16 hosts with reason: T376737 [production]
09:44 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.5 refs T375664 [production]
2024-11-26 §
21:17 <reedy@deploy2002> Synchronized wmf-config/core-Permissions.php: T380753 (duration: 11m 23s) [production]
18:34 <ladsgroup@cumin1002> END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) db2215 gradually with 4 steps - Maint over [production]
18:33 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db2215 gradually with 4 steps - Maint over [production]
15:33 <ladsgroup@cumin1002> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) db2215 gradually with 4 steps - Maint over [production]
15:33 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db2215 gradually with 4 steps - Maint over [production]
13:28 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp7002.magru.wmnet with reason: T376737 [production]
13:28 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp7002.magru.wmnet with reason: T376737 [production]
13:27 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp7008.magru.wmnet with reason: T376737 [production]
13:27 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp7008.magru.wmnet with reason: T376737 [production]
13:27 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp7006.magru.wmnet with reason: T376737 [production]
13:26 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp7006.magru.wmnet with reason: T376737 [production]
13:26 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp7001.magru.wmnet with reason: T376737 [production]
13:26 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp7001.magru.wmnet with reason: T376737 [production]
12:26 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.5 refs T375664 [production]
12:10 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1098006|Bump ratio of new parsercache key spec to 4 (T373037)]] (duration: 15m 21s) [production]
12:01 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1098006|Bump ratio of new parsercache key spec to 4 (T373037)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:55 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1098006|Bump ratio of new parsercache key spec to 4 (T373037)]] [production]
11:54 <hashar@deploy2002> Finished scap sync-world: testwikis to 1.44.0-wmf.5 refs T375664 (duration: 25m 52s) [production]
11:28 <hashar@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.5 refs T375664 [production]
11:25 <hashar@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.5 refs T375664 [production]
10:47 <hashar@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.5 refs T375664 [production]
2024-11-25 §
18:08 <swfrench-wmf> rebuilt php8.1 production images to pick up 8.1.31 [production]
16:45 <hashar@deploy2002> Pruned MediaWiki: 1.44.0-wmf.2 (duration: 03m 05s) [production]
16:42 <swfrench-wmf> uploaded php8.1 8.1.31-1+wmf11u1 to apt.w.o (16:25 UTC) [production]
13:17 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1179 gradually with 4 steps - Maint over [production]
12:32 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db1179 gradually with 4 steps - Maint over [production]
12:06 <hashar@deploy2002> Pruned MediaWiki: 1.39.0-wmf.1 (duration: 00m 40s) [production]