1401-1450 of 10000 results (18ms)
2024-10-29 §
08:08 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) db1169 gradually with 4 steps - index rebuilt [production]
08:08 <arnaudb@cumin1002> START - Cookbook sre.mysql.pool db1169 gradually with 4 steps - index rebuilt [production]
08:06 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) db1169 gradually with 4 steps - index rebuilt [production]
08:06 <arnaudb@cumin1002> START - Cookbook sre.mysql.pool db1169 gradually with 4 steps - index rebuilt [production]
04:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.43.0-wmf.26 (duration: 01m 04s) [production]
03:53 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.44.0-wmf.1 refs T375660 (duration: 49m 51s) [production]
03:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.1 refs T375660 [production]
2024-10-28 §
08:27 <hashar> Pushed https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/1083592 and https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1083591 for wmf/1.43.0-wmf.28 / T378132 due to a dependency loop [production]
08:24 <hashar> Pushed https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/1083592 and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/1083592 for wmf/1.43.0-wmf.28 / T378132 due to a dependency loop [production]
07:14 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db[1169,1234].eqiad.wmnet with reason: maintenance [production]
07:14 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db[1169,1234].eqiad.wmnet with reason: maintenance [production]
2024-10-24 §
18:09 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.28 refs T375659 [production]
16:05 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.28 refs T375659 [production]
09:12 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on pc[1014,1017].eqiad.wmnet with reason: pc maintenance T378068 [production]
09:12 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on pc[1014,1017].eqiad.wmnet with reason: pc maintenance T378068 [production]
06:44 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
06:44 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
04:58 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
04:57 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
2024-10-23 §
18:26 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.28 refs T375659 [production]
09:34 <volans@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1185 gradually with 4 steps - Testing new cookbook [production]
09:30 <volans@cumin1002> START - Cookbook sre.mysql.pool db1185 gradually with 4 steps - Testing new cookbook [production]
09:24 <volans@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1185 gradually with 4 steps - Testing new cookbook [production]
09:24 <volans@cumin1002> START - Cookbook sre.mysql.pool db1185 gradually with 4 steps - Testing new cookbook [production]
2024-10-22 §
19:54 <swfrench-wmf> running puppet on A:cp-text (-b11) after validating ATS Lua changes on cp4040 - T372605 [production]
19:40 <swfrench-wmf> disabling puppet on A:cp-text before merging ATS Lua changes - T372605 [production]
18:17 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.28 refs T375659 [production]
17:18 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs2014.codfw.wmnet with reason: rebooting to test changes rolled out in CR 1006063 [production]
17:17 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on lvs2014.codfw.wmnet with reason: rebooting to test changes rolled out in CR 1006063 [production]
17:03 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
17:03 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
16:16 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
16:15 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
14:29 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
14:29 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
12:09 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db[2149,2227].codfw.wmnet with reason: maintenance [production]
12:09 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db[2149,2227].codfw.wmnet with reason: maintenance [production]
07:59 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db[2149,2205].codfw.wmnet with reason: db2205 reclone [production]
07:59 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db[2149,2205].codfw.wmnet with reason: db2205 reclone [production]
04:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.43.0-wmf.25 (duration: 00m 58s) [production]
03:52 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.43.0-wmf.28 refs T375659 (duration: 49m 37s) [production]
03:02 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.43.0-wmf.28 refs T375659 [production]
2024-10-21 §
21:16 <swfrench-wmf> ran authdns-update to pick up mw-(web|api-ext)-next discovery records - T377040 [production]
19:36 <dduvall@deploy2002> Finished deploy [releng/jenkins-deploy@b75c4aa] (releasing): Deploying changes to MediaWiki branch and publish WMF single-version image job (duration: 01m 20s) [production]
19:34 <dduvall@deploy2002> Started deploy [releng/jenkins-deploy@b75c4aa] (releasing): Deploying changes to MediaWiki branch and publish WMF single-version image job [production]
19:01 <swfrench-wmf> ran and enabled puppet agent on 'A:lvs and A:codfw' - T377040 [production]
18:36 <swfrench-wmf> ran and enabled puppet agent on 'A:lvs and A:eqiad' - T377040 [production]
18:32 <swfrench-wmf> ran disable-puppet on 'A:lvs and (A:eqiad or A:codfw)' - T377040 [production]
18:19 <swfrench-wmf> ran and enabled pupppet agent on 'A:lvs and A:codfw' - T377040 [production]
18:04 <swfrench-wmf> ran and enabled pupppet agent on 'A:lvs and A:eqiad' - T377040 [production]