5651-5700 of 10000 results (34ms)
2021-01-07 §
00:44 <shdubsh> restart elasticsearch on logstash1011 - oom [production]
2021-01-06 §
22:34 <sbassett> Deployed security patch for T270988 to wmf.22 [production]
22:32 <sbassett> Deployed security patch for T270988 to wmf.25 [production]
22:17 <legoktm> forced gerrit to replicate RequestTimeout to github (`ssh gerrit.wikimedia.org replication start mediawiki/libs/RequestTimeout --wait`) [production]
21:59 <dwisehaupt> increased batch size for eoy_receipt to 4000 per run when frmx1001 is the primary mx [production]
21:58 <dwisehaupt> process-control config revision is 603c0ff4a0 [production]
21:25 <andrew@deploy1001> Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 09m 04s) [production]
21:23 <jhuneidi@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.25 refs T267418 (duration: 01m 04s) [production]
21:22 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.25 refs T267418 [production]
21:16 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:16 <andrew@deploy1001> Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 06s) [production]
21:16 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:15 <andrew@deploy1001> Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 05s) [production]
21:15 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:14 <andrew@deploy1001> Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 05s) [production]
21:14 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:13 <andrew@deploy1001> Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 08m 42s) [production]
21:10 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.25 refs T267418 [production]
21:04 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:04 <andrew@deploy1001> deploy aborted: update codfw1dev deploy from train-buster branch (duration: 00m 07s) [production]
21:04 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:04 <andrew@deploy1001> deploy aborted: update codfw1dev deploy from train-buster branch (duration: 00m 07s) [production]
21:04 <andrew@deploy1001> Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch [production]
21:00 <andrew@deploy1001> Finished deploy [horizon/deploy@965995d]: update codfw1dev deploy from train-buster branch (duration: 01m 51s) [production]
20:58 <andrew@deploy1001> Started deploy [horizon/deploy@965995d]: update codfw1dev deploy from train-buster branch [production]
20:43 <andrew@deploy1001> Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 02m 30s) [production]
20:40 <andrew@deploy1001> Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster [production]
20:40 <andrew@deploy1001> Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 00m 07s) [production]
20:40 <andrew@deploy1001> Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster [production]
20:38 <andrew@deploy1001> Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 00m 05s) [production]
20:38 <andrew@deploy1001> Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster [production]
20:27 <andrew@deploy1001> Finished deploy [horizon/deploy@89b308c]: (no justification provided) (duration: 00m 05s) [production]
20:27 <andrew@deploy1001> Started deploy [horizon/deploy@89b308c]: (no justification provided) [production]
20:26 <andrew@deploy1001> Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy (duration: 00m 08s) [production]
20:26 <andrew@deploy1001> Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy [production]
19:37 <eileen> increased batch processes on eoy_receipt - now 9000 per hour process-control config revision is 7b8319b97d [production]
19:25 <dpifke> Morning backport window complete. [production]
19:22 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
19:20 <dpifke@deploy1001> Synchronized lib: Removing unused profiler libraries (duration: 01m 03s) [production]
19:19 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
19:18 <dpifke@deploy1001> Synchronized wmf-config/PhpAutoPrepend.php: Removing unused profiler code (duration: 01m 04s) [production]
19:17 <dpifke@deploy1001> Synchronized wmf-config/profiler.php: Removing unused profiler code (duration: 01m 08s) [production]
19:13 <eileen> process-control config revision is 2909e8b9ed [production]
19:11 <eileen> civicrm revision changed from 1d5f6365ba to 95fefcb421, config revision is 9bc3d67b02 [production]
18:14 <mutante> creating uz.wikimedia.org - Uzbek language User Group - https://meta.wikimedia.org/wiki/Affiliations_Committee/Resolutions/Wikimedians_of_the_Uzbek_language_User_Group [production]
17:53 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
17:51 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
17:26 <andrewbogott> depooling labweb1002 for rebuild [production]
17:00 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2026.codfw.wmnet with reason: REIMAGE [production]
16:58 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1026.eqiad.wmnet with reason: REIMAGE [production]