|
2021-01-07
§
|
| 08:14 |
<XioNoX> |
shutdown cr2-eqsin - T267544 |
[production] |
| 07:43 |
<moritzm> |
installing libxml2 security updates on buster |
[production] |
| 07:19 |
<XioNoX> |
depool eqsin for router replacement - T267544 |
[production] |
| 04:12 |
<andrew@deploy1001> |
Finished deploy [striker/deploy@e4db843]: update codfw1dev striker (duration: 00m 48s) |
[production] |
| 04:11 |
<andrew@deploy1001> |
Started deploy [striker/deploy@e4db843]: update codfw1dev striker |
[production] |
| 02:57 |
<andrew@deploy1001> |
Finished deploy [striker/deploy@e120c6c]: update codfw1dev striker (duration: 00m 05s) |
[production] |
| 02:57 |
<andrew@deploy1001> |
Started deploy [striker/deploy@e120c6c]: update codfw1dev striker |
[production] |
| 02:49 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch (duration: 01m 48s) |
[production] |
| 02:48 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch |
[production] |
| 00:50 |
<eileen> |
civicrm revision changed from 95fefcb421 to 2df572bdcd, config revision is 603c0ff4a0 |
[production] |
| 00:44 |
<shdubsh> |
restart elasticsearch on logstash1011 - oom |
[production] |
|
2021-01-06
§
|
| 22:34 |
<sbassett> |
Deployed security patch for T270988 to wmf.22 |
[production] |
| 22:32 |
<sbassett> |
Deployed security patch for T270988 to wmf.25 |
[production] |
| 22:17 |
<legoktm> |
forced gerrit to replicate RequestTimeout to github (`ssh gerrit.wikimedia.org replication start mediawiki/libs/RequestTimeout --wait`) |
[production] |
| 21:59 |
<dwisehaupt> |
increased batch size for eoy_receipt to 4000 per run when frmx1001 is the primary mx |
[production] |
| 21:58 |
<dwisehaupt> |
process-control config revision is 603c0ff4a0 |
[production] |
| 21:25 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 09m 04s) |
[production] |
| 21:23 |
<jhuneidi@deploy1001> |
Synchronized php: group1 wikis to 1.36.0-wmf.25 refs T267418 (duration: 01m 04s) |
[production] |
| 21:22 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.25 refs T267418 |
[production] |
| 21:16 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:16 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 06s) |
[production] |
| 21:16 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:15 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 05s) |
[production] |
| 21:15 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:14 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 00m 05s) |
[production] |
| 21:14 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:13 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch (duration: 08m 42s) |
[production] |
| 21:10 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.25 refs T267418 |
[production] |
| 21:04 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:04 |
<andrew@deploy1001> |
deploy aborted: update codfw1dev deploy from train-buster branch (duration: 00m 07s) |
[production] |
| 21:04 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:04 |
<andrew@deploy1001> |
deploy aborted: update codfw1dev deploy from train-buster branch (duration: 00m 07s) |
[production] |
| 21:04 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b285acd]: update codfw1dev deploy from train-buster branch |
[production] |
| 21:00 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@965995d]: update codfw1dev deploy from train-buster branch (duration: 01m 51s) |
[production] |
| 20:58 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@965995d]: update codfw1dev deploy from train-buster branch |
[production] |
| 20:43 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 02m 30s) |
[production] |
| 20:40 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster |
[production] |
| 20:40 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 00m 07s) |
[production] |
| 20:40 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster |
[production] |
| 20:38 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster (duration: 00m 05s) |
[production] |
| 20:38 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy for Buster |
[production] |
| 20:27 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@89b308c]: (no justification provided) (duration: 00m 05s) |
[production] |
| 20:27 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@89b308c]: (no justification provided) |
[production] |
| 20:26 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@89b308c]: update codfw1dev deploy (duration: 00m 08s) |
[production] |
| 20:26 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@89b308c]: update codfw1dev deploy |
[production] |
| 19:37 |
<eileen> |
increased batch processes on eoy_receipt - now 9000 per hour process-control config revision is 7b8319b97d |
[production] |
| 19:25 |
<dpifke> |
Morning backport window complete. |
[production] |
| 19:22 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |
| 19:20 |
<dpifke@deploy1001> |
Synchronized lib: Removing unused profiler libraries (duration: 01m 03s) |
[production] |
| 19:19 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |