|
2018-06-11
§
|
| 23:45 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT: Lower CirrusSearch delayed job drop timeout (duration: 00m 50s) |
[production] |
| 23:26 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Tune CirrusSearch slow logging (duration: 00m 48s) |
[production] |
| 23:18 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Promote Cirrus MLR models from AB test to prod (duration: 00m 51s) |
[production] |
| 23:02 |
<twentyafterfour> |
phabricator: restarting apache2 on phab1001 to free up apache workers |
[production] |
| 22:17 |
<awight@deploy1001> |
Finished deploy [ores/deploy@6ee8775]: ORES: bswiki, euwiki, srwiki models (duration: 33m 58s) |
[production] |
| 21:43 |
<awight@deploy1001> |
Started deploy [ores/deploy@6ee8775]: ORES: bswiki, euwiki, srwiki models |
[production] |
| 20:57 |
<arlolra> |
Updated Parsoid to 06b74d2 (T191843) |
[production] |
| 20:49 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@97cdab8]: Updating Parsoid to 06b74d2 (duration: 17m 09s) |
[production] |
| 20:32 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@97cdab8]: Updating Parsoid to 06b74d2 |
[production] |
| 20:27 |
<otto@deploy1001> |
Finished deploy [eventstreams/deploy@6b013f9]: Enable composite stream and timestamp since param - T196009 , T187418 (duration: 09m 52s) |
[production] |
| 20:17 |
<otto@deploy1001> |
Started deploy [eventstreams/deploy@6b013f9]: Enable composite stream and timestamp since param - T196009 , T187418 |
[production] |
| 20:02 |
<ottomata> |
bouncing varnishkafka-webrequest on cp3039,cp3047,cp2007,cp3010 |
[production] |
| 19:56 |
<ottomata> |
bouncing varnishkafka on cp3032 |
[production] |
| 19:29 |
<aaron@deploy1001> |
Synchronized php-1.32.0-wmf.7/includes/libs/rdbms/ChronologyProtector.php: 11e596776f940 - add some logging details (duration: 00m 53s) |
[production] |
| 18:50 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Restore full config (duration: 00m 16s) |
[production] |
| 18:49 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Restore full config |
[production] |
| 18:15 |
<urandom> |
convert timeline indices to time-windowed compaction - T196024 |
[production] |
| 17:59 |
<twentyafterfour> |
phabricator: taking phd offline while I clear out the queue backlog (downtime is logged in icinga) see T196840 |
[production] |
| 17:51 |
<twentyafterfour> |
phabricator: rebuilding git parent caches |
[production] |
| 17:33 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater (duration: 13m 38s) |
[production] |
| 17:27 |
<twentyafterfour> |
phabricator: restarting phd for D1067 |
[production] |
| 17:25 |
<twentyafterfour> |
Phabricator: deploying hotfix (D1067) refs T196840 T196860 T196855 |
[production] |
| 17:20 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater |
[production] |
| 17:19 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater (duration: 00m 03s) |
[production] |
| 17:19 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater |
[production] |
| 17:17 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater (wdqs1009 only) (duration: 00m 26s) |
[production] |
| 17:16 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@37f6f32]: new version of wdqs GUI and updater (wdqs1009 only) |
[production] |
| 17:00 |
<akosiaris> |
ganeti2008 reboot for microcode update |
[production] |
| 16:42 |
<marostegui> |
Set disk 32:1 offline on db1065 to get a new one - T196806 |
[production] |
| 16:02 |
<akosiaris@deploy1001> |
Finished deploy [proton/deploy@97ec4bf]: (no justification provided) (duration: 01m 32s) |
[production] |
| 16:00 |
<akosiaris@deploy1001> |
Started deploy [proton/deploy@97ec4bf]: (no justification provided) |
[production] |
| 15:44 |
<akosiaris@deploy1001> |
Finished deploy [proton/deploy@97ec4bf]: (no justification provided) (duration: 00m 33s) |
[production] |
| 15:43 |
<akosiaris@deploy1001> |
Started deploy [proton/deploy@97ec4bf]: (no justification provided) |
[production] |
| 15:43 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1084 after alter table (duration: 00m 50s) |
[production] |
| 15:33 |
<akosiaris@deploy1001> |
Finished deploy [proton/deploy@97ec4bf]: (no justification provided) (duration: 00m 22s) |
[production] |
| 15:33 |
<akosiaris@deploy1001> |
Started deploy [proton/deploy@97ec4bf]: (no justification provided) |
[production] |
| 15:31 |
<marostegui> |
Set offline disk 32:3 on db1063 - T196806 |
[production] |
| 15:31 |
<marostegui> |
Set offline disk 32:1 on db1065 - T196806 |
[production] |
| 15:02 |
<akosiaris@deploy1001> |
Finished deploy [proton/deploy@97ec4bf]: (no justification provided) (duration: 35m 33s) |
[production] |
| 14:55 |
<marostegui> |
Deploy schema change on db1084 T191316 T192926 T89737 T195193 |
[production] |
| 14:55 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1084 for alter table (duration: 00m 50s) |
[production] |
| 14:53 |
<akosiaris> |
reboot bohrium for kernel upgrades and spec-ctrl enabling. Manually stopped mysql behorehand |
[production] |
| 14:50 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1081 after alter table (duration: 00m 50s) |
[production] |
| 14:35 |
<akosiaris> |
reboot mx1001, poolcounter1001 for kernel upgrades and spec-ctrl enabling |
[production] |
| 14:26 |
<akosiaris@deploy1001> |
Started deploy [proton/deploy@97ec4bf]: (no justification provided) |
[production] |
| 14:25 |
<godog> |
upload scap 3.8.2-1 - T196710 |
[production] |
| 14:21 |
<hoo> |
Updated operations/dumps/dcat (536bd5b..559dee3) on snapshot1008 |
[production] |
| 13:58 |
<marostegui> |
Deploy schema change on db1081 T191316 T192926 T89737 T195193 |
[production] |
| 13:56 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1081 for alter table (duration: 00m 48s) |
[production] |