|
2019-03-05
ยง
|
| 12:24 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert gerrit:493155 (duration: 00m 49s) |
[production] |
| 11:59 |
<_joe_> |
upgrading scap everywhere to 3.9.2-1, T217611 |
[production] |
| 11:52 |
<ema> |
lvs400[56]: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 11:45 |
<_joe_> |
installing new scap version in codfw |
[production] |
| 11:44 |
<oblivian@deploy1001> |
Synchronized README: Test deploy for new scap version (duration: 00m 48s) |
[production] |
| 11:43 |
<_joe_> |
installing new swat version on deployment servers, T217611 |
[production] |
| 11:22 |
<_joe_> |
uploading new scap packages , T217611 |
[production] |
| 10:58 |
<ema> |
lvs4007/lvs5003: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 10:57 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 47s) |
[production] |
| 10:55 |
<gilles@deploy1001> |
Synchronized php-1.33.0-wmf.19/extensions/NavigationTiming/NavigationTiming.config.php: T187299 Fix wiki oversampling config validation (duration: 00m 48s) |
[production] |
| 10:37 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 48s) |
[production] |
| 10:27 |
<jiji@cumin1001> |
conftool action : set/weight=4; selector: dc=eqiad,service=citoid,cluster=scb,name=kubernetes.* |
[production] |
| 10:24 |
<jijiki> |
Rump up citoid traffic from k8s to 25% - T213194 |
[production] |
| 10:18 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 47s) |
[production] |
| 10:10 |
<gilles@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T187299 Oversample navtiming on ruwiki and eswiki (duration: 00m 47s) |
[production] |
| 10:07 |
<gilles@deploy1001> |
Synchronized php-1.33.0-wmf.19/extensions/NavigationTiming: T187299 Backport wiki oversampling config syntax change (duration: 00m 48s) |
[production] |
| 10:00 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 50s) |
[production] |
| 09:56 |
<ema> |
lvs200[456]: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 09:31 |
<marostegui> |
Stop MySQL on db1103:3312 and db1103:3314 for MySQL upgrade |
[production] |
| 09:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 and db1103:3314 for mysql upgrade (duration: 00m 47s) |
[production] |
| 09:26 |
<ema> |
lvs100[456]: reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 09:23 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1081 (duration: 00m 47s) |
[production] |
| 09:16 |
<godog> |
kibana refresh field list |
[production] |
| 08:58 |
<mutante> |
restarting gerrit to pickup change 493963 - disable jgit gc |
[production] |
| 08:47 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 47s) |
[production] |
| 08:43 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1084 (duration: 00m 48s) |
[production] |
| 08:33 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1084 in API (duration: 00m 48s) |
[production] |
| 08:32 |
<marostegui> |
Optimize echo_event table on x1 codfw master (db2034) this will generate lag on x1 codfw - T217591 |
[production] |
| 08:24 |
<akosiaris> |
T213194 bump percentage of citoid requests reaching eqiad kubernetes cluster to 9% |
[production] |
| 08:23 |
<jiji@cumin1001> |
conftool action : set/pooled=yes; selector: dc=eqiad,service=citoid,cluster=scb,name=kubernetes100.* |
[production] |
| 08:14 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1084 (duration: 00m 49s) |
[production] |
| 07:47 |
<marostegui> |
Upgrade MySQL on db1084 |
[production] |
| 07:18 |
<marostegui> |
Stop MySQL on db1095 (backups host) to upgrade MySQL |
[production] |
| 07:18 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 47s) |
[production] |
| 07:08 |
<marostegui> |
Start transferring data from labsdb1011 to labsdb1012 - T215231 |
[production] |
| 06:56 |
<marostegui> |
Reboot labsdb1012 |
[production] |
| 06:55 |
<marostegui> |
Defragment echo_event tables on dbstore1005:3320 T217591 |
[production] |
| 06:51 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1091 (duration: 00m 48s) |
[production] |
| 06:43 |
<marostegui> |
Stop MySQL on db2035 (s2 codfw master) to upgrade MySQL |
[production] |
| 06:41 |
<kart_> |
Finished manual run of unpublished ContentTranslation draft purge script (T217310) |
[production] |
| 06:18 |
<marostegui> |
Stop MySQL on dbstore2001 to upgrade MySQL |
[production] |
| 06:17 |
<marostegui> |
Reload haproxy on dbproxy1010 to depool labsdb1011 |
[production] |
| 06:10 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 51s) |
[production] |
| 03:05 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Handle TitleBlacklist errors correctly (T217382) (duration: 00m 49s) |
[production] |
| 03:03 |
<kart_> |
Started manual run of unpublished ContentTranslation draft purge script (T217310) |
[production] |
| 02:59 |
<ejegg> |
updated payments-wiki from ca7c280f3e to 4f2935ad17 |
[production] |
| 02:27 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Revert hot fix (duration: 00m 46s) |
[production] |
| 02:21 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Hot fix for T217615 (duration: 00m 47s) |
[production] |
| 02:05 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) |
[production] |
| 01:32 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) |
[production] |