2018-02-14
ยง
|
19:08 |
<demon@tin> |
scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) |
[production] |
19:06 |
<demon@tin> |
rebuilt and synchronized wikiversions files: namespace aliases for zhwiki, T184866 |
[production] |
19:00 |
<ema> |
upgrade cp1063 to varnish 5 |
[production] |
17:43 |
<ema> |
upgrade cp1062 to varnish 5 |
[production] |
17:42 |
<moritzm> |
updated jenkins packages on apt.wikimedia.org for stretch (thirdpary/ci) and jessie (thirdparty) to 2.89.4 |
[production] |
17:39 |
<hashar> |
CI Jenkins seems all happy following the upgrade ^o^ |
[production] |
17:34 |
<moritzm> |
updating remaining python-cryptography updates from jessie point release |
[production] |
17:32 |
<hashar> |
Upgrading Jenkins on contint1001 / contint2001 |
[production] |
17:30 |
<godog> |
roll-restart ms-fe to pick up https://gerrit.wikimedia.org/r/c/410199/ |
[production] |
17:22 |
<moritzm> |
installing uwsgi jessie update on graphite* |
[production] |
17:20 |
<godog> |
roll-upgrade thumbor 1.14 in eqiad/codfw |
[production] |
16:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 01m 09s) |
[production] |
16:56 |
<ema> |
upgrade cp1050 to varnish 5 |
[production] |
16:50 |
<marostegui> |
Deploy schema change on db1110 - T187089 T185128 T153182 |
[production] |
16:50 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1110 (duration: 01m 12s) |
[production] |
16:41 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 01m 12s) |
[production] |
16:35 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1088 with low weight (duration: 01m 12s) |
[production] |
16:19 |
<ema> |
upgrade cp1049 to varnish 5 |
[production] |
15:59 |
<jynus> |
upgrade and restart db1088 |
[production] |
15:52 |
<moritzm> |
rolling out debdeploy 0.0.99.2 (cumin masters already upgraded for a while, just synching the clients) |
[production] |
15:51 |
<andrewbogott> |
powering down labvirt1008 so chris can re-apply thermal paste |
[production] |
15:45 |
<moritzm> |
installing libgcrypt security updates on trusty |
[production] |
15:31 |
<zeljkof> |
EU SWAT finished |
[production] |
15:24 |
<godog> |
roll-upgrade thumbor to 1.13 - T187159 T179954 T187088 |
[production] |
15:19 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert "Add suppressredirect to autoconfirmed at zhwikt" (T187018) (duration: 01m 13s) |
[production] |
15:18 |
<ema> |
upgrade cp1048 to varnish 5 |
[production] |
14:47 |
<moritzm> |
installing PHP security updates |
[production] |
14:44 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:409752|Enable flood flag at zhwikt (T187018)]] (duration: 01m 12s) |
[production] |
14:37 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:409743|Require 7 days & 10 edits for autoconfirmed at zhwiktionary (T187018)]] (duration: 01m 13s) |
[production] |
14:30 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:408045|Make alias from old NS_PROJECT to new NS_PROJECT at hiwikiversity (T185347)]] (duration: 01m 12s) |
[production] |
14:21 |
<akosiaris> |
reboot ganeti1008 for kernel upgrade T181121 |
[production] |
14:14 |
<zfilipin@tin> |
Synchronized wmf-config/reverse-proxy.php: SWAT: [[gerrit:410113|wgSquidServersNoPurge: add eqsin, remove dead IP (T156027)]] (duration: 01m 12s) |
[production] |
14:11 |
<mlitn@tin> |
Synchronized php-1.31.0-wmf.20/extensions/3D/modules/mmv.3d.head.js: Fix 3D badge (duration: 01m 12s) |
[production] |
14:10 |
<mlitn@tin> |
Synchronized php-1.31.0-wmf.20/extensions/3D/modules/ext.3d.js: Fix 3D badge and Webkit thumb load detection (duration: 01m 13s) |
[production] |
13:44 |
<elukey> |
rollback java 8 upgrade for archiva - issues with Analytics builds |
[production] |
13:34 |
<elukey> |
installed openjdk-8 on meitnerium, manually upgraded java-update-alternatives to java8, restarted archiva |
[production] |
13:26 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1104 original weight (duration: 01m 12s) |
[production] |
13:16 |
<jynus> |
stop slave and rolling schema change on db1059 m3 replica |
[production] |
13:14 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 01m 12s) |
[production] |
13:02 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1106 (duration: 01m 12s) |
[production] |
12:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Give more traffic to db1106 (duration: 01m 12s) |
[production] |
12:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1106 (duration: 01m 12s) |
[production] |
11:25 |
<marostegui> |
Deploy schema change on db1106 - T187089 T185128 T153182 |
[production] |
11:16 |
<marostegui> |
Stop MySQL and reboot db1106 for mysql and kernel upgrade |
[production] |
11:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1106 (duration: 01m 12s) |
[production] |
11:14 |
<filippo@tin> |
Synchronized wmf-config/ProductionServices.php: repool poolcounter1002 after disk replacement (duration: 01m 12s) |
[production] |
11:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1100 (duration: 01m 12s) |
[production] |
10:46 |
<jynus> |
dropping test databases from m5 T186585 |
[production] |
10:42 |
<marostegui> |
Stop replication in sync on db1089 and db1067 - T162807 |
[production] |
10:28 |
<moritzm> |
installing libvorbis security updates on trusty systems |
[production] |