2018-04-23
§
|
08:59 |
<moritzm> |
reimaging mw1283,mw1285,mw1286 (API servers) to stretch |
[production] |
08:57 |
<marostegui> |
Deploy schema change on s6 codfw master (db2039) - this will generate lag on codfw - T191519 T188299 T190148 |
[production] |
08:56 |
<gehel> |
rolling restart of blazegraph on wdqs1004, 2004 and 2005 for JVM upgrade |
[production] |
08:55 |
<moritzm> |
reimaging mw1270,mw1271,mw1272 (app servers) to stretch |
[production] |
08:52 |
<vgutierrez> |
restarting pybal on esams cluster |
[production] |
08:50 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1078 (duration: 01m 16s) |
[production] |
08:48 |
<_joe_> |
upgrading nginx on the config cluster in eqiad (T164456) |
[production] |
08:47 |
<marostegui> |
Drop table logging_pre_1_10 in s5 - T118859 |
[production] |
08:47 |
<marostegui> |
Dropped table logging_pre_1_10 in s3 - T118859 |
[production] |
08:42 |
<vgutierrez> |
restarting pybal on lvs4006 |
[production] |
08:40 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1078 (duration: 01m 18s) |
[production] |
08:36 |
<vgutierrez> |
restarting pybal on codfw (once at a time) |
[production] |
08:33 |
<vgutierrez> |
restart pybal on lvs4007 |
[production] |
08:31 |
<vgutierrez> |
restarting pybal on lvs5002 |
[production] |
08:30 |
<vgutierrez> |
restarting pybal on lvs5001 |
[production] |
08:30 |
<marostegui> |
Drop table logging_pre_1_10 in s4 - T118859 |
[production] |
08:27 |
<vgutierrez> |
restarting pybal on lvs4005 |
[production] |
08:27 |
<_joe_> |
restarting pybal on lvs5003 |
[production] |
08:17 |
<_joe_> |
upgrading nginx on the config cluster in codfw (T164456) |
[production] |
08:13 |
<marostegui> |
Drop table logging_pre_1_10 in s7 - T118859 |
[production] |
08:08 |
<_joe_> |
restarting memcached in codfw (T184854) |
[production] |
08:08 |
<gehel> |
restarting blazegraph on wdqs1003 (crazy number of java threads) |
[production] |
08:04 |
<moritzm> |
upgrading terbium to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build |
[production] |
07:58 |
<ema> |
cp-misc: upgrade varnish to 5.1.3-1wm7 |
[production] |
07:55 |
<marostegui> |
reload haproxy on dbproxy1010 to depool labsdb1010 |
[production] |
07:55 |
<marostegui> |
Depool labsdb1010 - T184446 |
[production] |
07:50 |
<marostegui> |
Drop table logging_pre_1_10 in s2 - T118859 |
[production] |
07:47 |
<marostegui> |
Drop table logging_pre_1_10 in s6 - T118859 |
[production] |
07:36 |
<moritzm> |
upgrading remaining API servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build |
[production] |
07:35 |
<elukey> |
reboot ms-be2034 - stuck in com2 console with "sd 0:1:0:1: rejecting I/O to offline device", not responsive to ssh |
[production] |
07:00 |
<moritzm> |
upgrading remaining app servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build |
[production] |
06:26 |
<marostegui> |
Remove logging_pre_1_10 from codfw - T118859 |
[production] |
05:28 |
<marostegui> |
flow_subscription empty table from officewiki - T149936 |
[production] |
05:17 |
<marostegui> |
Deploy schema change on db1070 (s5 primary master) - T191519 T188299 T190148 |
[production] |
02:40 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.29) (duration: 05m 56s) |
[production] |
2018-04-20
§
|
20:45 |
<andrewbogott> |
re-imaging labvirt1021 and 1022 as Jessie |
[production] |
20:23 |
<ejegg> |
updated fundraising python tools from 0c50f9e38f to 7c5c7a5f9e |
[production] |
18:23 |
<mutante> |
add LDAP user "tieu" to group "wmde" (T192256) |
[production] |
17:42 |
<imarlier@tin> |
Finished deploy [performance/coal@99db58f]: coal - update to submit via graphite. Not yet active, requires puppet changes (duration: 00m 04s) |
[production] |
17:41 |
<imarlier@tin> |
Started deploy [performance/coal@99db58f]: coal - update to submit via graphite. Not yet active, requires puppet changes |
[production] |
17:35 |
<no_justification> |
gerrit: update mysql-client and deps 5.5.59 -> 5.5.60 |
[production] |
17:28 |
<mutante> |
phabricator - restarted apache |
[production] |
17:26 |
<mutante> |
phabricator (phab1001) - upgrading Apache, openssl, mysql-common |
[production] |