|
2016-11-10
ยง
|
| 20:32 |
<mutante> |
neon - shutdown -h now (scheduled 3 days downtime, nothing that looked worth saving in homes) |
[production] |
| 20:28 |
<mutante> |
neon - deactivate puppet node |
[production] |
| 20:25 |
<twentyafterfour@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: sync LABS: enable mapframe everywhere (I35709ed2903b28a2d4d6e8528ac1fcf361483e76) (duration: 00m 50s) |
[production] |
| 19:37 |
<dcausse> |
elastic@eqiad: reindexing commonswiki (logs in terbium.eqiad.wmnet:~dcausse/commons_reindex/cirrus_log) - T150232 |
[production] |
| 19:33 |
<bblack> |
cache_*: restarting nginx for libssl update (seamless) |
[production] |
| 19:31 |
<bblack> |
upgrading libssl1.1 to 1.1.0c on other misc hosts... |
[production] |
| 19:30 |
<Pchelolo> |
update RESTBase to 6bfa0f75f |
[production] |
| 19:24 |
<Pchelolo> |
update RESTBase to 6bfa0f75f - canary on restbase1007 |
[production] |
| 19:22 |
<bblack> |
upgrading openssl to 1.1.0c on cache_* |
[production] |
| 19:19 |
<Pchelolo> |
update RESTBase to 6bfa0f75f - staging |
[production] |
| 19:16 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:320552|Add PageViewInfo log channel (T129602)]] (duration: 00m 49s) |
[production] |
| 19:09 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:320450|Make beta PageViewInfo use the production pageview API (T129602)]] (labs-only-change) (duration: 00m 48s) |
[production] |
| 19:02 |
<cwd> |
updated payments from c1fa73c649986be89a6a038b9e19f6b3ea19e537 to 3b3c8ce6c7bc24beb520a3e2f507df4514de4679 |
[production] |
| 18:57 |
<moritzm> |
uploaded openssl 1.1.0c for jessie-wikimedia to carbon |
[production] |
| 18:42 |
<paravoid> |
upgrading (and restarting) nginx on sodium |
[production] |
| 17:46 |
<urandom> |
T133395: Convert final 25 RESTBase tables to TWCS |
[production] |
| 17:34 |
<cwd> |
deployed EVERYTHING... changed config tree to c6a7b17432188a0a4f990061b488208e64fe39dd and civicrm-authonly from 56eadabf705b3d035e11bb9fd3478457c159e40d to df50d2d7b6a8494fb3e049df6b1e101611270 |
[production] |
| 17:33 |
<cwd> |
restarted slander |
[production] |
| 17:32 |
<cwd> |
restarted dash |
[production] |
| 16:58 |
<urandom> |
T133395: Performing next 25 RESTBase table conversions to TWCS |
[production] |
| 15:09 |
<marostegui> |
Deploy schema change s4 commonswiki.template links (db1068) - https://phabricator.wikimedia.org/T149079 |
[production] |
| 15:01 |
<elukey> |
restored mw1284 to its settings |
[production] |
| 14:53 |
<jynus> |
applying schema change on s3 (page) T69223 |
[production] |
| 14:47 |
<elukey> |
de-pooling mw1284 to raise mod_proxy_fcgi log level manually (temporary for an ongoing investigation) |
[production] |
| 14:31 |
<bblack> |
cache_text: upgrade nginx to 1.11.4-1+wmf14 |
[production] |
| 14:20 |
<bblack> |
cache_upload: upgrade nginx to 1.11.4-1+wmf14 |
[production] |
| 14:04 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1068 - T149079 (duration: 00m 48s) |
[production] |
| 13:54 |
<bblack> |
restarting varnishes on cache_maps + cache_misc |
[production] |
| 13:51 |
<marostegui> |
Enabled gtid+ssl on db2010,db2012,db2030 |
[production] |
| 13:45 |
<bblack> |
cache_misc: upgrade nginx to 1.11.4-1+wmf14 |
[production] |
| 13:29 |
<bblack> |
cache_maps: upgrade nginx to 1.11.4-1+wmf14 |
[production] |
| 13:25 |
<marostegui> |
Restarting mysql in misc shard slaves (only codfw - db2010,db2012,db2030) to apply a MySQL config - T149418 |
[production] |
| 13:20 |
<gehel> |
restart wdqs1* for jvm update |
[production] |
| 13:07 |
<gehel> |
restart wdqs2* for jvm update |
[production] |
| 12:01 |
<ema> |
upgrading cp1068 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 11:45 |
<ema> |
upgrading cp1067 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 11:25 |
<ema> |
upgrading cp1066 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 11:08 |
<ema> |
upgrading cp1065 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 10:43 |
<ema> |
upgrading cp1055 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 10:29 |
<ema> |
upgrading cp1054 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 10:26 |
<_joe_> |
powercycling mw1280, unresponsive to ping, blank unresponsive console |
[production] |
| 10:25 |
<moritzm> |
rolling restart of zookeeper in eqiad to pick up java security update |
[production] |
| 10:10 |
<moritzm> |
rolling restart of zookeeper in codfw to pick up java security update |
[production] |
| 09:53 |
<ema> |
upgrading cp1053 (text-eqiad) to varnish 4 -- T131503 |
[production] |
| 09:44 |
<marostegui> |
Deploy gtid_domain_id mysql flag for misc shards - https://phabricator.wikimedia.org/T149418 |
[production] |
| 09:43 |
<elukey> |
restarting druid daemons on druid100[123] for openjdk updates |
[production] |
| 09:38 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: wmf-config/db-codfw.php Depool db1059 - T149079. Repool db2048 T150334 (duration: 00m 50s) |
[production] |
| 09:22 |
<dcausse> |
elastic@codfw: reindexing commonswiki (logs in wasat.codfw.wmnet:~dcausse/commons_reindex/cirrus_log) |
[production] |
| 09:06 |
<moritzm> |
rolling restart of elasticsearch on logstash100[4-6] for picking up a Java security update |
[production] |
| 08:55 |
<moritzm> |
rebooting ruthenium for kernel update |
[production] |