2017-04-28
§
|
21:24 |
<Dereckson> |
End of live debug on mwdebug1001, restored previous state with a local scap pull |
[production] |
21:00 |
<ejegg> |
updated payments-wiki from 1620b8233321099262ff4333a2269f0563107e66 to 4c5630283c57efbc454cc70d47218f7f22ea252a |
[production] |
20:23 |
<Dereckson> |
Live debug on mwdebug1001 for T164059 |
[production] |
19:30 |
<jynus> |
shutting down db1063 - I see high temperatures reported, and going up T164107 |
[production] |
19:08 |
<urandom> |
T163936: reenabling puppet on restbase-dev1001 |
[production] |
18:14 |
<urandom> |
T163936: disabling puppet on restbase-dev1001 (t-shooting c-m-c) |
[production] |
17:08 |
<jynus> |
restarting replication on all nodes on s7-eqiad T164092 |
[production] |
16:38 |
<jynus> |
stopping replication on all nodes on s7-eqiad in case db1062 boots up in a corrupted state |
[production] |
16:36 |
<jynus> |
restarting db1062 once more T164092 |
[production] |
15:56 |
<godog> |
poweroff prometheus1004 for ram upgrade - T163385 |
[production] |
15:40 |
<jynus> |
deploying new events_coredb_slave.sql on codfw T160984 |
[production] |
15:21 |
<godog> |
poweroff prometheus1003 for ram upgrade - T163385 |
[production] |
14:55 |
<gehel> |
shutting down elastic2020 for mainboard replacement - T149006 |
[production] |
14:32 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Change db1063 IP and rack - T163895 (duration: 00m 48s) |
[production] |
14:31 |
<marostegui@naos> |
Synchronized wmf-config/db-codfw.php: Change db1063 IP and rack - T163895 (duration: 00m 50s) |
[production] |
14:04 |
<marostegui> |
Stop and shutdown db1063 - T163895 |
[production] |
14:04 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Change db1062 rack location - T163895 (duration: 00m 52s) |
[production] |
13:59 |
<moritzm> |
installing ghostscript security updates |
[production] |
13:56 |
<urandom> |
T163936: restarting cassandra-metrics-collector, restbase production |
[production] |
13:55 |
<urandom> |
$ readlink /usr/local/lib/cassandra-metrics-collector/cassandra-metrics-collector.jar |
[production] |
13:50 |
<ema> |
varnish 4.1.6-1wm1 uploaded to apt.w.o |
[production] |
13:46 |
<urandom> |
T163936: restarting cassandra-metrics-collector on restbase1007 |
[production] |
13:46 |
<marostegui@naos> |
Synchronized wmf-config/db-codfw.php: Change db1061 IP - T163895 (duration: 01m 00s) |
[production] |
13:44 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Change db1061 IP - T163895 (duration: 01m 19s) |
[production] |
13:44 |
<urandom> |
T163936: forcing puppet run on restbase1007 |
[production] |
13:30 |
<marostegui> |
Stop MySQL and shutdown db1061 - T163895 |
[production] |
13:26 |
<marostegui> |
Stop MySQL and shutdown db1062 - T163895 |
[production] |
10:47 |
<akosiaris> |
migrate/evacuate ganeti2005, ganeti2006 for T164011 |
[production] |
10:42 |
<akosiaris> |
reboot oresrdb1002 for kernel upgrade |
[production] |
09:56 |
<moritzm> |
installing libxslt security updates on trusty |
[production] |
09:29 |
<marostegui> |
upgrade mariadb db1059,db1056 from 10.0.22 to 10.0.28 |
[production] |
09:17 |
<marostegui> |
upgrade mariadb db1071 from 10.0.23 to 10.0.28 |
[production] |
09:15 |
<akosiaris> |
reboot oresrdb1001 for kernel upgrade |
[production] |
09:02 |
<marostegui> |
Upgrade mariadb on db1081 and db1084 from 10.0.23 to 10.0.28 |
[production] |
08:03 |
<Amir1> |
cleanup done, 4M rows deleted (T159753) |
[production] |
07:58 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Repool db1045 - T162539 T163548 (duration: 02m 38s) |
[production] |
06:48 |
<Amir1> |
cleaning around 5-10M rows in ores_classification in enwiki (half-an-hour script, T159753) |
[production] |
01:18 |
<ejegg> |
rolled payments-wiki back to 1620b8233321099262ff4333a2269f0563107e66 |
[production] |
01:15 |
<ejegg> |
udated payments-wiki from 1620b8233321099262ff4333a2269f0563107e66 to 4c5630283c57efbc454cc70d47218f7f22ea252a |
[production] |