|
2018-08-20
§
|
| 13:00 |
<marostegui> |
Increase max_connections from 500 to 800 on db1073 to triage issues - T188589 |
[production] |
| 12:51 |
<jynus> |
reload dbproxy1005 |
[production] |
| 12:29 |
<moritzm> |
upgrading scb2006 to latest nodejs along with rolling restarts of node-based services |
[production] |
| 12:02 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:01 |
<arturo> |
T202261 extend icinga downtime 1D for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet neutron not properly syncing with agents |
[production] |
| 11:56 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:453383|Adding Chinese Wikiversitys logos (T202127)]] (duration: 00m 50s) |
[production] |
| 11:50 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:453693|Use HD logos for lfnwiki (T202228)]] (duration: 00m 50s) |
[production] |
| 11:41 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:453692|Upload HD logos for lfnwiki (T202228)]] (duration: 00m 50s) |
[production] |
| 11:36 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:451823|Enable Rollbacker User Group at ru.wikiquote (T200201)]] (duration: 00m 53s) |
[production] |
| 11:25 |
<arturo> |
T202261 icinga downtime 1h for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet previous to patch merge |
[production] |
| 11:07 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:450450|Allow all bureaucrats to remove interface-admin]] (duration: 00m 54s) |
[production] |
| 11:01 |
<arturo> |
T202261 disabled puppet in cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet |
[production] |
| 10:31 |
<moritzm> |
rebooting mw1261 for kernel update/some tests |
[production] |
| 10:23 |
<moritzm> |
rebooting mw2234 for some kernel tests |
[production] |
| 10:07 |
<moritzm> |
uploaded nodejs 6.11.0~dfsg-1+wmf2 to apt.wikimedia.org |
[production] |
| 09:31 |
<moritzm> |
uploaded nodejs 6.11.0~dfsg-1+wmf2+jessie to apt.wikimedia.org |
[production] |
| 08:50 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request (duration: 06m 29s) |
[production] |
| 08:43 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request |
[production] |
| 08:43 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 (duration: 18m 17s) |
[production] |
| 08:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1100 (duration: 00m 50s) |
[production] |
| 08:31 |
<moritzm> |
installing systemd updates from stretch 9.5 point release |
[production] |
| 08:25 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 |
[production] |
| 08:24 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request (duration: 06m 02s) |
[production] |
| 08:18 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request |
[production] |
| 08:16 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 (duration: 04m 16s) |
[production] |
| 08:15 |
<marostegui> |
Deploy schema change on db1100 to check for regressions |
[production] |
| 08:13 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 50s) |
[production] |
| 08:12 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 |
[production] |
| 08:03 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Depool db1100 (duration: 01m 02s) |
[production] |
| 07:29 |
<gehel> |
resetting management card on elastic1022 |
[production] |
| 06:57 |
<volans> |
reset-failed debmonitor failed session on ms-be2024 ^^^^ |
[production] |
| 02:47 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Mon Aug 20 02:47:17 UTC 2018 (duration 10m 22s) |
[production] |
| 02:36 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.16) (duration: 14m 23s) |
[production] |
|
2018-08-17
§
|
| 16:24 |
<gehel> |
disabling systemd state check for elastic eqiad until T202120 is fixed |
[production] |
| 14:38 |
<moritzm> |
rebooting elnath for some kernel tests |
[production] |
| 13:02 |
<jynus> |
stopping db2084 for upgrade |
[production] |
| 12:49 |
<imarlier@deploy1001> |
Finished deploy [performance/coal@aff3793]: (no justification provided) (duration: 01m 06s) |
[production] |
| 12:48 |
<imarlier@deploy1001> |
Started deploy [performance/coal@aff3793]: (no justification provided) |
[production] |
| 12:46 |
<gehel> |
rebooting relforge for JVM and kernel upgrade |
[production] |
| 12:36 |
<moritzm> |
installing openjdk-8 security updates on elastic* in codfw (eqiad already has it via the recent reimage to stretch) |
[production] |
| 12:30 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1097 (duration: 00m 53s) |
[production] |
| 12:07 |
<gehel> |
repooling wdqs2003, catched up on updates |
[production] |
| 10:58 |
<moritzm> |
rebooting mw2152-mw2162 for kernel security update (also bundling wikidiff and apache updates) |
[production] |
| 10:35 |
<moritzm> |
powercycling mw2286 |
[production] |
| 09:47 |
<moritzm> |
rebooting mw2243-mw2290 for kernel security update (also bundling wikidiff and apache updates) |
[production] |
| 09:03 |
<gehel> |
depool wdqs2003 to catch up on updates |
[production] |
| 08:29 |
<jynus> |
stopping db2073 for upgrade |
[production] |
| 08:13 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1097 (duration: 00m 54s) |
[production] |
| 08:06 |
<gehel> |
silencing systemd check as mjolnir is flapping |
[production] |
| 07:59 |
<gehel> |
restarting mjolnir on all elastic / cirrus nodes |
[production] |