|
2016-05-20
§
|
| 13:45 |
<mark> |
Enabled cr2-codfw et-0/* interfaces, reenabling OSPF/OSPF3 |
[production] |
| 13:38 |
<mark> |
Bringing cr2-codfw FPC 0 back up |
[production] |
| 13:37 |
<moritzm> |
upgraded java on xenon/praseodymium/cerium and restbase2001 to latest openjdk-8 release (along with restarts of Cassandra) |
[production] |
| 13:37 |
<mark> |
Offlining cr2-codfw FPC 0 |
[production] |
| 13:35 |
<jynus> |
changing dbstore1001 to be a direct slave of db1075 |
[production] |
| 13:31 |
<mark> |
Disabling cr2-codfw et-0/* interfaces |
[production] |
| 13:24 |
<mark> |
Disabling OSPF on all cr2-codfw row subnets to drain FPC0 |
[production] |
| 13:14 |
<mark> |
Lowering VRRP priority to 50 on all VRRP groups on cr2-codfw to drain FPC0 |
[production] |
| 13:07 |
<mark> |
Performing acupuncture on cr2-codfw:ae4.2020 (Lowered VRRP priority from 100 to 50, inet/inet6) |
[production] |
| 13:05 |
<jynus> |
freeing up space on db1038 by defragmenting its tables |
[production] |
| 12:31 |
<moritzm> |
rolling restart of nginx in eqiad to pick up expat update |
[production] |
| 12:22 |
<moritzm> |
rolling restart of nginx in codfw to pick up expat update |
[production] |
| 12:16 |
<elukey> |
restarting cassandra on aqs100[123] for Java upgrades |
[production] |
| 12:02 |
<moritzm> |
rolling restart of nginx in esams to pick up expat update |
[production] |
| 11:49 |
<moritzm> |
rolling restart of nginx in ulsfo to pick up expat update |
[production] |
| 10:40 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1029 and db1033 weight back to normal after upgrade (duration: 01m 52s) |
[production] |
| 09:00 |
<jynus> |
altering db1040 commonswiki.categorylinks |
[production] |
| 08:50 |
<elukey> |
upgrading cassandra from 2.1.12 to 2.1.13 on aqs1003.eqiad.mwnet |
[production] |
| 08:45 |
<awight> |
Update payments fraud config |
[production] |
| 08:11 |
<elukey> |
upgrading cassandra from 2.1.12 to 2.1.13 on aqs1002.eqiad.mwnet |
[production] |
| 08:08 |
<mobrovac> |
mathoid deploying 243a530 |
[production] |
| 07:36 |
<jynus> |
testing medata lock detectiom on db1069 |
[production] |
| 06:11 |
<bblack> |
restarted gdnsd on eeden.esams (with new config, esams marked down) |
[production] |
| 05:58 |
<bblack> |
gdnsd stopped on eeden.esams, puppet disabled |
[production] |
| 05:56 |
<volans> |
Killed transaction 3262258 on db1040 (alter table stuck in "Waiting for table metadata lock" blocking the replica) T130692 |
[production] |
| 04:24 |
<moritzm> |
restarted hhvm on mw1014 (got stuck, output of hhvm-dump-debug available) |
[production] |
| 00:52 |
<mutante> |
stashbot test (T122690) |
[production] |
| 00:07 |
<dereckson@tin> |
Finished scap: Revert "Convert Special:WhatLinksHere from XML form to OOUI form" ([[Gerrit:289772]], T135773) (duration: 34m 12s) |
[production] |
|
2016-05-19
§
|
| 23:33 |
<dereckson@tin> |
Started scap: Revert "Convert Special:WhatLinksHere from XML form to OOUI form" ([[Gerrit:289772]], T135773) |
[production] |
| 23:29 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Drop already-enabled VisualEditorNewAccountEnableProportion wikis (duration: 00m 27s) |
[production] |
| 23:25 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Move VisualEditor to secondary status on English Wikipedia (T132806) (duration: 00m 29s) |
[production] |
| 23:13 |
<dereckson@tin> |
Synchronized wmf-config/throttle.php: Add Account throttle exception for SF Edit-a-thon (T135777) (duration: 00m 27s) |
[production] |
| 23:10 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Enable experimental Video.js player on test2wiki (2/2) (duration: 00m 27s) |
[production] |
| 23:09 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable experimental Video.js player on test2wiki (1/2) (duration: 00m 26s) |
[production] |
| 23:09 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable experimental Video.js player on test2wiki (1/2) (duration: 00m 30s) |
[production] |
| 22:13 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: rv for now, have another idea for later (duration: 00m 40s) |
[production] |
| 21:28 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: more debug logs (duration: 00m 25s) |
[production] |
| 21:02 |
<yurik_> |
deployed tilerator service update https://gerrit.wikimedia.org/r/#/c/289736/ |
[production] |
| 21:01 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: (no message) (duration: 00m 27s) |
[production] |
| 20:50 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: (no message) (duration: 00m 25s) |
[production] |
| 20:49 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: update to the debug logging to try to find other params (duration: 00m 28s) |
[production] |
| 20:45 |
<urandom> |
RESTBase staging Cassandra upgrade complete : T126629 |
[production] |
| 20:44 |
<urandom> |
restbase-test2003.codfw.wmnet upgraded and online : T126629 |
[production] |
| 20:42 |
<urandom> |
Upgrading Cassandra to 2.2.6 on restbase-test2003.codfw.wmnet : T126629 |
[production] |
| 20:41 |
<urandom> |
Stopping Cassandra on restbase-test2003.codfw.wmnet : T126629 |
[production] |
| 20:38 |
<urandom> |
restbase-test2002.codfw.wmnet upgraded and online : T126629 |
[production] |
| 20:36 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.2/extensions/VisualEditor/ApiVisualEditor.php: slight update to the debug logging to try to find the callers (duration: 00m 31s) |
[production] |
| 20:36 |
<urandom> |
Upgrading Cassandra to 2.2.6 on restbase-test2002.codfw.wmnet : T126629 |
[production] |
| 20:35 |
<urandom> |
Stopping Cassandra on restbase-test2002.codfw.wmnet : T126629 |
[production] |
| 20:35 |
<chasemp> |
iridium try to block vandal by ip temp so puppet disable and edit of /etc/apache2/phabbanlist.conf |
[production] |