|
2016-03-08
§
|
| 23:20 |
<mutante> |
bast2001 - install issues - extending downtime, bbiaw |
[production] |
| 23:20 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.27.0-wmf.16 |
[production] |
| 23:11 |
<mutante> |
neon: re-enable puppet, start icinga-wm |
[production] |
| 23:03 |
<twentyafterfour@tin> |
Synchronized w/static/: (no message) (duration: 00m 32s) |
[production] |
| 22:53 |
<mutante> |
bast2001 - powercycle, reinstall |
[production] |
| 22:19 |
<twentyafterfour@tin> |
Finished scap: testwiki to php-1.27.0-wmf.16 and rebuild l10n cache (duration: 26m 06s) |
[production] |
| 22:04 |
<ori> |
Canary application servers (mw1017-mw1025) and canary API application servers (mw1114-mw1119) upgraded to HHVM 3.12.1 |
[production] |
| 22:04 |
<jynus> |
recreating slave watchdog events on all servers |
[production] |
| 21:53 |
<twentyafterfour@tin> |
Started scap: testwiki to php-1.27.0-wmf.16 and rebuild l10n cache |
[production] |
| 21:02 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2040 (duration: 00m 34s) |
[production] |
| 21:01 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1066 (duration: 00m 33s) |
[production] |
| 20:49 |
<ori> |
Updated mw1200 to HHVM 3.12.1; repooling |
[production] |
| 20:45 |
<ori> |
Depooled mw1200 for HHVM update |
[production] |
| 20:40 |
<jynus> |
killing long running queries on db1066 |
[production] |
| 20:39 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1066 (duration: 01m 49s) |
[production] |
| 18:55 |
<mutante> |
temp. stopped icinga-wm |
[production] |
| 18:54 |
<moritzm> |
uploaded linux 4.4.2-3+wmf1/jessie-wikimedia (based on Linux 4.4.4) to carbon |
[production] |
| 17:46 |
<bblack> |
switching text cache routing: ulsfo->codfw |
[production] |
| 17:36 |
<papaul> |
sinistra signing puppet certs, salt-key, initial run |
[production] |
| 17:34 |
<jynus> |
applying new grants to all database servers |
[production] |
| 17:12 |
<godog> |
upgrade cassandra to 2.1.13 on restbase1010 |
[production] |
| 16:57 |
<godog> |
upgrade cassandra to 2.1.13 on restbase1009 |
[production] |
| 16:46 |
<godog> |
upgrade cassandra to 2.1.13 on restbase1008 |
[production] |
| 16:34 |
<godog> |
upgrade cassandra to 2.1.13 on restbase1007 |
[production] |
| 16:25 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove reader segmentation survey [[gerrit:275669]] (duration: 00m 25s) |
[production] |
| 16:19 |
<thcipriani@tin> |
Synchronized wmf-config: SWAT: Update pbkdf2 hash parameters [[gerrit:274795]] (duration: 00m 31s) |
[production] |
| 16:16 |
<godog> |
restarting cassandra on restbase1* |
[production] |
| 16:12 |
<godog> |
upgrade cassandra to 2.1.13 on restbase1001 |
[production] |
| 16:12 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable VisualEditor for new accounts on the German Wikipedia PART II [[gerrit:271712]] (duration: 00m 29s) |
[production] |
| 16:11 |
<thcipriani@tin> |
Synchronized dblists/visualeditor-default.dblist: SWAT: Enable VisualEditor for new accounts on the German Wikipedia PART I [[gerrit:271712]] (duration: 00m 32s) |
[production] |
| 16:06 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Permissions configuration changes for gl.wikipedia [[gerrit:275285]] and Modify throttle settings for frwiki and cawiki due to Workshop [[gerrit:275287]] (duration: 00m 28s) |
[production] |
| 15:40 |
<godog> |
upgrade cassandra to 2.1.13 on restbase2006 |
[production] |
| 15:36 |
<bblack> |
switching upload cache routing: ulsfo->codfw |
[production] |
| 15:32 |
<godog> |
upgrade cassandra to 2.1.13 on restbase2005 |
[production] |
| 15:29 |
<godog> |
upgrade cassandra to 2.1.13 on restbase2004 |
[production] |
| 15:24 |
<godog> |
upgrade cassandra to 2.1.13 on restbase2003 |
[production] |
| 15:15 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2038, db2039; depool db2035 for partitioning (duration: 00m 40s) |
[production] |
| 15:09 |
<bblack> |
switching misc-web cache routing: ulsfo->codfw |
[production] |
| 14:51 |
<godog> |
upgrade cassandra to 2.1.3 on restbase2002 |
[production] |
| 14:27 |
<godog> |
upgrade cassandra to 2.1.3 on restbase2001 |
[production] |
| 14:10 |
<godog> |
update reprepro with cassandra 2.1.13 T126629 |
[production] |
| 11:54 |
<jynus> |
performing schema change (s7 partitioning) on db2040 |
[production] |
| 11:28 |
<_joe_> |
restarting pybal on lvs2003,6 to pick up the config change |
[production] |
| 08:43 |
<elukey> |
Redis and Puppet stopped on rdb1002 (Job queue slave) as pre-step for Debian re-image |
[production] |
| 08:00 |
<jynus> |
starting schema change (s6 partitioning) on db2039 |
[production] |