|
2015-09-03
ยง
|
| 23:37 |
<mutante> |
mw1224 - killed and restarted defunct hhvm, version is different from the one on mw1225 |
[production] |
| 23:37 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/235728 (duration: 00m 13s) |
[production] |
| 23:36 |
<krenair@tin> |
Synchronized w/static/images/project-logos/knwikisource.png: https://gerrit.wikimedia.org/r/#/c/235728/ (duration: 00m 12s) |
[production] |
| 23:32 |
<Krenair> |
mw1224 has been sending segfault warnings and "Lost parent, LightProcess exiting" to hhvm.log since about 21:17:34 |
[production] |
| 23:29 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/CirrusSearch: https://gerrit.wikimedia.org/r/#/c/235905/ (duration: 00m 13s) |
[production] |
| 23:28 |
<krenair@tin> |
Synchronized php-1.26wmf21/package.json: bd2eb6cc1919c7dab056d5f8fe5b4a164236d78f (duration: 00m 13s) |
[production] |
| 23:02 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/235908/ (duration: 00m 13s) |
[production] |
| 21:21 |
<ori> |
rebuilt HHVM with updated diff from facebook/hhvm PR #6071 (T109540), uploaded to apt as 3.6.5+dfsg1-1+wm5 |
[production] |
| 21:18 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC settings |
[production] |
| 19:54 |
<bearND> |
MobileApps deployed sha1 553c399 |
[production] |
| 19:31 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.26wmf21 |
[production] |
| 18:13 |
<ottomata> |
rolling restart of hadoop yarn nodemanagers to pick up Yarn AppMaster port range limitation to apply ferm rules. |
[production] |
| 18:04 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: Add plumbing code for Flow beta feature (unused for now) (duration: 00m 12s) |
[production] |
| 18:03 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add plumbing code for Flow beta feature (unused for now) (duration: 00m 12s) |
[production] |
| 17:39 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/OpenStackManager/nova/OpenStackNovaController.php: https://gerrit.wikimedia.org/r/#/c/235769/ (duration: 00m 12s) |
[production] |
| 17:34 |
<mutante> |
bromine - deleting policy docroot |
[production] |
| 17:06 |
<jynus> |
cloning es1006 mysql data into es1015 [ETA:8h] |
[production] |
| 16:30 |
<bblack> |
updating nginx->1.9.4 on cp1071, cp3033 for prod validation before broader rollout |
[production] |
| 16:30 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: es3 master switchover from es1009 to es1014 (eqiad) (duration: 00m 13s) |
[production] |
| 16:28 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: es3 master switchover from es1009 to es1014 (codfw) (duration: 00m 13s) |
[production] |
| 16:26 |
<mutante> |
imported jenkins 1.609.3 into APT repo |
[production] |
| 16:23 |
<legoktm> |
fixed content model of Template:Languages@metawiki |
[production] |
| 16:21 |
<robh> |
re-enabling puppet on all mw systems |
[production] |
| 16:14 |
<robh> |
disabling puppet on all mw systems for apache config update |
[production] |
| 16:01 |
<jynus> |
performing es3 master switchover from es1009 to es1014 |
[production] |
| 15:40 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: depool es1006 (duration: 00m 12s) |
[production] |
| 15:17 |
<hashar> |
stopping nodepool on labnodepool1001.eqiad.wmnet not ready yet |
[production] |
| 15:15 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: es2 master switchover from es1006 to es1011 (eqiad) (duration: 00m 13s) |
[production] |
| 15:14 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: es2 master switchover from es1006 to es1011 (codfw) (duration: 00m 12s) |
[production] |
| 15:05 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) |
[production] |
| 15:04 |
<demon@tin> |
Synchronized php-1.26wmf21/extensions/Translate/: (no message) (duration: 00m 15s) |
[production] |
| 14:51 |
<jynus> |
performing es2 master switchover from es1006 to es1011 |
[production] |
| 14:33 |
<paravoid> |
rebooting msw1-eqiad |
[production] |
| 14:28 |
<twentyafterfour> |
restarted phd (phabricator daemon) to pick up new configuration |
[production] |
| 14:24 |
<paravoid> |
changing IPv6 RA interval/lifetime/virtual-router-only @ eqiad |
[production] |
| 14:21 |
<paravoid> |
rebooting msw1-codfw |
[production] |
| 13:17 |
<paravoid> |
upgrading mr1-esams and mr1-eqiad to newer junos |
[production] |
| 13:13 |
<godog> |
bounce carbon daemons on graphite1001 |
[production] |
| 12:42 |
<chasemp> |
unban elastic1001 and put back in service |
[production] |
| 12:24 |
<chasemp> |
move all shards off of elastic1001 |
[production] |
| 12:24 |
<chasemp> |
disable elastic1001 in lvs as we are gonig to try fw apply round #2 |
[production] |
| 11:01 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1028; increase the load of es1010, es1013 and es1017 (duration: 00m 12s) |
[production] |
| 10:45 |
<jynus> |
applying schema change for ContentTranslation on x1-master "wikishared" |
[production] |
| 10:02 |
<godog> |
reenable puppet on ms-be1* |
[production] |
| 09:16 |
<jynus> |
started profiling mysql queries at phabricator. Only a 1% overhead is expected. |
[production] |
| 09:12 |
<moritzm> |
updated rsyncd firewall rules (see https://gerrit.wikimedia.org/r/235425 for details) |
[production] |
| 09:12 |
<godog> |
stop puppet on ms-be1* after ferm rsync change |
[production] |
| 08:23 |
<godog> |
fixup current graphite retention T96662 |
[production] |
| 07:26 |
<moritzm> |
enabled ferm on dbstore* servers in codfw |
[production] |
| 06:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Sep 3 06:29:35 UTC 2015 (duration 29m 34s) |
[production] |