|
2015-07-09
ยง
|
| 20:48 |
<gwicke> |
temporarily disabled puppet on cassandra nodes while tweaking settings |
[production] |
| 19:53 |
<legoktm> |
manually fixing global merge of Yuvipanda->YuviPanda (T104686) |
[production] |
| 19:04 |
<gwicke> |
bounced cassandra on restbase1004 |
[production] |
| 18:29 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf13 |
[production] |
| 17:54 |
<gwicke> |
bounced restbase on restbase1005 |
[production] |
| 17:32 |
<ori> |
installed poolcounter on mw1154 |
[production] |
| 17:31 |
<ori> |
Synchronized wmf-config/PoolCounterSettings-eqiad.php: (no message) (duration: 00m 12s) |
[production] |
| 17:22 |
<cmjohnson1> |
shutting down helium for a few minutes to move within the same row |
[production] |
| 16:53 |
<gwicke> |
bounced cassandra on restbase1004 |
[production] |
| 16:48 |
<godog> |
reboot ms-be2013 T105213 |
[production] |
| 16:38 |
<gwicke> |
bounced cassandra on restbase1006 |
[production] |
| 16:07 |
<_joe_> |
repooling mw1152 |
[production] |
| 15:57 |
<godog> |
restart cassandra on restbase1002 |
[production] |
| 15:34 |
<gwicke> |
bounced cassandra on restbase1004 |
[production] |
| 15:24 |
<krenair> |
Synchronized php-1.26wmf12/extensions/ContentTranslation: https://gerrit.wikimedia.org/r/#/c/223739/ (duration: 00m 12s) |
[production] |
| 15:23 |
<krenair> |
Synchronized php-1.26wmf13/extensions/ContentTranslation: https://gerrit.wikimedia.org/r/#/c/223737/ (duration: 00m 12s) |
[production] |
| 15:23 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/223742/ (duration: 00m 12s) |
[production] |
| 15:09 |
<gwicke> |
bounced cassandra on restbase1004 |
[production] |
| 14:44 |
<gwicke> |
re-enabled compaction throttling (60mb/s) on cassandra nodes |
[production] |
| 14:44 |
<bblack> |
reprepro: jessie-wikimedia/backports openssl pkg, 1.0.2c-1 => 1.0.2d-1~wmf1 |
[production] |
| 14:29 |
<_joe_> |
reimaging mw1152 for wiping any leftover local hacks. Depooling, scheduling downtime |
[production] |
| 14:28 |
<moritzm> |
installed python-django security updates on labmon, netmon and californium |
[production] |
| 14:24 |
<godog> |
really upgrade python-django on graphite2001 |
[production] |
| 13:48 |
<mobrovac> |
restbase cassandra rolling restart to apply https://gerrit.wikimedia.org/r/223774 |
[production] |
| 13:02 |
<godog> |
upgrade python-django on graphite1001 and graphite2001 following http://www.ubuntu.com/usn/usn-2671-1/ |
[production] |
| 11:34 |
<godog> |
restart cassandra on restbase1001 |
[production] |
| 11:22 |
<krinkle> |
Synchronized php-1.26wmf13/resources/src/mediawiki/mediawiki.util.js: T105265 (duration: 00m 11s) |
[production] |
| 11:21 |
<krinkle> |
Synchronized php-1.26wmf13/includes/GlobalFunctions.php: T105265 (duration: 00m 12s) |
[production] |
| 11:09 |
<mobrovac> |
restbase deploying https://gerrit.wikimedia.org/r/#/c/223297/ which bumps the back-end module version ( https://github.com/wikimedia/restbase-mod-table-cassandra/pull/117 ) |
[production] |
| 10:53 |
<mobrovac> |
restbase started thinner 15 days for wikimedia group |
[production] |
| 10:38 |
<mark> |
Shutdown AMS-IX route server BGP sessions on cr1-esams |
[production] |
| 07:48 |
<oblivian> |
Synchronized php-1.26wmf13/thumb.php: Re-add fix for thumb.php 404s on HHVM (duration: 00m 13s) |
[production] |
| 06:27 |
<twentyafterfour> |
restarted apache2 on iridium to fix phab exception |
[production] |
| 06:15 |
<springle> |
db1037 is repartitioning tables; it will lag intermittently for a day |
[production] |
| 06:05 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jul 9 06:05:30 UTC 2015 (duration 5m 29s) |
[production] |
| 05:23 |
<gwicke> |
dynamically limited cassandra compaction throughput to 80mb/s; please review https://gerrit.wikimedia.org/r/#/c/223722/ to make this permanent |
[production] |
| 03:01 |
<LocalisationUpdate> |
completed (1.26wmf13) at 2015-07-09 03:01:13+00:00 |
[production] |
| 02:58 |
<l10nupdate> |
Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 05m 29s) |
[production] |
| 02:42 |
<LocalisationUpdate> |
completed (1.26wmf12) at 2015-07-09 02:42:56+00:00 |
[production] |
| 02:40 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jul 9 02:40:16 UTC 2015 (duration 40m 15s) |
[production] |
| 02:36 |
<l10nupdate> |
Synchronized php-1.26wmf12/cache/l10n: (no message) (duration: 10m 32s) |
[production] |
| 02:28 |
<twentyafterfour> |
restarted phd |
[production] |
| 02:28 |
<twentyafterfour> |
moved phd log to free disk space on iridium |
[production] |
| 02:24 |
<LocalisationUpdate> |
completed (1.26wmf13) at 2015-07-09 02:24:00+00:00 |
[production] |
| 02:23 |
<l10nupdate> |
Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 00m 34s) |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.26wmf12) at 2015-07-09 02:17:02+00:00 |
[production] |
| 02:16 |
<l10nupdate> |
Synchronized php-1.26wmf12/cache/l10n: (no message) (duration: 00m 47s) |
[production] |
| 02:00 |
<springle> |
pkg upgrade and restart db1037 |
[production] |
| 01:49 |
<gwicke> |
switched remaining cassandra nodes to JDK8 |
[production] |
| 01:37 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1037 (duration: 00m 11s) |
[production] |