|
2015-09-16
§
|
| 13:03 |
<paravoid> |
disabling asw-d-eqiad xe-8/0/23, xe-8/0/24, xe-8/0/25, xe-8/0/26, xe-8/0/27, xe-8/0/28; servers reboot-looping -> asw-d's SNMP unhappy -> librenms unhappy -> faidon's mailbox unhappy |
[production] |
| 12:48 |
<moritzm> |
repooled mw1115-mw1117, mw1119 (with ferm enabled) |
[production] |
| 12:42 |
<moritzm> |
depooling mw1115-mw1117, mw1119 (mw1118 was already depooled) to enable ferm |
[production] |
| 11:32 |
<moritzm> |
repooled mw1019-mw1025 with ferm enabled |
[production] |
| 11:24 |
<jynus> |
making db1069 a sibling of db1055 (s1) |
[production] |
| 11:13 |
<godog> |
create restbase user on cassandra test cluster |
[production] |
| 11:07 |
<moritzm> |
depooled mw1019-mw1025 (to enable ferm) |
[production] |
| 10:52 |
<catrope@tin> |
Synchronized php-1.26wmf23: (no message) (duration: 02m 04s) |
[production] |
| 10:49 |
<catrope@tin> |
Synchronized php-1.26wmf22: (no message) (duration: 02m 12s) |
[production] |
| 10:48 |
<jynus> |
reenabling semisync on db1072 and db1073 |
[production] |
| 10:47 |
<catrope@tin> |
scap aborted: (no message) (duration: 00m 21s) |
[production] |
| 10:47 |
<catrope@tin> |
Started scap: (no message) |
[production] |
| 10:24 |
<catrope@tin> |
Synchronized php-1.26wmf23/includes/changes/EnhancedChangesList.php: T112738 (duration: 00m 12s) |
[production] |
| 10:08 |
<aude@tin> |
Synchronized arbitraryaccess.dblist: (no message) (duration: 00m 11s) |
[production] |
| 08:12 |
<moritzm> |
repooled mw1153 with ferm enabled |
[production] |
| 07:57 |
<jynus> |
truncated some tables from ContentTranslation extension on x1 |
[production] |
| 07:57 |
<moritzm> |
depooled mw1153 (it's an image scaler, of course) to enable ferm |
[production] |
| 07:56 |
<moritzm> |
depooled mw1153 (videoscaler) to enable ferm |
[production] |
| 06:31 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Sep 16 06:31:58 UTC 2015 (duration 31m 57s) |
[production] |
| 03:28 |
<ori@tin> |
Synchronized php-1.26wmf22/vendor/monolog/monolog/src/Monolog/Logger.php: Iccfda47689: monolog: Don't waste milliseconds counting microseconds (duration: 00m 12s) |
[production] |
| 03:27 |
<ori@tin> |
Synchronized php-1.26wmf23/vendor/monolog/monolog/src/Monolog/Logger.php: Iccfda47689: monolog: Dont waste milliseconds counting microseconds ; sync-file php-1.26wmf22/vendor/monolog/monolog/src/Monolog/Logger.php Iccfda47689: monolog: Dont waste milliseconds counting microseconds (duration: 00m 12s) |
[production] |
| 03:12 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf23) at 2015-09-16 03:12:08+00:00 |
[production] |
| 03:05 |
<l10nupdate@tin> |
Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 10m 30s) |
[production] |
| 02:38 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf22) at 2015-09-16 02:38:48+00:00 |
[production] |
| 02:35 |
<l10nupdate@tin> |
Synchronized php-1.26wmf22/cache/l10n: l10nupdate for 1.26wmf22 (duration: 07m 02s) |
[production] |
| 01:03 |
<krinkle@tin> |
Synchronized php-1.26wmf23/resources/src/mediawiki/mediawiki.js: hotfix Ia2fcd13f4 (duration: 00m 12s) |
[production] |
| 00:15 |
<legoktm@tin> |
Synchronized php-1.26wmf23/extensions/CentralAuth/includes/: Use set() for tokens with unique keys (duration: 00m 12s) |
[production] |
| 00:14 |
<legoktm@tin> |
Synchronized php-1.26wmf22/extensions/CentralAuth/includes/: Use set() for tokens with unique keys (duration: 00m 12s) |
[production] |
| 00:11 |
<bblack> |
reinstalling lvs400[12] to jessie (traffic on 400[34], already jessie) |
[production] |
| 00:08 |
<krenair@tin> |
Synchronized php-1.26wmf23/extensions/VisualEditor/modules/ve-mw/ui/styles/dialogs: https://gerrit.wikimedia.org/r/#/c/238646/ (duration: 00m 12s) |
[production] |
|
2015-09-15
§
|
| 23:51 |
<krenair@tin> |
Synchronized php-1.26wmf22/extensions/WikimediaEvents/modules/ext.wikimediaEvents.geoFeatures.js: https://gerrit.wikimedia.org/r/#/c/238617/ (duration: 00m 12s) |
[production] |
| 23:48 |
<krenair@tin> |
Synchronized php-1.26wmf23/extensions/WikimediaEvents/modules/ext.wikimediaEvents.geoFeatures.js: https://gerrit.wikimedia.org/r/#/c/238618/ (duration: 00m 12s) |
[production] |
| 23:42 |
<krenair@tin> |
Synchronized wmf-config/mobile.php: https://gerrit.wikimedia.org/r/#/c/238543/ (duration: 00m 14s) |
[production] |
| 23:42 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/238543/ (duration: 00m 12s) |
[production] |
| 23:40 |
<krenair@tin> |
Synchronized php-1.26wmf22/includes/resourceloader/ResourceLoader.php: https://gerrit.wikimedia.org/r/#/c/238544/ (duration: 00m 11s) |
[production] |
| 23:38 |
<krenair@tin> |
Synchronized php-1.26wmf23/includes/resourceloader/ResourceLoader.php: https://gerrit.wikimedia.org/r/#/c/238545/ (duration: 00m 11s) |
[production] |
| 23:24 |
<yurik> |
deployed kartotherian & tilerator |
[production] |
| 23:22 |
<krenair@tin> |
Synchronized php-1.26wmf22/extensions/EventLogging/modules/ext.eventLogging.core.js: https://gerrit.wikimedia.org/r/#/c/238512/ (duration: 00m 12s) |
[production] |
| 23:16 |
<krenair@tin> |
Synchronized php-1.26wmf23/extensions/EventLogging/modules/ext.eventLogging.core.js: https://gerrit.wikimedia.org/r/#/c/238513/ (duration: 00m 12s) |
[production] |
| 21:15 |
<ebernhardson@tin> |
Synchronized php-1.26wmf22/extensions/WikimediaEvents/: touch files edited in I0cb6fe37e and re-sync to cluster (duration: 00m 13s) |
[production] |
| 21:13 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf23 |
[production] |
| 21:10 |
<twentyafterfour@tin> |
Finished scap: sync 1.26wmf23 to testwiki, once more because mw1010 overloaded (duration: 03m 52s) |
[production] |
| 21:07 |
<twentyafterfour@tin> |
Started scap: sync 1.26wmf23 to testwiki, once more because mw1010 overloaded |
[production] |
| 21:05 |
<twentyafterfour@tin> |
Finished scap: sync 1.26wmf23 to testwiki, again (duration: 47m 49s) |
[production] |
| 20:47 |
<mutante> |
mw1010 - extremely slow,finally got on and attempted to restart hhvm. load going down |
[production] |
| 20:17 |
<twentyafterfour@tin> |
Started scap: sync 1.26wmf23 to testwiki, again |
[production] |
| 20:17 |
<twentyafterfour@tin> |
scap aborted: sync 1.26wmf23 to testwiki (duration: 82m 58s) |
[production] |
| 20:05 |
<ottomata> |
restarted mysql (and oozie) on analytics1027 to start mysql binlogging |
[production] |
| 18:54 |
<twentyafterfour@tin> |
Started scap: sync 1.26wmf23 to testwiki |
[production] |
| 16:55 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1003, es1004, es1007 and es1010 for decommision (duration: 00m 12s) |
[production] |