|
2014-09-01
§
|
| 18:58 |
<reedy> |
Purged l10n cache for 1.24wmf17 |
[production] |
| 16:44 |
<ottomata> |
removed some large slow query logs from elastic* nodes, need to look into this... |
[production] |
| 12:10 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1044, take 2 (duration: 00m 06s) |
[production] |
| 12:04 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1044 (duration: 00m 06s) |
[production] |
| 11:31 |
<springle> |
Synchronized wmf-config/db-eqiad.php: pool db1044, warm up (duration: 00m 06s) |
[production] |
| 09:31 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1027 (duration: 00m 07s) |
[production] |
| 07:27 |
<godog> |
deploy latest ring to swift eqiad-prod |
[production] |
| 07:11 |
<godog> |
powercycle ms-be1010 "cpu soft lockup" on console |
[production] |
| 05:28 |
<springle> |
xtrabackup clone db1027 to db1044 |
[production] |
| 05:26 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1027 while cloning (duration: 00m 07s) |
[production] |
| 03:15 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Sep 1 03:14:22 UTC 2014 (duration 14m 21s) |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.24wmf19) at 2014-09-01 02:27:39+00:00 |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.24wmf18) at 2014-09-01 02:16:18+00:00 |
[production] |
|
2014-08-30
§
|
| 08:18 |
<godog> |
restart mailman on sodium, pending https://gerrit.wikimedia.org/r/#/c/156766/ |
[production] |
| 08:01 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1071, warm up (duration: 00m 07s) |
[production] |
| 06:33 |
<jgage> |
analytics1021 back in service after election |
[production] |
| 06:14 |
<jgage> |
upgraded & rebooted analytics1021 |
[production] |
| 06:01 |
<springle> |
Synchronized wmf-config/db-eqiad.php: return db1037 to normal load (duration: 00m 06s) |
[production] |
| 05:03 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool es1001 (duration: 00m 06s) |
[production] |
| 04:06 |
<springle> |
upgrade es1001 to mariadb 10 |
[production] |
| 03:56 |
<springle> |
xtrabackup clone db1037 to db1071 |
[production] |
| 03:55 |
<springle> |
Synchronized wmf-config/db-eqiad.php: reduce db1037 load while cloning (duration: 00m 06s) |
[production] |
| 03:31 |
<springle> |
Synchronized wmf-config/db-eqiad.php: pool db1073, depool db1071 (duration: 00m 07s) |
[production] |
| 03:19 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Aug 30 03:17:57 UTC 2014 (duration 17m 56s) |
[production] |
| 02:33 |
<LocalisationUpdate> |
completed (1.24wmf19) at 2014-08-30 02:32:06+00:00 |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.24wmf18) at 2014-08-30 02:20:39+00:00 |
[production] |
|
2014-08-29
§
|
| 21:15 |
<ori> |
Synchronized wmf-config: I812c0bb6c: Scrap unused Twemproxy config files (duration: 00m 04s) |
[production] |
| 21:12 |
<ori> |
updated /a/common to {{Gerrit|I812c0bb6c}}: Scrap unused Twemproxy config files |
[production] |
| 21:03 |
<mutante> |
restarted uwsgi on tungsten |
[production] |
| 20:49 |
<mutante> |
tungsten extremely busy, graphite down, logging in since 5 minutes :p |
[production] |
| 20:48 |
<mutante> |
powercycling ms-be1006 - BUG: soft lockup - CPU#0 stuck ... |
[production] |
| 19:19 |
<mutante> |
installing package upgrades on iron, bast1001 |
[production] |
| 18:41 |
<aaron> |
Synchronized php-1.24wmf18/maintenance/findMissingFiles.php: 994d4a556a070156fd04fb4951492f10696cc63c (duration: 00m 03s) |
[production] |
| 18:30 |
<ori> |
Synchronized php-1.24wmf19/resources/src/mediawiki.action/mediawiki.action.view.redirect.js: I19221a25a: mediawiki.action.view.redirect: Work around a IE 10+ HTML5 history API bug (duration: 00m 06s) |
[production] |
| 18:30 |
<ori> |
Synchronized php-1.24wmf18/resources/src/mediawiki.action/mediawiki.action.view.redirect.js: I19221a25a: mediawiki.action.view.redirect: Work around a IE 10+ HTML5 history API bug (duration: 00m 07s) |
[production] |
| 15:36 |
<hashar_> |
Jenkins: pooled a new slave 10.68.16.162 as wikidata-jenkins3 on behalf of addshore / wmde |
[production] |
| 15:04 |
<_joe_> |
shutting down mw1163, filled RT 8243 for repair. |
[production] |
| 14:54 |
<_joe_> |
re-enabled mw1130 |
[production] |
| 14:41 |
<aude> |
Synchronized wmf-config/Wikibase.php: enable Wikibase badges css, follow up from last night deploy (duration: 00m 06s) |
[production] |
| 14:22 |
<_joe_> |
syncing mw1130 |
[production] |
| 14:06 |
<_joe_> |
disable mw1130 from the api pool whil it gets resynced |
[production] |
| 12:30 |
<Krinkle> |
Running extensions/GlobalCssJs/removeOldManualUserPages.php per [[m:GlobalCssJs]] |
[production] |
| 11:06 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1070 (duration: 00m 09s) |
[production] |