|
2015-07-17
§
|
| 14:07 |
<urandom> |
restart restbase service on restbase1003 |
[production] |
| 14:05 |
<urandom> |
restart restbase service on restbase1002 |
[production] |
| 13:56 |
<godog> |
apache2ctl graceful on fluorine antimony argon caesium helium |
[production] |
| 13:43 |
<godog> |
apache2ctl graceful on netmon1001 |
[production] |
| 11:24 |
<hashar> |
rebooted labnodepool1001.eqiad.wmnet . Accidentally deleted the whole /dev which freeze everything :( |
[production] |
| 10:21 |
<_joe_> |
repooling mw1158 |
[production] |
| 09:08 |
<_joe_> |
depooling mw1158, repooling mw1156,7 |
[production] |
| 07:51 |
<_joe_> |
depooled mw1156,7 for reimaging |
[production] |
| 04:54 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Jul 17 04:53:56 UTC 2015 (duration 53m 55s) |
[production] |
| 03:31 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1030 (duration: 00m 12s) |
[production] |
| 02:30 |
<LocalisationUpdate> |
completed (1.26wmf14) at 2015-07-17 02:30:03+00:00 |
[production] |
| 02:26 |
<l10nupdate> |
Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 05m 55s) |
[production] |
| 02:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Jul 17 02:07:22 UTC 2015 (duration 7m 20s) |
[production] |
| 02:03 |
<LocalisationUpdate> |
failed (1.26wmf14) at 2015-07-17 02:03:12+00:00 |
[production] |
| 01:30 |
<mutante> |
git pull origin on strontium |
[production] |
|
2015-07-16
§
|
| 21:27 |
<ori> |
bounced nutcracker on mw1139 as well. hashar noticed flood of errors from these hosts on https://logstash.wikimedia.org/#/dashboard/elasticsearch/mediawiki-errors . lack of monitoring / alerts is troubling. |
[production] |
| 21:26 |
<ori> |
bounced nutcracker on mw1128 and mw1134 |
[production] |
| 20:50 |
<mutante> |
iegreview tool - short maintenance downtime |
[production] |
| 19:39 |
<YuviPanda> |
imported aspell-id from ubuntu to jessie-wikimedia - needed by ores, simple package that I am not sure why it is not in jessie |
[production] |
| 19:20 |
<twentyafterfour> |
Synchronized php-1.26wmf14/includes/db/LoadMonitor.php: Deploying Hotfix for T105373 (duration: 00m 13s) |
[production] |
| 18:40 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf14 |
[production] |
| 18:26 |
<ejegg> |
changed batch size from 250 to 1 in RGC jenkins job |
[production] |
| 18:22 |
<ejegg> |
updated civicrm from 24e0fc854433ea4982e94a0fd2f8bdad8f8dcad7 to fa724dd2e2e69545d81015c943cb7f52cf6de8e1 |
[production] |
| 16:56 |
<Jeff_Green> |
authdns update to rename lutetium.wm.o |
[production] |
| 16:08 |
<hashar_> |
kept nodepool stopped on labnodepool1001.eqiad.wmnet because it spams the cron log |
[production] |
| 15:57 |
<demon> |
Synchronized multiversion/MWMultiVersion.php: prod no-op, beta change (duration: 00m 13s) |
[production] |
| 15:54 |
<krenair> |
Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/224975/ (duration: 00m 12s) |
[production] |
| 15:27 |
<thcipriani> |
Synchronized php-1.26wmf14/extensions/Math/MathMathML.php: SWAT: Fix: Undefined variable passed hook [[gerrit:225058]] (duration: 00m 12s) |
[production] |
| 15:03 |
<ejegg> |
updated payments from 4ca95d55a9745c05ccfbb16ee6f23a6f75328824 to ebb1a9e52172a4793cf5feb33220b4d7edfcad70 |
[production] |
| 12:21 |
<dcausse> |
es1.6 upgrade: all done |
[production] |
| 11:32 |
<dcausse> |
restarted gmond on elastic1024 |
[production] |
| 11:06 |
<mobrovac> |
citoid deploying ff90869 |
[production] |
| 10:56 |
<dcausse> |
es1.6 upgrade: upgrade elastic1031 |
[production] |
| 10:25 |
<mobrovac> |
citoid rolled back to ffbaf6d |
[production] |
| 10:10 |
<mobrovac> |
citoid deploying 5aeb0fc |
[production] |
| 10:05 |
<dcausse> |
es1.6 upgrade: upgrade elastic1030 |
[production] |
| 09:38 |
<dcausse> |
es1.6 upgrade: upgrade elastic1029 |
[production] |
| 08:42 |
<dcausse> |
es1.6 upgrade: upgrade elastic1028 |
[production] |
| 07:31 |
<dcausse> |
es1.6 upgrade: upgrade elastic1027 |
[production] |
| 07:22 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jul 16 07:22:49 UTC 2015 (duration 22m 48s) |
[production] |
| 05:53 |
<dcausse> |
es1.6 upgrade: upgrade elastic1026 |
[production] |
| 05:31 |
<krenair> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 12s) |
[production] |
| 05:24 |
<krenair> |
Synchronized php-1.26wmf14/extensions/WikimediaMaintenance/dumpInterwiki.php: https://gerrit.wikimedia.org/r/#/c/225008/ (duration: 00m 13s) |
[production] |
| 04:38 |
<krenair> |
Synchronized php-1.26wmf13/extensions/WikimediaMaintenance/dumpInterwiki.php: https://gerrit.wikimedia.org/r/#/c/225006/ (duration: 00m 13s) |
[production] |
| 03:54 |
<manybubbles> |
es1.6 upgrade: upgrade elastic1025 |
[production] |
| 03:19 |
<LocalisationUpdate> |
completed (1.26wmf14) at 2015-07-16 03:19:37+00:00 |
[production] |
| 03:13 |
<l10nupdate> |
Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 10m 23s) |
[production] |
| 02:46 |
<LocalisationUpdate> |
completed (1.26wmf13) at 2015-07-16 02:46:03+00:00 |
[production] |
| 02:43 |
<manybubbles> |
es1.6 upgrade: upgrade elastic1024 |
[production] |
| 02:39 |
<l10nupdate> |
Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 10m 50s) |
[production] |