|
2015-10-07
§
|
| 05:25 |
<ebernhardson> |
generating elasticsearch indices in codfw, should run ~3 hours |
[production] |
| 04:33 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Touch InitiialiSettings.php to force config regeneration (duration: 00m 18s) |
[production] |
| 04:23 |
<ebernhardson@tin> |
Synchronized wmf-config/: enable second es cluster in testwiki one more time (duration: 00m 18s) |
[production] |
| 04:15 |
<ebernhardson> |
sync-common on mw2187.codfw.wmnet to fix localisation cache errors in exception.log |
[production] |
| 03:37 |
<ebernhardson@tin> |
Synchronized wmf-config: redisable second cluster only on testwiki (duration: 00m 16s) |
[production] |
| 03:35 |
<ebernhardson@tin> |
Synchronized wmf-config/: Reenable second ES cluster on testwiki only (duration: 00m 18s) |
[production] |
| 03:10 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-07 03:10:02+00:00 |
[production] |
| 03:03 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 10m 18s) |
[production] |
| 02:37 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-07 02:37:32+00:00 |
[production] |
| 02:32 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 22s) |
[production] |
| 01:44 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.2/extensions/Echo: Fix JS error (duration: 00m 18s) |
[production] |
| 01:44 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.1/extensions/Echo: Fix JS error (duration: 00m 17s) |
[production] |
| 00:04 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.2/extensions/Echo: SWAT (duration: 00m 17s) |
[production] |
| 00:04 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.1/extensions/Echo: SWAT (duration: 00m 17s) |
[production] |
|
2015-10-06
§
|
| 23:20 |
<ebernhardson@tin> |
Synchronized wmf-config: Revert multicluster config for testwiki (duration: 00m 18s) |
[production] |
| 23:18 |
<ebernhardson@tin> |
Synchronized wmf-config/: Enable multicluster ES on testwiki (duration: 00m 17s) |
[production] |
| 22:44 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 |
[production] |
| 22:40 |
<twentyafterfour@tin> |
Synchronized php-1.27.0-wmf.2: Deploy https://gerrit.wikimedia.org/r/#/c/244066/ (duration: 01m 40s) |
[production] |
| 21:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.1 |
[production] |
| 21:15 |
<twentyafterfour> |
restarted phd in response to a phabricator setup issue |
[production] |
| 20:58 |
<bblack> |
disabling puppet on caches for VCL testing |
[production] |
| 20:58 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 |
[production] |
| 20:53 |
<twentyafterfour@tin> |
Finished scap: sync wmf/1.27.0-wmf.1 (duration: 32m 13s) |
[production] |
| 20:29 |
<mutante> |
service "ishmael" has been removed (T109777) - removed docroot on neon. tarball exists in /root just in case. code is on https://github.com/asher/ishmael |
[production] |
| 20:20 |
<twentyafterfour@tin> |
Started scap: sync wmf/1.27.0-wmf.1 |
[production] |
| 18:48 |
<yuvipanda> |
fixing https://phabricator.wikimedia.org/T109216 on labstore1002 |
[production] |
| 18:10 |
<godog> |
upgrade videoscalers to ffmpeg2theora 0.29.0~git+20150813-2 |
[production] |
| 15:04 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable Suggestion in af, gl, gu, mk, oc, sh and simplewiki [[gerrit:243919]] (duration: 00m 18s) |
[production] |
| 11:33 |
<jynus> |
performing schema change on db1051 enwiki revision |
[production] |
| 11:10 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1051 for more maintenance (duration: 00m 17s) |
[production] |
| 10:45 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool es1051 after maintenance (duration: 00m 17s) |
[production] |
| 10:41 |
<jynus> |
potential extra load on mediawiki recent changes and watchlist on enwiki, please report any slowdown |
[production] |
| 10:22 |
<jynus> |
dropping temp recovered tables from db1051 to prepare for repool |
[production] |
| 09:50 |
<_joe_> |
uploaded a new pybal package for jessie |
[production] |
| 06:19 |
<paravoid> |
eqord is back up |
[production] |
| 04:24 |
<paravoid> |
all waves to eqord down, probably related to RT#9619 |
[production] |
| 02:34 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-06 02:34:31+00:00 |
[production] |
| 02:29 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 53s) |
[production] |
|
2015-10-05
§
|
| 23:53 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner/includes/ZeroSpecialPage.php: https://gerrit.wikimedia.org/r/#/c/243833/ (duration: 00m 17s) |
[production] |
| 23:39 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: rv (duration: 00m 17s) |
[production] |
| 23:38 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/243728/ (duration: 00m 17s) |
[production] |
| 23:14 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.1/extensions/VisualEditor/modules/ve-mw/ui: https://gerrit.wikimedia.org/r/#/c/243729/ (duration: 00m 17s) |
[production] |
| 23:05 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/242942/ (duration: 00m 17s) |
[production] |
| 21:16 |
<yurik@tin> |
Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Take2: Deploying ZeroBanner 242661+243808 (duration: 00m 17s) |
[production] |
| 21:00 |
<yurik@tin> |
Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Rolling back ZeroBanner 242661 (duration: 00m 18s) |
[production] |
| 20:55 |
<yurik@tin> |
Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Deploying ZeroBanner 242661 (duration: 00m 17s) |
[production] |
| 18:38 |
<mutante> |
restarted gitblit |
[production] |
| 17:44 |
<gwicke> |
rolling restart of eqiad restbase nodes done |
[production] |
| 17:27 |
<gwicke> |
rolling restart of restbase cluster to rule out driver issues causing the increased p99 read lacenty |
[production] |
| 17:19 |
<robh> |
analytics1035 pegged out, ssh unresponsive and raid failures, and then fixed itself 5 minutes later |
[production] |