2016-05-02
§
|
19:27 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.22/includes/filebackend/FileBackendMultiWrite.php: 63b2d7b2eae (duration: 00m 32s) |
[production] |
19:17 |
<mutante> |
manually removing 2fa from my own wikitech account, adding it back .. |
[production] |
18:30 |
<joal> |
manually touch _SUCCESS file in hdfs://analytics-hadoop/wmf/data/raw/webrequest/webrequest_text/hourly/2016/05/02/14/ to launch refine process despites load job failure |
[analytics] |
18:24 |
<gehel> |
deploying latest WDQS version |
[production] |
17:38 |
<elukey> |
removed out of service banner from dashiki dashboards |
[analytics] |
17:33 |
<elukey> |
reverted Varnish config to return 503s for datasets and stats |
[analytics] |
17:23 |
<robh> |
restbase2004 offline for next few hours for comparison work for new systems T132976 |
[production] |
16:41 |
<urandom> |
Forcing puppet run and restarting Cassandra on deployment-restbase0[1-2] : T126629 |
[releng] |
16:40 |
<urandom> |
Cherry-picking https://gerrit.wikimedia.org/r/operations/puppet refs/changes/78/284078/12 to deployment-puppetmaster : T126629 |
[releng] |
16:24 |
<urandom> |
Restarat Cassandra on deployment-restbase0[1-2] : T126629 |
[releng] |
16:21 |
<urandom> |
forcing puppet run on deployment-restbase0[1-2] : T126629 |
[releng] |
16:20 |
<urandom> |
cherry-picking latest refs/changes/78/284078/11 onto deployment-puppetmaster : T126629 |
[releng] |
16:01 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286286/ (duration: 00m 26s) |
[production] |
15:53 |
<krenair@tin> |
Synchronized wikiversions-labs.json: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 25s) |
[production] |
15:53 |
<krenair@tin> |
Synchronized dblists/all-labs.dblist: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 26s) |
[production] |
15:44 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286287/ (duration: 00m 25s) |
[production] |
15:40 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286285/ (duration: 00m 25s) |
[production] |
15:32 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/286434/2 (duration: 02m 02s) |
[production] |
15:28 |
<bblack> |
re-pooling esams |
[production] |
15:22 |
<jynus> |
restarting db1040 for reimage |
[production] |
15:21 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Math/MathRestbaseInterface.php: https://gerrit.wikimedia.org/r/#/c/286412/ (duration: 00m 26s) |
[production] |
15:07 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/285700/ (duration: 00m 42s) |
[production] |
14:52 |
<moritzm> |
rolling restart of zookeeper to pick up Java update |
[production] |
14:22 |
<bblack> |
starting gdnsd on esams (esams is marked down there) |
[production] |
14:20 |
<bblack> |
stopped gdnsd on eeden |
[production] |
13:13 |
<jynus> |
stopping db1040 mysql for backup before cloning |
[production] |
12:15 |
<elukey> |
deployed Varnish change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
12:14 |
<elukey> |
deployed Varnish change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[analytics] |
12:13 |
<elukey> |
deployed Varnish cache::misc change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
12:12 |
<elukey> |
Merged Varnish cache::misc change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
12:05 |
<elukey> |
enabled maintenance banner to dashiki based dashboards via https://meta.wikimedia.org/wiki/Dashiki:OutOfService |
[analytics] |
11:21 |
<elukey> |
deployed the last version of Event Logging from tin. Service also restarted. |
[production] |
11:21 |
<elukey> |
deployed last version of Event Logging. Service also restarted. |
[analytics] |
11:06 |
<moritzm> |
rolling restart of hhvm in eqiad for pcre security update |
[production] |
10:42 |
<moritzm> |
rolling restart of hhvm in codfw for pcre security update |
[production] |
09:58 |
<moritzm> |
uploaded openldap 2.4.41+wmf1 for jessie-wikimedia to carbon (T130593) |
[production] |
09:54 |
<gehel> |
restart elasticsearch cluster to ensure multicast configuration is disabled (T110236) |
[deployment-prep] |
09:44 |
<hashar> |
On zuul-merger instances (gallium / scandium), cleared out pywikibot/core working copy ( rm -fR /srv/ssd/zuul/git/pywikibot/core/ ) T134062 |
[releng] |
08:14 |
<hashar> |
Restarted stuck Jenkins (due to IRC plugin) |
[production] |
07:44 |
<moritzm> |
rebooting hasseleh/hassium for kernel upgrade to 4.4 |
[production] |
07:10 |
<moritzm> |
installing poppler security updates |
[production] |
06:46 |
<_joe_> |
rebooting serpens from ganeti, unreachable |
[production] |
02:30 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon May 2 02:30:33 UTC 2016 (duration 9m 18s) |
[production] |
02:21 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.22) (duration: 09m 31s) |
[production] |