2019-05-28
ยง
|
14:10 |
<herron> |
beginning rolling reboots of codfw kafka-main cluster for security updates |
[production] |
14:10 |
<zfilipin@deploy1001> |
Finished scap: testwiki to php-1.34.0-wmf.7 and rebuild l10n cache (duration: 34m 22s) |
[production] |
14:04 |
<gehel@cumin2001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |
13:50 |
<_joe_> |
hhvm restarted on mwdebug1001 |
[production] |
13:48 |
<_joe_> |
stopping hhvm on mwdebug1001 for testing |
[production] |
13:39 |
<gehel@cumin2001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
13:35 |
<zfilipin@deploy1001> |
Started scap: testwiki to php-1.34.0-wmf.7 and rebuild l10n cache |
[production] |
13:32 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@60369cc]: T224388 (duration: 00m 03s) |
[production] |
13:31 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@60369cc]: T224388 |
[production] |
13:31 |
<gilles@deploy1001> |
deploy aborted: T224388 (duration: 00m 01s) |
[production] |
13:31 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@1c60db1]: T224388 |
[production] |
13:24 |
<urandom> |
decommissioning restbase1014-c -- T223976 |
[production] |
13:23 |
<gehel@cumin2001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |
12:55 |
<gehel@cumin2001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
12:51 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@1c60db1]: T224388 (duration: 00m 04s) |
[production] |
12:50 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@1c60db1]: T224388 |
[production] |
12:40 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@157c25f]: T224388 (duration: 00m 06s) |
[production] |
12:40 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@157c25f]: T224388 |
[production] |
12:13 |
<raynor> |
EU SWAT done |
[production] |
12:11 |
<pmiazga@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:512743 Disable the rdf2latex Collection portlet format(T224433)]] (duration: 00m 55s) |
[production] |
12:00 |
<raynor> |
EU SWAT re-opened |
[production] |
11:58 |
<Lucas_WMDE> |
EU SWAT done |
[production] |
11:54 |
<Lucas_WMDE> |
^ error, no change to wiki |
[production] |
11:54 |
<Lucas_WMDE> |
lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/EntitySchema/maintenance/createPreexistingSchemas.php --wiki=testwikidatawiki |
[production] |
11:52 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/EntitySchema/: SWAT: [[gerrit:512689|Add maintenance script to create preexisting Schemas]] + [[gerrit:512717|Small maintenance script adjustments]] (duration: 00m 54s) |
[production] |
11:48 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/EntitySchema: SWAT: [[gerrit:512677|Skip configured IDs]] (duration: 00m 57s) |
[production] |
11:43 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:511753|Add a list of IDs to skip in production]] (duration: 00m 54s) |
[production] |
11:37 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config: SWAT: [[gerrit:510204|Add feature flag config for breaking Wikibase API change (T223300)]] (duration: 00m 54s) |
[production] |
11:31 |
<Urbanecm> |
Ran namespaceDupes.php for urwikibooks, urwikiquote, urwiktionary and aswikisource |
[production] |
11:27 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:512426|Use underscores instead of spaces in wgMetaNamespace(Talk) for several projects]] (T223039) (duration: 00m 54s) |
[production] |
11:25 |
<arturo> |
merging change to the puppet sudo module https://gerrit.wikimedia.org/r/c/operations/puppet/+/508311 |
[production] |
11:18 |
<urbanecm@deploy1001> |
Synchronized wmf-config/abusefilter.php: SWAT: [[:gerrit:512422|Add abusefilter-modify-restricted to abusefilter group on plwiki (T224308)]] (duration: 02m 36s) |
[production] |
10:54 |
<zfilipin@deploy1001> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki="testwiki" --outdir="/tmp/scap_l10n_4182265560" --threads=30 --lang en --quiet' returned non-zero exit status 1 (duration: 03m 00s) |
[production] |
10:51 |
<zfilipin@deploy1001> |
Started scap: testwiki to php-1.34.0-wmf.7 and rebuild l10n cache |
[production] |
10:48 |
<zfilipin@deploy1001> |
Pruned MediaWiki: 1.34.0-wmf.3 [keeping static files] (duration: 01m 32s) |
[production] |
10:45 |
<zfilipin@deploy1001> |
Pruned MediaWiki: 1.34.0-wmf.4 [keeping static files] (duration: 06m 06s) |
[production] |
09:32 |
<mobrovac@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Allow MW to honour the X-Request-Id header if set - T201409 (duration: 01m 12s) |
[production] |
09:28 |
<moritzm> |
installing php5 security updates |
[production] |
09:00 |
<moritzm> |
installing ffmpeg security updates |
[production] |
08:58 |
<gehel> |
rebooting wdqs nodes for kernel upgrade |
[production] |
08:54 |
<jiji@deploy1001> |
Finished deploy [cpjobqueue/deploy@04cc66d]: Migrating ORESFetchScoresJob to PHP7 - T219148 (duration: 01m 21s) |
[production] |
08:52 |
<jiji@deploy1001> |
Started deploy [cpjobqueue/deploy@04cc66d]: Migrating ORESFetchScoresJob to PHP7 - T219148 |
[production] |
08:52 |
<moritzm> |
uploaded ffmpeg 3.2.14-1~deb9u1+wmf3 to component/vp9 of stretch-wikimedia (rebase of our vp9-row-mt backport to the latest stretch-security ffmpeg update) |
[production] |
08:47 |
<vgutierrez> |
uploaded acme-chief 0.17 to apt.wikimedia.org (buster) - T220518 T213820 |
[production] |
08:40 |
<volans> |
T224448 sudo cumin -b 15 -p 95 'R:git::clone' 'run-puppet-agent -q --failed-only' |
[production] |
08:29 |
<volans> |
restarting gerrit due to stack threads - T224448 |
[production] |
07:17 |
<moritzm> |
uploaded ffmpeg 3.2.14-1~deb9u1+wmf1 to component/vp9 of stretch-wikimedia (rebase of our vp9-row-mt backport to the latest stretch-security ffmpeg update) |
[production] |
07:02 |
<mobrovac> |
decommission restbase1014-b -- T223976 |
[production] |
06:40 |
<jiji@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Send 20% of anonymous users to PHP7.2 - T219150 (duration: 00m 51s) |
[production] |
00:38 |
<urandom> |
decommissioning restbase1014-a -- T223976 |
[production] |