2019-05-28
§
|
13:23 |
<gehel@cumin2001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |
12:55 |
<gehel@cumin2001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
12:51 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@1c60db1]: T224388 (duration: 00m 04s) |
[production] |
12:50 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@1c60db1]: T224388 |
[production] |
12:40 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@157c25f]: T224388 (duration: 00m 06s) |
[production] |
12:40 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@157c25f]: T224388 |
[production] |
12:13 |
<raynor> |
EU SWAT done |
[production] |
12:11 |
<pmiazga@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:512743 Disable the rdf2latex Collection portlet format(T224433)]] (duration: 00m 55s) |
[production] |
12:00 |
<raynor> |
EU SWAT re-opened |
[production] |
11:58 |
<Lucas_WMDE> |
EU SWAT done |
[production] |
11:54 |
<Lucas_WMDE> |
^ error, no change to wiki |
[production] |
11:54 |
<Lucas_WMDE> |
lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/EntitySchema/maintenance/createPreexistingSchemas.php --wiki=testwikidatawiki |
[production] |
11:52 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/EntitySchema/: SWAT: [[gerrit:512689|Add maintenance script to create preexisting Schemas]] + [[gerrit:512717|Small maintenance script adjustments]] (duration: 00m 54s) |
[production] |
11:48 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/EntitySchema: SWAT: [[gerrit:512677|Skip configured IDs]] (duration: 00m 57s) |
[production] |
11:43 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:511753|Add a list of IDs to skip in production]] (duration: 00m 54s) |
[production] |
11:37 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config: SWAT: [[gerrit:510204|Add feature flag config for breaking Wikibase API change (T223300)]] (duration: 00m 54s) |
[production] |
11:31 |
<Urbanecm> |
Ran namespaceDupes.php for urwikibooks, urwikiquote, urwiktionary and aswikisource |
[production] |
11:27 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:512426|Use underscores instead of spaces in wgMetaNamespace(Talk) for several projects]] (T223039) (duration: 00m 54s) |
[production] |
11:25 |
<arturo> |
merging change to the puppet sudo module https://gerrit.wikimedia.org/r/c/operations/puppet/+/508311 |
[production] |
11:18 |
<urbanecm@deploy1001> |
Synchronized wmf-config/abusefilter.php: SWAT: [[:gerrit:512422|Add abusefilter-modify-restricted to abusefilter group on plwiki (T224308)]] (duration: 02m 36s) |
[production] |
10:54 |
<zfilipin@deploy1001> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki="testwiki" --outdir="/tmp/scap_l10n_4182265560" --threads=30 --lang en --quiet' returned non-zero exit status 1 (duration: 03m 00s) |
[production] |
10:51 |
<zfilipin@deploy1001> |
Started scap: testwiki to php-1.34.0-wmf.7 and rebuild l10n cache |
[production] |
10:48 |
<zfilipin@deploy1001> |
Pruned MediaWiki: 1.34.0-wmf.3 [keeping static files] (duration: 01m 32s) |
[production] |
10:45 |
<zfilipin@deploy1001> |
Pruned MediaWiki: 1.34.0-wmf.4 [keeping static files] (duration: 06m 06s) |
[production] |
09:32 |
<mobrovac@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Allow MW to honour the X-Request-Id header if set - T201409 (duration: 01m 12s) |
[production] |
09:28 |
<moritzm> |
installing php5 security updates |
[production] |
09:00 |
<moritzm> |
installing ffmpeg security updates |
[production] |
08:58 |
<gehel> |
rebooting wdqs nodes for kernel upgrade |
[production] |
08:54 |
<jiji@deploy1001> |
Finished deploy [cpjobqueue/deploy@04cc66d]: Migrating ORESFetchScoresJob to PHP7 - T219148 (duration: 01m 21s) |
[production] |
08:52 |
<jiji@deploy1001> |
Started deploy [cpjobqueue/deploy@04cc66d]: Migrating ORESFetchScoresJob to PHP7 - T219148 |
[production] |
08:52 |
<moritzm> |
uploaded ffmpeg 3.2.14-1~deb9u1+wmf3 to component/vp9 of stretch-wikimedia (rebase of our vp9-row-mt backport to the latest stretch-security ffmpeg update) |
[production] |
08:47 |
<vgutierrez> |
uploaded acme-chief 0.17 to apt.wikimedia.org (buster) - T220518 T213820 |
[production] |
08:40 |
<volans> |
T224448 sudo cumin -b 15 -p 95 'R:git::clone' 'run-puppet-agent -q --failed-only' |
[production] |
08:29 |
<volans> |
restarting gerrit due to stack threads - T224448 |
[production] |
07:17 |
<moritzm> |
uploaded ffmpeg 3.2.14-1~deb9u1+wmf1 to component/vp9 of stretch-wikimedia (rebase of our vp9-row-mt backport to the latest stretch-security ffmpeg update) |
[production] |
07:02 |
<mobrovac> |
decommission restbase1014-b -- T223976 |
[production] |
06:40 |
<jiji@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Send 20% of anonymous users to PHP7.2 - T219150 (duration: 00m 51s) |
[production] |
00:38 |
<urandom> |
decommissioning restbase1014-a -- T223976 |
[production] |
2019-05-27
§
|
23:19 |
<thcipriani> |
gerrit back after restarting due to T224448 |
[production] |
23:10 |
<thcipriani> |
restarting gerrit due to active threads being stuck being a sendemail thread. |
[production] |
22:52 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@bacfc37]: T224388 (duration: 00m 05s) |
[production] |
22:52 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@bacfc37]: T224388 |
[production] |
22:19 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@d0c156e]: T224388 (duration: 00m 05s) |
[production] |
22:19 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@d0c156e]: T224388 |
[production] |
20:19 |
<gilles@deploy1001> |
Finished deploy [performance/asoranking@61039f1]: (no justification provided) (duration: 00m 06s) |
[production] |
20:19 |
<gilles@deploy1001> |
Started deploy [performance/asoranking@61039f1]: (no justification provided) |
[production] |
18:41 |
<krinkle@deploy1001> |
Synchronized php-1.34.0-wmf.6/includes/libs/rdbms: 66556bf37e8 / T223310, T223978 (duration: 00m 50s) |
[production] |
18:06 |
<krinkle@deploy1001> |
Synchronized errorpages/: 4ffcbfc2ba3 (duration: 00m 48s) |
[production] |
17:56 |
<andrewbogott> |
re-imaging cloudservices1004 in order to make sure our apt magic is working properly |
[production] |
17:37 |
<andrewbogott> |
refreshing puppet-compiler facts |
[production] |