3401-3450 of 10000 results (56ms)
2017-03-21 §
14:44 <gehel> elasticsearch eqiad, full cluster restart after cleanup of known old indices - T157479 [production]
14:39 <gehel> deleting old v2 indices from each elasticsearch server - T157479 [production]
14:34 <gehel> deleting old v2 indices from elastic1030: azbwiki_general_first, vewikimedia_content_1415331110, vewikimedia_general_1415331150 - T157479 [production]
14:07 <gehel> upgrading elasticsearch eqiad to v5.x - T157479 [production]
14:01 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2044, depool db2037 T160415 - T73563 (duration: 00m 42s) [production]
13:44 <dcausse> eu SWAT done [production]
13:39 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] Enable completion suggester (duration: 00m 42s) [production]
13:30 <dcausse@tin> Synchronized wmf-config/CirrusSearch-common.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (3/3) (duration: 00m 41s) [production]
13:29 <gehel> rolling restart of wdqs to load new configuration options [production]
13:29 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (2/3) (duration: 00m 43s) [production]
13:27 <dcausse@tin> Synchronized wmf-config/CommonSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (1/3) (duration: 00m 42s) [production]
13:15 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T157111 pagePreviews: Increase perf instrumentation sample (duration: 00m 58s) [production]
13:14 <Reedy> Make that clear 2FA for RickinBaltimore per T160671 [production]
13:12 <Reedy> Clear centralauth for RickinBaltimore per T160671 [production]
12:54 <moritzm> installing r-base security updates [production]
12:47 <gehel> running stress and bonnie on elastic2020 - T149006 [production]
12:34 <Dereckson> Created OATHAuth tables on projectcomwiki (T143138) [production]
12:27 <Dereckson> Create account Superzerocool on projectcomwiki (bureaucrat, T143138) [production]
11:00 <ema> upgrading twisted to 16.2.0 on lvs1007-12 T160433 [production]
10:33 <marostegui> Run pt-table-checksum on s6 (ruwiki) - https://phabricator.wikimedia.org/T160509 [production]
09:42 <moritzm> installing libevent security updates on remaining hosts in eqiad [production]
09:42 <marostegui> Stop MySQL db1070 to clone db1092 from it - T137191 [production]
09:14 <akosiaris> enable bacula deamons on helium, everything looks ok [production]
09:09 <moritzm> installing wireshark security updates [production]
09:06 <hashar> CI deploying config hack "High priority test pipeline" : https://gerrit.wikimedia.org/r/343318 - T160667 [production]
08:43 <gehel> shutting down elasticsearch on elastic2020, investigating T149006 [production]
07:50 <gehel> banning elastic2020 from cluster to investigate T149006 [production]
07:36 <marostegui> Stop mysql db1092 for maintenance - T137191 [production]
07:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T137191 (duration: 00m 42s) [production]
07:22 <marostegui> Run pt-table-checksum on s6 (jawiki) - T160509 [production]
07:18 <marostegui> Deploy schema change on db2044 and labsdb1009 (s4) - https://phabricator.wikimedia.org/T160415 - https://phabricator.wikimedia.org/T73563 [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2044 - T160415 - T73563 (duration: 00m 41s) [production]
06:49 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2051 - T160415 - T73563 (duration: 01m 07s) [production]
06:01 <joal@tin> Finished deploy [analytics/refinery@c3a9139]: (no justification provided) (duration: 06m 39s) [production]
05:55 <joal@tin> Started deploy [analytics/refinery@c3a9139]: (no justification provided) [production]
03:38 <eileen> update civicrm from 21afe66b621d36e285fc5a041bd26e8083287a04 to 92e3b850d7dbe9719ab86ba2d1c2489c60c0dcc0 [production]
03:10 <eileen> update civicrm from 0ed1659d679d015f3f5ff223bc0684de6f249bbf to 21afe66b621d36e285fc5a041bd26e8083287a04 [production]
02:37 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Mar 21 02:37:33 UTC 2017 (duration 5m 22s) [production]
02:32 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.16) (duration: 13m 22s) [production]
01:59 <eileen> update civicrm from f454f16bc68a19578ddc270bac088546dd243a27 to 0ed1659d679d015f3f5ff223bc0684de6f249bbf [production]
00:37 <Amir1> ladsgroup@terbium:/srv/mediawiki/php-1.29.0-wmf.16$ mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=etwiki is done now (T159609) [production]
00:30 <Amir1> ladsgroup@terbium:/srv/mediawiki/php-1.29.0-wmf.16$ mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=etwiki (T159609) [production]
00:28 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Enable ORES review tool in etwiki (T159609) (duration: 00m 42s) [production]
00:13 <Amir1> mwscript maintenance/sql.php --wiki=etwiki extensions/ORES/sql/(ores_model|ores_classification).sql (T159609) [production]
00:04 <Krinkle> mwscript deleteEqualMessages.php on public wikis (T45917) [production]
00:02 <eileen> update civicrm from e058e8cf2377d6964eec909990e9f592275822c6 to f454f16bc68a19578ddc270bac088546dd243a27 [production]
2017-03-20 §
23:59 <mutante> phab2001 / iridium - running puppet after gerrit:343635 - switches phab search to codfw [production]
23:58 <dereckson@tin> Synchronized php-1.29.0-wmf.16/extensions/CirrusSearch/includes/CompletionSuggester.php: Don't pass null suggest queries to elasticsearch (T160896) (duration: 00m 42s) [production]
23:54 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Restrict page images to lead section (T152115) (duration: 00m 43s) [production]
23:48 <dereckson@tin> Synchronized php-1.29.0-wmf.16/extensions/CirrusSearch/includes/BuildDocument/Completion/SuggestBuilder.php: [[Gerrit:343754]] Allow completion suggester to work with titles that look like integers (duration: 00m 45s) [production]