|
2017-03-21
ยง
|
| 16:52 |
<urandom> |
T111113: Rolling restart of RESTBase, eqiad |
[production] |
| 16:41 |
<urandom> |
T111113: Rolling restart of RESTBase, codfw, complete |
[production] |
| 16:17 |
<urandom> |
T111113: Enabling RESTBase client encryption on (remaining) codfw nodes |
[production] |
| 16:11 |
<urandom> |
T111113: Enabling RESTBase client encryption on restbase2001.codfw.wmnet (canary) |
[production] |
| 15:56 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic2020.codfw.wmnet |
[production] |
| 15:27 |
<moritzm> |
removed "Directory Managers" group from LDAP (Bug T157131) |
[production] |
| 15:00 |
<bd808@tin> |
Synchronized php-1.29.0-wmf.16/extensions/OpenStackManager/special/SpecialNovaInstance.php: SpecialNovaInstance: Remove some totally useless domain code. (T160995) (duration: 00m 43s) |
[production] |
| 14:58 |
<gehel> |
elasticsearch upgrade on eqiad is completed - T157479 |
[production] |
| 14:50 |
<moritzm> |
installing gnutls security updates on trusty (jessie already fixed) |
[production] |
| 14:44 |
<gehel> |
elasticsearch eqiad, full cluster restart after cleanup of known old indices - T157479 |
[production] |
| 14:39 |
<gehel> |
deleting old v2 indices from each elasticsearch server - T157479 |
[production] |
| 14:34 |
<gehel> |
deleting old v2 indices from elastic1030: azbwiki_general_first, vewikimedia_content_1415331110, vewikimedia_general_1415331150 - T157479 |
[production] |
| 14:07 |
<gehel> |
upgrading elasticsearch eqiad to v5.x - T157479 |
[production] |
| 14:01 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2044, depool db2037 T160415 - T73563 (duration: 00m 42s) |
[production] |
| 13:44 |
<dcausse> |
eu SWAT done |
[production] |
| 13:39 |
<dcausse@tin> |
Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] Enable completion suggester (duration: 00m 42s) |
[production] |
| 13:30 |
<dcausse@tin> |
Synchronized wmf-config/CirrusSearch-common.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (3/3) (duration: 00m 41s) |
[production] |
| 13:29 |
<gehel> |
rolling restart of wdqs to load new configuration options |
[production] |
| 13:29 |
<dcausse@tin> |
Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (2/3) (duration: 00m 43s) |
[production] |
| 13:27 |
<dcausse@tin> |
Synchronized wmf-config/CommonSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (1/3) (duration: 00m 42s) |
[production] |
| 13:15 |
<dcausse@tin> |
Synchronized wmf-config/InitialiseSettings.php: T157111 pagePreviews: Increase perf instrumentation sample (duration: 00m 58s) |
[production] |
| 13:14 |
<Reedy> |
Make that clear 2FA for RickinBaltimore per T160671 |
[production] |
| 13:12 |
<Reedy> |
Clear centralauth for RickinBaltimore per T160671 |
[production] |
| 12:54 |
<moritzm> |
installing r-base security updates |
[production] |
| 12:47 |
<gehel> |
running stress and bonnie on elastic2020 - T149006 |
[production] |
| 12:34 |
<Dereckson> |
Created OATHAuth tables on projectcomwiki (T143138) |
[production] |
| 12:27 |
<Dereckson> |
Create account Superzerocool on projectcomwiki (bureaucrat, T143138) |
[production] |
| 11:00 |
<ema> |
upgrading twisted to 16.2.0 on lvs1007-12 T160433 |
[production] |
| 10:33 |
<marostegui> |
Run pt-table-checksum on s6 (ruwiki) - https://phabricator.wikimedia.org/T160509 |
[production] |
| 09:42 |
<moritzm> |
installing libevent security updates on remaining hosts in eqiad |
[production] |
| 09:42 |
<marostegui> |
Stop MySQL db1070 to clone db1092 from it - T137191 |
[production] |
| 09:14 |
<akosiaris> |
enable bacula deamons on helium, everything looks ok |
[production] |
| 09:09 |
<moritzm> |
installing wireshark security updates |
[production] |
| 09:06 |
<hashar> |
CI deploying config hack "High priority test pipeline" : https://gerrit.wikimedia.org/r/343318 - T160667 |
[production] |
| 08:43 |
<gehel> |
shutting down elasticsearch on elastic2020, investigating T149006 |
[production] |
| 07:50 |
<gehel> |
banning elastic2020 from cluster to investigate T149006 |
[production] |
| 07:36 |
<marostegui> |
Stop mysql db1092 for maintenance - T137191 |
[production] |
| 07:35 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1092 - T137191 (duration: 00m 42s) |
[production] |
| 07:22 |
<marostegui> |
Run pt-table-checksum on s6 (jawiki) - T160509 |
[production] |
| 07:18 |
<marostegui> |
Deploy schema change on db2044 and labsdb1009 (s4) - https://phabricator.wikimedia.org/T160415 - https://phabricator.wikimedia.org/T73563 |
[production] |
| 07:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2044 - T160415 - T73563 (duration: 00m 41s) |
[production] |
| 06:49 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2051 - T160415 - T73563 (duration: 01m 07s) |
[production] |
| 06:01 |
<joal@tin> |
Finished deploy [analytics/refinery@c3a9139]: (no justification provided) (duration: 06m 39s) |
[production] |
| 05:55 |
<joal@tin> |
Started deploy [analytics/refinery@c3a9139]: (no justification provided) |
[production] |
| 03:38 |
<eileen> |
update civicrm from 21afe66b621d36e285fc5a041bd26e8083287a04 to 92e3b850d7dbe9719ab86ba2d1c2489c60c0dcc0 |
[production] |
| 03:10 |
<eileen> |
update civicrm from 0ed1659d679d015f3f5ff223bc0684de6f249bbf to 21afe66b621d36e285fc5a041bd26e8083287a04 |
[production] |
| 02:37 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Mar 21 02:37:33 UTC 2017 (duration 5m 22s) |
[production] |
| 02:32 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.16) (duration: 13m 22s) |
[production] |
| 01:59 |
<eileen> |
update civicrm from f454f16bc68a19578ddc270bac088546dd243a27 to 0ed1659d679d015f3f5ff223bc0684de6f249bbf |
[production] |
| 00:37 |
<Amir1> |
ladsgroup@terbium:/srv/mediawiki/php-1.29.0-wmf.16$ mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=etwiki is done now (T159609) |
[production] |