4001-4050 of 10000 results (49ms)
2017-03-21 ยง
17:53 <dcausse@tin> Synchronized wmf-config/CommonSettings.php: [es5 upgrade] step 4: repool eqiad for writes (1/3) (duration: 00m 42s) [production]
17:45 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1092 weight - T137191 (duration: 00m 42s) [production]
17:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1092 weight - T137191 (duration: 00m 45s) [production]
17:13 <thcipriani> starting branch cut for 1.29.0-wmf.17 [production]
17:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1092 with low weight - T137191 (duration: 00m 42s) [production]
17:02 <urandom> T111113: Rolling restart of RESTBase, eqiad, complete [production]
16:52 <urandom> T111113: Rolling restart of RESTBase, eqiad [production]
16:41 <urandom> T111113: Rolling restart of RESTBase, codfw, complete [production]
16:17 <urandom> T111113: Enabling RESTBase client encryption on (remaining) codfw nodes [production]
16:11 <urandom> T111113: Enabling RESTBase client encryption on restbase2001.codfw.wmnet (canary) [production]
15:56 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2020.codfw.wmnet [production]
15:27 <moritzm> removed "Directory Managers" group from LDAP (Bug T157131) [production]
15:00 <bd808@tin> Synchronized php-1.29.0-wmf.16/extensions/OpenStackManager/special/SpecialNovaInstance.php: SpecialNovaInstance: Remove some totally useless domain code. (T160995) (duration: 00m 43s) [production]
14:58 <gehel> elasticsearch upgrade on eqiad is completed - T157479 [production]
14:50 <moritzm> installing gnutls security updates on trusty (jessie already fixed) [production]
14:44 <gehel> elasticsearch eqiad, full cluster restart after cleanup of known old indices - T157479 [production]
14:39 <gehel> deleting old v2 indices from each elasticsearch server - T157479 [production]
14:34 <gehel> deleting old v2 indices from elastic1030: azbwiki_general_first, vewikimedia_content_1415331110, vewikimedia_general_1415331150 - T157479 [production]
14:07 <gehel> upgrading elasticsearch eqiad to v5.x - T157479 [production]
14:01 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2044, depool db2037 T160415 - T73563 (duration: 00m 42s) [production]
13:44 <dcausse> eu SWAT done [production]
13:39 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] Enable completion suggester (duration: 00m 42s) [production]
13:30 <dcausse@tin> Synchronized wmf-config/CirrusSearch-common.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (3/3) (duration: 00m 41s) [production]
13:29 <gehel> rolling restart of wdqs to load new configuration options [production]
13:29 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (2/3) (duration: 00m 43s) [production]
13:27 <dcausse@tin> Synchronized wmf-config/CommonSettings.php: [es5 upgrade] step 3: depool eqiad for writes (take 2) (1/3) (duration: 00m 42s) [production]
13:15 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T157111 pagePreviews: Increase perf instrumentation sample (duration: 00m 58s) [production]
13:14 <Reedy> Make that clear 2FA for RickinBaltimore per T160671 [production]
13:12 <Reedy> Clear centralauth for RickinBaltimore per T160671 [production]
12:54 <moritzm> installing r-base security updates [production]
12:47 <gehel> running stress and bonnie on elastic2020 - T149006 [production]
12:34 <Dereckson> Created OATHAuth tables on projectcomwiki (T143138) [production]
12:27 <Dereckson> Create account Superzerocool on projectcomwiki (bureaucrat, T143138) [production]
11:00 <ema> upgrading twisted to 16.2.0 on lvs1007-12 T160433 [production]
10:33 <marostegui> Run pt-table-checksum on s6 (ruwiki) - https://phabricator.wikimedia.org/T160509 [production]
09:42 <moritzm> installing libevent security updates on remaining hosts in eqiad [production]
09:42 <marostegui> Stop MySQL db1070 to clone db1092 from it - T137191 [production]
09:14 <akosiaris> enable bacula deamons on helium, everything looks ok [production]
09:09 <moritzm> installing wireshark security updates [production]
09:06 <hashar> CI deploying config hack "High priority test pipeline" : https://gerrit.wikimedia.org/r/343318 - T160667 [production]
08:43 <gehel> shutting down elasticsearch on elastic2020, investigating T149006 [production]
07:50 <gehel> banning elastic2020 from cluster to investigate T149006 [production]
07:36 <marostegui> Stop mysql db1092 for maintenance - T137191 [production]
07:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T137191 (duration: 00m 42s) [production]
07:22 <marostegui> Run pt-table-checksum on s6 (jawiki) - T160509 [production]
07:18 <marostegui> Deploy schema change on db2044 and labsdb1009 (s4) - https://phabricator.wikimedia.org/T160415 - https://phabricator.wikimedia.org/T73563 [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2044 - T160415 - T73563 (duration: 00m 41s) [production]
06:49 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2051 - T160415 - T73563 (duration: 01m 07s) [production]
06:01 <joal@tin> Finished deploy [analytics/refinery@c3a9139]: (no justification provided) (duration: 06m 39s) [production]
05:55 <joal@tin> Started deploy [analytics/refinery@c3a9139]: (no justification provided) [production]