1501-1550 of 10000 results (60ms)
2018-08-23 ยง
17:01 <XioNoX> powering off cr1-eqdfw - T196941 [production]
16:49 <filippo@neodymium> conftool action : set/pooled=yes; selector: name=restbase2003.codfw.wmnet [production]
16:22 <godog> depool and cassandra-drain restbase2003, then reboot [production]
16:20 <filippo@neodymium> conftool action : set/pooled=no; selector: name=restbase2003.codfw.wmnet [production]
16:17 <XioNoX> deactivating IX/Transit links on cr1-eqdfw - T196941 [production]
16:15 <godog> upgrade hp raid firmware on restbase2003 - T201804 T141756 [production]
15:15 <marostegui> Deploy schema change on db1090:3312 [production]
15:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 54s) [production]
15:14 <jynus> upgrading db2089 [production]
15:08 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 (duration: 00m 55s) [production]
15:02 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113 (duration: 00m 54s) [production]
14:47 <jynus> upgrading db1113 [production]
14:37 <otto@deploy1001> Finished deploy [analytics/turnilo/deploy@50a8845]: Deploying 1.7.2 to analytics-tool1002 with dep fixes (duration: 00m 08s) [production]
14:37 <otto@deploy1001> Started deploy [analytics/turnilo/deploy@50a8845]: Deploying 1.7.2 to analytics-tool1002 with dep fixes [production]
14:36 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1113 (duration: 00m 57s) [production]
14:26 <otto@deploy1001> Finished deploy [analytics/turnilo/deploy@240b357]: Deploying 1.7.2 to analytics-tool1002 (duration: 05m 07s) [production]
14:21 <otto@deploy1001> Started deploy [analytics/turnilo/deploy@240b357]: Deploying 1.7.2 to analytics-tool1002 [production]
13:39 <jynus> upgrading dbstore1001 [production]
13:38 <marostegui> Deploy schema change on db1103:3312 [production]
13:37 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 (duration: 00m 54s) [production]
13:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 (duration: 00m 54s) [production]
13:29 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T198396 Revert "Limit page creation and edit rate on Wikidata" [[gerrit:454785]] (duration: 00m 56s) [production]
13:06 <jynus> upgrading dbstore200[12], will take a while due to ongoing alter tables [production]
12:34 <moritzm> install Java updates on Hadoop nodes [production]
12:06 <moritzm> created new archiva-deployers LDAP group (T200454) [production]
12:00 <marostegui> Deploy schema change on db1105:3312 [production]
12:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 (duration: 00m 55s) [production]
11:56 <addshore> SWAT done [production]
11:50 <addshore@deploy1001> Synchronized wmf-config: T199800 [[gerrit:Cleanup wikdiff2 mobile moved paragraph config]] (duration: 00m 55s) [production]
11:40 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202555 [[gerrit:454590|Require autoconfirmed status to edit the 828 namespace at es.wikibooks]] (duration: 00m 56s) [production]
11:35 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202065 [[gerrit:454330|Switch 'wikidata-staff' add/remove 'interface-admin' for own account]] (duration: 00m 55s) [production]
11:19 <moritzm> installing shared-mime-info updates from stretch 9.5 point release [production]
11:18 <addshore@deploy1001> Synchronized wmf-config/CommonSettings.php: T199800 [[gerrit:454026|Enable moved paragrah detection everywhere]] (duration: 00m 55s) [production]
11:01 <marostegui> Deploy schema change on dbstore1002:s2 [production]
11:00 <gehel> new SSL certs / tlsproxy deployed on elastic nodes - T198351 [production]
10:56 <marostegui> Deploy schema change on s2 codfw masters (db2035) with replication - this will generate lag on s2 codfw [production]
10:35 <moritzm> installing openldap updates from stretch 9.5 point release [production]
10:27 <akosiaris> reboot analytics-tool* hosts for the IP renumbering change T202559 [production]
10:27 <akosiaris> purge rec dns caches for analytics-tool* hosts T202559 [production]
10:15 <elukey> restart druid-broker on druid100[4-5] due to unresponsiveness (still unclear why) [production]
10:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 (duration: 00m 54s) [production]
09:59 <marostegui> Deploy schema change on s6 primary master (db1061) [production]
09:50 <moritzm> installing debdeploy update [production]
09:40 <moritzm> restarting etherpad-lite for nodejs security update [production]
09:29 <moritzm> installing nodejs security updates on wtp* (Parsoid servers) [production]
09:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 00m 55s) [production]
09:23 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1093 (duration: 00m 56s) [production]
09:17 <gehel> starting to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/444610 as part of T198351, including regeneration of SSL certs. Disabling puppet on elastic* during the operation [production]
08:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 55s) [production]
08:45 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085 (duration: 00m 55s) [production]