3401-3450 of 10000 results (55ms)
2017-03-22 ยง
12:26 <marostegui> Deploy schema change on s4 to db1081 and labsdb1011 - T160415 T73563 [production]
12:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1084, depool db1081 T160415 - T73563 (duration: 00m 43s) [production]
12:20 <gehel> maps restarting kartotherian - T150354 [production]
12:18 <gehel> installing latest mapnik version on maps servers [production]
12:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1087 with low weight - T137191 (duration: 00m 43s) [production]
12:09 <gehel> maps upgrade to nodejs 6 completed - T150354 [production]
12:09 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps1004.eqiad.wmnet [production]
12:05 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps1004.eqiad.wmnet [production]
12:04 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps1003.eqiad.wmnet [production]
12:02 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps1003.eqiad.wmnet [production]
12:01 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps1002.eqiad.wmnet [production]
11:58 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps1002.eqiad.wmnet [production]
11:57 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps1001.eqiad.wmnet [production]
11:54 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps1001.eqiad.wmnet [production]
11:53 <gehel> maps codfw fully upgraded to nodejs 6, starting upgrade on maps eqiad - T150354 [production]
11:51 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2003.codfw.wmnet [production]
11:51 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2004.codfw.wmnet [production]
11:46 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2004.codfw.wmnet [production]
11:41 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2002.codfw.wmnet [production]
11:34 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2002.codfw.wmnet [production]
11:33 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2001.codfw.wmnet [production]
11:27 <gehel> maps2001.codfw.wmnet upgraded to nodejs6 [production]
11:19 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2001.codfw.wmnet [production]
11:15 <akosiaris> Enable IGMP snooping for private1-d-eqiad on asw2-d. T133387 [production]
11:15 <akosiaris> Enable IGMP snooping for private1-d-eqiad. T133387 [production]
11:05 <gehel> disabling puppet on all maps servers - T150354 [production]
11:04 <gehel> upgrade maps to nodejs 6 - T150354 [production]
10:53 <akosiaris> cr1-eqiad: set ae4 and members to enable again. T133387 [production]
10:41 <akosiaris> reoot asw2-d T133387 [production]
10:31 <dcausse> cirrus: rebuilding comp suggest indices in elastic@eqiad [production]
10:15 <akosiaris> Upgrading asw2-d-eqiad to JunOS 14.1X53 (T133387) [production]
10:09 <akosiaris> cr1-eqiad: set ae4 and members to disable. T133387 [production]
09:55 <moritzm> upgrading mw1261 to HHVM 3.18.1 [production]
09:50 <moritzm> upgrading mwdebug* to HHVM 3.18.1 [production]
09:40 <marostegui> Deploy alter table s4 (commonswiki) db1084 - T73563 T160415 [production]
09:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1084 T160415 - T73563 (duration: 00m 43s) [production]
09:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1091 T160415 - T73563 (duration: 00m 43s) [production]
09:20 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=prometheus2002.codfw.wmnet [production]
08:46 <marostegui> Stop MySQL db1070 to clone db1087 from it - T137191 [production]
07:53 <dcausse> rebuilding ttmserver index in elastic@eqiad to catchup lost writes during es5 upgrade [production]
07:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1091 T160415 - T73563 (duration: 00m 43s) [production]
07:10 <oblivian@puppetmaster1001> conftool action : set/ttl=300; selector: dnsdisc=.* [production]
07:05 <marostegui> Stop MySQL db1087 - T137191 [production]
06:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1087 - T137191 (duration: 00m 43s) [production]
06:43 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2037 T160415 - T73563 (duration: 00m 43s) [production]
06:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1092 weight - T137191 (duration: 00m 49s) [production]
05:44 <_joe_> finished tests on citoid/dns discovery; restbase successfully detects the change [production]
05:18 <_joe_> depooling temporarily citoid in eqiad from dns discovery [production]
02:40 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Mar 22 02:40:42 UTC 2017 (duration 5m 29s) [production]
02:35 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.16) (duration: 13m 20s) [production]