5751-5800 of 10000 results (73ms)
2017-07-11 ยง
18:47 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2154.codfw.wmnet [production]
18:43 <thcipriani@tin> Pruned MediaWiki: 1.30.0-wmf.6 [keeping static files] (duration: 06m 28s) [production]
18:28 <dcausse> T169498: elastic@eqiad huge but short load spike on 24+ nodes (despite the workaround on token_count_router deployed) [production]
18:27 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2154.codfw.wmnet [production]
18:25 <mutante> mw2154 - depool for attempting IPMI fix [production]
18:17 <mutante> ms2202 - repooled [production]
18:09 <mutante> mw2201 - repooled [production]
17:20 <mutante> mw2201, mw2202 - depool appservers for T169360 (drain flea power) [production]
17:19 <thcipriani> starting branch cut for 1.30.0-wmf.9 T167893 [production]
16:32 <bblack> restarting varnish backend on cp1074 (mailbox lag) [production]
16:16 <tzatziki> Removed 2FA for Arsog1985 SUL account (T168779) [production]
15:56 <dcausse> restarting elastic on relforge100*.eqiad.wmnet to pickup a new version of the ltr plugin [production]
15:36 <moritzm> rolling restart of thumbor to pick up tiff and expat security updates [production]
15:29 <marostegui> Stop replication labsdb1010 for maintenance - T153743 [production]
15:25 <marostegui> Stop replication labsdb1009 for maintenance - T153743 [production]
15:24 <elukey> restart burrow on krypton [production]
15:21 <moritzm> rebooting uranium for kernel update [production]
14:31 <marostegui> Deploy alter table on db1064 - commonswiki and let it replicate to db1095 and labsdb1009, 1010 and 1011 - T168661 [production]
14:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1064 - T168661 (duration: 00m 43s) [production]
14:26 <moritzm> installing apache security updates on mw2* [production]
14:24 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw2118.codfw.wmnet [production]
14:21 <jynus> rebooting labsdb1004 for kernel upgrade T168584 [production]
14:16 <jynus> upgradem wmf-mariadb10 on labsdb1004 [production]
14:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1079 original weight (duration: 00m 42s) [production]
14:13 <madhuvishy> Disable event handler icinga checks for labsdb1004 [production]
14:10 <madhuvishy> disabled icinga notifications for host and services for labsdb1004 [production]
13:44 <dereckson@tin> Synchronized php-1.30.0-wmf.7/extensions/EventLogging/modules/ext.eventLogging.subscriber.js: Don't subscribe EventLogging twice if window.onload fires twice (T170018) (duration: 00m 42s) [production]
13:35 <Dereckson> Purged https://en.wikipedia org/static/images/project-logos/eswikibooks.png [production]
13:29 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: High density logos for es.wikibooks (T170248, 2/2) (duration: 00m 42s) [production]
13:26 <dereckson@tin> Synchronized static/images/project-logos/: High density logos for es.wikibooks (T170248, 1/2) (duration: 00m 43s) [production]
10:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 with 0 weight - T166204 (duration: 00m 41s) [production]
10:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1079 weight (duration: 00m 42s) [production]
10:37 <akosiaris> enable puppet everywhere but on einsteinium (icinga host) for merge of https://gerrit.wikimedia.org/r/#/c/363295/5 [production]
10:36 <XioNoX> bump BFD timer from 300 to 600 on the eqiad-codfw link for T170131 [production]
10:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1081 - T168661 (duration: 00m 42s) [production]
10:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1079 weight (duration: 00m 42s) [production]
10:11 <marostegui> Drop table localisation_file_hash from commonswiki - T119811 [production]
10:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1079 weight (duration: 00m 42s) [production]
09:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1079 with low weight - T153743 (duration: 00m 42s) [production]
09:41 <moritzm> installing tiff security updates [production]
09:40 <marostegui> Stop slave s6 on db1102 for exporting its content - T153743 [production]
09:12 <moritzm> reboot sarin for kernel update [production]
08:50 <marostegui> Deploy alter table on s4 - db1081 - T168661 [production]
08:49 <moritzm> rebooting mw1169 for kernel update [production]
08:47 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1081 - T168661 (duration: 00m 42s) [production]
08:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1084 - T168661 (duration: 00m 42s) [production]
08:25 <akosiaris> disable puppet everywhere but on einsteinium (icinga host) for merge of https://gerrit.wikimedia.org/r/#/c/363295/5 [production]
08:24 <akosiaris> disable puppet on einsteinium (icinga host) for merge of https://gerrit.wikimedia.org/r/#/c/363295/5 [production]
08:17 <marostegui> Drop localisation_file_hash table from dewiki (s5) - T119811 [production]
07:57 <marostegui> Drop localisation_file_hash table from frwiki and jawiki (s6) - T119811 [production]