701-750 of 10000 results (40ms)
2017-10-04 ยง
14:57 <ema> cp4025: restart varnish backend [production]
14:47 <XioNoX> replacing faulty VC cable on fasw-c-eqiad [production]
14:45 <bblack> base package upgrades (+autoremove) on lvs3001-2 [production]
14:43 <bblack> base package upgrades (+autoremove) on lvs3004 [production]
14:41 <bblack> base package upgrades (+autoremove) on lvs3003 [production]
14:24 <bblack> upgrading nginx to 1.13.5-1+wmf1~jessie1 on cp4021 (first live cache, upload@ulsfo) [production]
14:18 <bblack> base package upgrades (+autoremove) on lvs2* [production]
14:10 <bblack> base package upgrades (+autoremove) on lvs4* [production]
13:47 <zeljkof> EU SWAT finished [production]
13:46 <zfilipin@tin> Synchronized php-1.31.0-wmf.2/extensions/Translate/tag/PageTranslationHooks.php: SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 50s) [production]
13:45 <zfilipin@tin> Synchronized php-1.31.0-wmf.2/extensions/Translate/TranslateHooks.php: SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 50s) [production]
13:41 <zfilipin@tin> Synchronized php-1.31.0-wmf.2/extensions/Translate/TranslateHooks.php: php-1.31.0-wmf.2/extensions/Translate/tag/PageTranslationHooks.php SWAT: [[gerrit:382095|Revert "Use Language type hint in hooks" (T177352)]] (duration: 00m 52s) [production]
13:26 <zeljkof> one more commit for EU SWAT [production]
13:26 <marostegui> Optimize table ores_classification on enwiki codfw master db2048 with replication - might generate lag - T159753 [production]
13:22 <marostegui> Optimize enwiki.ores_classification on db2069 [production]
13:06 <zeljkof> EU SWAT finished [production]
13:05 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:382116|New throttle rule (T177370)]] (duration: 00m 53s) [production]
12:59 <jynus> upgrade and reboot labsdb1009 [production]
12:56 <marostegui> Optimize templatelinks and pagelinks tables on s2 and s7 - labsdb1010 - T174509 [production]
12:38 <moritzm> upgrading app servers in codfw to HHVM 3.18.5 [production]
12:21 <moritzm> upgrading image scalers mw1293-mw1295 to HHVM 3.18.5 [production]
12:12 <moritzm> upgrading HHVM on deployment servers to 3.18.5 [production]
12:10 <elukey> added two new mediawiki videoscalers - mw1307/1318 [production]
12:09 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1318.eqiad.wmnet [production]
12:09 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1307.eqiad.wmnet [production]
12:00 <gehel> mediawiki now uses the LVS endpoint for logstash - T175242 [production]
11:49 <moritzm> upgrading job runners mw1161-mw1167 to HHVM 3.18.5 [production]
11:34 <moritzm> installing ghostscript security updates [production]
11:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1087 original weight (duration: 00m 47s) [production]
10:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1087 weight (duration: 00m 51s) [production]
10:29 <jynus> upgrade and reboot labsdb1011 [production]
10:22 <jynus> draining labsdb1011 connections [production]
10:18 <akosiaris> T177374, fully depool wtp1001-wtp1024 [production]
10:18 <akosiaris@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=wtp10([01][0-9]|2[0-4]).eqiad.wmnet [production]
10:03 <moritzm> install libidn security updates [production]
10:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1087 with low weight (duration: 00m 50s) [production]
09:54 <_joe_> restarting hhvm on canaries (both appservers and canaries) T107128 [production]
09:47 <moritzm> upgrading API app servers mw1189-mw1208 to HHVM 3.18.5 [production]
09:45 <elukey> rolling restart of aqs nodes to pick up the new logstash lvs config [production]
09:39 <hoo> Killed remaining dumpRdf runners on snapshot1007 after two crashed due to the db1087 depool. Auto-restart will do the rest. [production]
09:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db1104 to the config - T172679 (duration: 00m 50s) [production]
09:32 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add db1104 to the config - T172679 (duration: 00m 51s) [production]
09:25 <moritzm> installing ocaml security updates on trusty [production]
09:16 <marostegui> Reboot db1087 to pick up new kernel [production]
09:09 <_joe_> restarting hhvm on mwdebug*, T107128 [production]
09:07 <marostegui> Optimize templatelinks and pagelinks tables on db1097 (s4) - T174509 [production]
09:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1097 - T174509 (duration: 00m 50s) [production]
08:41 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: name=wtp10([01][0-9]|2[0-4]).eqiad.wmnet [production]
08:40 <mobrovac@tin> Finished deploy [restbase/deploy@8eb758a]: Switch the mobile feeds to the new storage schema and Cassandra 3 (duration: 10m 05s) [production]
08:36 <moritzm> upgrading app servers mw1180-mw1188, mw1209-mw1220 to HHVM 3.18.5 [production]