1451-1500 of 10000 results (25ms)
2017-10-23 ยง
22:59 <bblack> cp4024: varnish-backend-restart for lag [production]
21:40 <XioNoX> increasing MTU on Zayo transit interfaces [production]
20:33 <arlolra> Updated Parsoid to 1cefef12 (T178217) [production]
20:25 <arlolra@tin> Finished deploy [parsoid/deploy@0759bd1]: Updating Parsoid to 1cefef12 (duration: 11m 14s) [production]
20:14 <arlolra@tin> Started deploy [parsoid/deploy@0759bd1]: Updating Parsoid to 1cefef12 [production]
19:37 <bsitzmann@tin> Finished deploy [mobileapps/deploy@a654ce1]: Update mobileapps to 3628105 (T178828) (duration: 06m 59s) [production]
19:30 <bsitzmann@tin> Started deploy [mobileapps/deploy@a654ce1]: Update mobileapps to 3628105 (T178828) [production]
19:00 <joal@tin> Finished deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests - Redeploy after config fix (duration: 02m 34s) [production]
18:58 <joal@tin> Started deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests - Redeploy after config fix [production]
18:58 <joal@tin> Finished deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests - Redeploy after config fix (duration: 05m 07s) [production]
18:52 <joal@tin> Started deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests - Redeploy after config fix [production]
18:52 <joal@tin> Finished deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests (duration: 321m 51s) [production]
17:56 <gehel@tin> Finished deploy [wdqs/wdqs@b84592f]: WDQS GUI update (duration: 01m 58s) [production]
17:54 <gehel@tin> Started deploy [wdqs/wdqs@b84592f]: WDQS GUI update [production]
17:48 <XenoRyet> updated smashpig from d056a131ccbbd4b505da4f99e04f5337fdd9c32e to 5262d532e30aef76a72fd9b8ff248e9a9570f8f7 [production]
17:32 <demon@tin> Synchronized scap/plugins/prep.py: Fixes and improvements of various sorts (duration: 00m 45s) [production]
17:26 <gehel@tin> Finished deploy [wdqs/wdqs@4626acb]: deploying latest WDQS version, blazegraph + GUI updates (duration: 02m 07s) [production]
17:24 <gehel@tin> Started deploy [wdqs/wdqs@4626acb]: deploying latest WDQS version, blazegraph + GUI updates [production]
16:53 <demon@tin> Pruned MediaWiki: 1.30.0-wmf.19 (duration: 03m 09s) [production]
15:59 <elukey> forced BBU learn cycle on db1046 - T166141 [production]
14:59 <herron> wiped resolver cache of records puppet.cofdw.wmnet and puppet.ulsfo.wmnet (T177254) [production]
14:46 <herron> depooling codfw puppetmaster (via dns) [production]
14:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1078 - T164488 (duration: 00m 46s) [production]
14:05 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2037 - T178359 (duration: 00m 46s) [production]
13:48 <marostegui> Stop mysql and poweroff db1082 for HW maintenance - T178460 [production]
13:30 <joal@tin> Started deploy [analytics/aqs/deploy@ad22e0c]: Upgrade AQS node modules to restbase-latests [production]
13:19 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Add aleph500.biblacad.ro to $wgCopyUploadsDomains - T178753 (duration: 00m 47s) [production]
13:19 <gehel> rolling restart of wdqs for GC tuning - T175919 [production]
13:18 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Remove hooserv.net from wgCopyUploadsDomains (duration: 00m 47s) [production]
13:08 <zeljkof> EU SWAT finished, no deploys [production]
13:00 <bblack@neodymium> conftool action : set/pooled=no; selector: dc=ulsfo,cluster=cache_text,name=cp4018.ulsfo.wmnet [production]
12:59 <bblack@neodymium> conftool action : set/pooled=yes; selector: dc=ulsfo,cluster=cache_text,name=cp4032.ulsfo.wmnet [production]
12:53 <bblack@neodymium> conftool action : set/pooled=no; selector: dc=ulsfo,cluster=cache_text,name=cp4017.ulsfo.wmnet [production]
12:47 <bblack@neodymium> conftool action : set/pooled=yes; selector: dc=ulsfo,cluster=cache_text,name=cp4031.ulsfo.wmnet [production]
12:46 <moritzm> upgrading hhvm-wikdiff2 on remaining job runners in codfw [production]
12:39 <moritzm> upgrading hhvm-wikdiff2 on remaining video scalers in codfw [production]
12:32 <bblack@neodymium> conftool action : set/pooled=no; selector: dc=ulsfo,cluster=cache_text,name=cp4010.ulsfo.wmnet [production]
12:29 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Remove hooserv.net from wgCopyUploadsDomains (duration: 00m 46s) [production]
12:26 <moritzm> upgrading hhvm-wikdiff2 on mw2153-mw2162 (job runners) [production]
12:21 <moritzm> upgrading hhvm-wikdiff2 on mw2254-mw2258 (app servers) [production]
12:20 <bblack@neodymium> conftool action : set/pooled=yes; selector: dc=ulsfo,cluster=cache_text,name=cp4030.ulsfo.wmnet [production]
12:15 <bblack@neodymium> conftool action : set/pooled=no; selector: dc=ulsfo,cluster=cache_text,name=cp4009.ulsfo.wmnet [production]
12:12 <bblack@neodymium> conftool action : set/pooled=yes; selector: dc=ulsfo,cluster=cache_text,name=cp4029.ulsfo.wmnet [production]
12:03 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on further wikis (T178515) (duration: 00m 47s) [production]
11:11 <moritzm> upgrading hhvm-wikdiff2 on mw2097-mw2114 [production]
11:10 <marostegui> Compress innodb on db2038 and db2084 - T178359 [production]
10:56 <moritzm> upgrading hhvm-wikdiff2 on remaining API servers in codfw [production]
10:46 <moritzm> upgrading hhvm-wikdiff2 on mw1161-mw1167 (job runners) [production]
10:28 <moritzm> upgrading hhvm-wikdiff2 on mw1180-mw1188 (app servers) [production]
10:28 <marostegui> Remove /srv from db1015 as it has been stopped for weeks now and will be decommissioned (and it is alerting low on disk space) - T173570 [production]