4151-4200 of 10000 results (59ms)
2017-03-07 ยง
18:52 <volans> rmmod acpi_pad on baham, was using 100% CPU T137647 [production]
18:37 <mobrovac> restbase deploy start of cd53670b [production]
16:58 <akosiaris> re-increase temporarily the client-output-buffer-limit for rbd1007, phab task filling to follow [production]
16:40 <akosiaris> decrease client-output-buffer-limit soft-limit back to normal values [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1008.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1007.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1006.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1005.eqiad.wmnet [production]
15:28 <joal@tin> Finished deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) (duration: 06m 08s) [production]
15:22 <joal@tin> Started deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) [production]
15:15 <akosiaris> increase client-output-buffer-limit soft-limit to 500MB temporarily on rdb1007 [production]
14:46 <jynus> restart labsdb1004 for config and data check [production]
14:32 <moritzm> uploaded HHVM 3.18 builds of hhvm-tidy, hhvm-luasandbox and hhvm-wikidiff2 to the experimental section of apt.wikimedia.org (Bug: T158176) [production]
14:03 <reedy@tin> Synchronized docroot/: Fixup filebackend symlinks (duration: 00m 41s) [production]
13:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1060 weight - T158193 (duration: 00m 58s) [production]
12:53 <marostegui> Just for the sake of having it logged: gtid_domain_id has been deployed in all the database servers - T149418 [production]
12:53 <elukey> analytics1040 back in service - testing the new Debian configuration [production]
12:39 <marostegui> Deploy ALTER table on db2028 (codfw s6 master) on the revision table - T159414 [production]
12:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1060 with less weight - T158193 (duration: 00m 40s) [production]
12:19 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2053 - T159414 (duration: 00m 43s) [production]
12:03 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2034 - T132416 (duration: 00m 50s) [production]
11:41 <gehel> cleaning empty log file on elastic2001 (cronspam) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=citoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=graphoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mobileapps']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) [production]
11:32 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) [production]
11:32 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=citoid']) [production]
11:32 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=graphoid']) [production]
11:32 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) [production]
11:32 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mobileapps']) [production]
11:27 <elukey> end of hacking on install1002 (puppet re-enabled) [production]
09:23 <ema> cache_text, cache_upload: upgrading to varnish 4.1.5 T159424 [production]
09:10 <elukey> temporary live hacking analytics-flex.cfg partman config on install1002 [production]
08:25 <moritzm> installing systemd bugfix updates from jessie point release [production]
07:39 <marostegui> Stop MySQL db1067 to clone db1060 from it - T158193 [production]
07:16 <marostegui> Deploy ALTER table on db2053 (s6) for the revision table - T159414 [production]
07:16 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2053 - T159414 (duration: 00m 41s) [production]
05:22 <Krinkle> foreachwikiindblist 'all - closed - private' deleteEqualMessages.php (T45917) - purge upstreamed translations from remaining wikis [production]