2251-2300 of 10000 results (41ms)
2017-03-07 ยง
22:01 <mobrovac@tin> Started deploy [zotero/translators@35da336]: Update transators for T158675 [production]
21:59 <mobrovac@tin> Finished deploy [trending-edits/deploy@f855460]: (no justification provided) (duration: 04m 48s) [production]
21:54 <mobrovac@tin> Started deploy [trending-edits/deploy@f855460]: (no justification provided) [production]
21:40 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.29.0-wmf.15 refs T158996 [production]
21:30 <twentyafterfour@tin> Finished scap: bump test wikis to 1.29.0-wmf.5 refs T158996 (duration: 53m 17s) [production]
21:23 <mutante> mw1177 - service hhvm restart [production]
20:37 <twentyafterfour@tin> Started scap: bump test wikis to 1.29.0-wmf.5 refs T158996 [production]
20:29 <mutante> iridium - re-enabling puppet, ssh-phab service converted to base::service_unit, upstart template moved but unchanged, service restarted just fine. [production]
20:27 <mutante> phab2001 - phab-ssh service converted to base::service_unit and with working systemd unit file. 'systemctl ssh-phab status' is active (running) (T158434) [production]
20:26 <ottomata> installing librdkafka 0.9.4 on cp1045 (cache misc host) via .deb package to try it with varnishkafka in prod (ping bblack, ema, just in case) [production]
20:23 <mutante> iridium - temp disabled puppet - converting phab-ssh service to base::service_unit, systemd on phab2001, upstart on iridium [production]
19:23 <twentyafterfour> branching 1.29.0-wmf15 refs T158996 [production]
19:20 <bblack> rebooting baham (ns1) AGAIN - low cpu frequencies issues like T147905 - checking bios/idrac stuff [production]
19:08 <bblack> rebooting baham (ns1) - low cpu frequencies issues like T147905 [production]
18:52 <volans> rmmod acpi_pad on baham, was using 100% CPU T137647 [production]
18:37 <mobrovac> restbase deploy start of cd53670b [production]
16:58 <akosiaris> re-increase temporarily the client-output-buffer-limit for rbd1007, phab task filling to follow [production]
16:40 <akosiaris> decrease client-output-buffer-limit soft-limit back to normal values [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1008.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1007.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1006.eqiad.wmnet [production]
16:22 <filippo@puppetmaster1001> conftool action : set/weight=40; selector: name=ms-fe1005.eqiad.wmnet [production]
15:28 <joal@tin> Finished deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) (duration: 06m 08s) [production]
15:22 <joal@tin> Started deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) [production]
15:15 <akosiaris> increase client-output-buffer-limit soft-limit to 500MB temporarily on rdb1007 [production]
14:46 <jynus> restart labsdb1004 for config and data check [production]
14:32 <moritzm> uploaded HHVM 3.18 builds of hhvm-tidy, hhvm-luasandbox and hhvm-wikidiff2 to the experimental section of apt.wikimedia.org (Bug: T158176) [production]
14:03 <reedy@tin> Synchronized docroot/: Fixup filebackend symlinks (duration: 00m 41s) [production]
13:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1060 weight - T158193 (duration: 00m 58s) [production]
12:53 <marostegui> Just for the sake of having it logged: gtid_domain_id has been deployed in all the database servers - T149418 [production]
12:53 <elukey> analytics1040 back in service - testing the new Debian configuration [production]
12:39 <marostegui> Deploy ALTER table on db2028 (codfw s6 master) on the revision table - T159414 [production]
12:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1060 with less weight - T158193 (duration: 00m 40s) [production]
12:19 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2053 - T159414 (duration: 00m 43s) [production]
12:03 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2034 - T132416 (duration: 00m 50s) [production]
11:41 <gehel> cleaning empty log file on elastic2001 (cronspam) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=citoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=graphoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mobileapps']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) [production]
11:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) [production]