|
2017-03-07
ยง
|
| 19:23 |
<twentyafterfour> |
branching 1.29.0-wmf15 refs T158996 |
[production] |
| 19:20 |
<bblack> |
rebooting baham (ns1) AGAIN - low cpu frequencies issues like T147905 - checking bios/idrac stuff |
[production] |
| 19:08 |
<bblack> |
rebooting baham (ns1) - low cpu frequencies issues like T147905 |
[production] |
| 18:52 |
<volans> |
rmmod acpi_pad on baham, was using 100% CPU T137647 |
[production] |
| 18:37 |
<mobrovac> |
restbase deploy start of cd53670b |
[production] |
| 16:58 |
<akosiaris> |
re-increase temporarily the client-output-buffer-limit for rbd1007, phab task filling to follow |
[production] |
| 16:40 |
<akosiaris> |
decrease client-output-buffer-limit soft-limit back to normal values |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1008.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1007.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1006.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1005.eqiad.wmnet |
[production] |
| 15:28 |
<joal@tin> |
Finished deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) (duration: 06m 08s) |
[production] |
| 15:22 |
<joal@tin> |
Started deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) |
[production] |
| 15:15 |
<akosiaris> |
increase client-output-buffer-limit soft-limit to 500MB temporarily on rdb1007 |
[production] |
| 14:46 |
<jynus> |
restart labsdb1004 for config and data check |
[production] |
| 14:32 |
<moritzm> |
uploaded HHVM 3.18 builds of hhvm-tidy, hhvm-luasandbox and hhvm-wikidiff2 to the experimental section of apt.wikimedia.org (Bug: T158176) |
[production] |
| 14:03 |
<reedy@tin> |
Synchronized docroot/: Fixup filebackend symlinks (duration: 00m 41s) |
[production] |
| 13:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1060 weight - T158193 (duration: 00m 58s) |
[production] |
| 12:53 |
<marostegui> |
Just for the sake of having it logged: gtid_domain_id has been deployed in all the database servers - T149418 |
[production] |
| 12:53 |
<elukey> |
analytics1040 back in service - testing the new Debian configuration |
[production] |
| 12:39 |
<marostegui> |
Deploy ALTER table on db2028 (codfw s6 master) on the revision table - T159414 |
[production] |
| 12:34 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1060 with less weight - T158193 (duration: 00m 40s) |
[production] |
| 12:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2053 - T159414 (duration: 00m 43s) |
[production] |
| 12:03 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2034 - T132416 (duration: 00m 50s) |
[production] |
| 11:41 |
<gehel> |
cleaning empty log file on elastic2001 (cronspam) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=citoid']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=graphoid']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mobileapps']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) |
[production] |
| 11:32 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) |
[production] |
| 11:32 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=citoid']) |
[production] |
| 11:32 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=graphoid']) |
[production] |
| 11:32 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) |
[production] |
| 11:32 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mobileapps']) |
[production] |
| 11:27 |
<elukey> |
end of hacking on install1002 (puppet re-enabled) |
[production] |
| 09:23 |
<ema> |
cache_text, cache_upload: upgrading to varnish 4.1.5 T159424 |
[production] |
| 09:10 |
<elukey> |
temporary live hacking analytics-flex.cfg partman config on install1002 |
[production] |
| 08:25 |
<moritzm> |
installing systemd bugfix updates from jessie point release |
[production] |
| 07:39 |
<marostegui> |
Stop MySQL db1067 to clone db1060 from it - T158193 |
[production] |