|
2017-03-07
§
|
| 23:38 |
<mutante> |
gerrit restarting for config changes 341701, 341587 |
[production] |
| 22:45 |
<papaul> |
ms-be2028-ms-be2039 - signing puppet certs, salt-key, initial run |
[production] |
| 22:11 |
<mobrovac@tin> |
Finished deploy [citoid/deploy@5a7e053]: Deploy for T158675 T103478 T159486 (duration: 02m 36s) |
[production] |
| 22:08 |
<mobrovac@tin> |
Started deploy [citoid/deploy@5a7e053]: Deploy for T158675 T103478 T159486 |
[production] |
| 22:02 |
<mobrovac@tin> |
Finished deploy [zotero/translators@35da336]: Update transators for T158675 (duration: 00m 06s) |
[production] |
| 22:01 |
<mobrovac@tin> |
Started deploy [zotero/translators@35da336]: Update transators for T158675 |
[production] |
| 21:59 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@f855460]: (no justification provided) (duration: 04m 48s) |
[production] |
| 21:54 |
<mobrovac@tin> |
Started deploy [trending-edits/deploy@f855460]: (no justification provided) |
[production] |
| 21:40 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.29.0-wmf.15 refs T158996 |
[production] |
| 21:30 |
<twentyafterfour@tin> |
Finished scap: bump test wikis to 1.29.0-wmf.5 refs T158996 (duration: 53m 17s) |
[production] |
| 21:23 |
<mutante> |
mw1177 - service hhvm restart |
[production] |
| 20:37 |
<twentyafterfour@tin> |
Started scap: bump test wikis to 1.29.0-wmf.5 refs T158996 |
[production] |
| 20:29 |
<mutante> |
iridium - re-enabling puppet, ssh-phab service converted to base::service_unit, upstart template moved but unchanged, service restarted just fine. |
[production] |
| 20:27 |
<mutante> |
phab2001 - phab-ssh service converted to base::service_unit and with working systemd unit file. 'systemctl ssh-phab status' is active (running) (T158434) |
[production] |
| 20:26 |
<ottomata> |
installing librdkafka 0.9.4 on cp1045 (cache misc host) via .deb package to try it with varnishkafka in prod (ping bblack, ema, just in case) |
[production] |
| 20:23 |
<mutante> |
iridium - temp disabled puppet - converting phab-ssh service to base::service_unit, systemd on phab2001, upstart on iridium |
[production] |
| 19:23 |
<twentyafterfour> |
branching 1.29.0-wmf15 refs T158996 |
[production] |
| 19:20 |
<bblack> |
rebooting baham (ns1) AGAIN - low cpu frequencies issues like T147905 - checking bios/idrac stuff |
[production] |
| 19:08 |
<bblack> |
rebooting baham (ns1) - low cpu frequencies issues like T147905 |
[production] |
| 18:52 |
<volans> |
rmmod acpi_pad on baham, was using 100% CPU T137647 |
[production] |
| 18:37 |
<mobrovac> |
restbase deploy start of cd53670b |
[production] |
| 16:58 |
<akosiaris> |
re-increase temporarily the client-output-buffer-limit for rbd1007, phab task filling to follow |
[production] |
| 16:40 |
<akosiaris> |
decrease client-output-buffer-limit soft-limit back to normal values |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1008.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1007.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1006.eqiad.wmnet |
[production] |
| 16:22 |
<filippo@puppetmaster1001> |
conftool action : set/weight=40; selector: name=ms-fe1005.eqiad.wmnet |
[production] |
| 15:28 |
<joal@tin> |
Finished deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) (duration: 06m 08s) |
[production] |
| 15:22 |
<joal@tin> |
Started deploy [analytics/aqs/deploy@e0da1bd]: (no justification provided) |
[production] |
| 15:15 |
<akosiaris> |
increase client-output-buffer-limit soft-limit to 500MB temporarily on rdb1007 |
[production] |
| 14:46 |
<jynus> |
restart labsdb1004 for config and data check |
[production] |
| 14:32 |
<moritzm> |
uploaded HHVM 3.18 builds of hhvm-tidy, hhvm-luasandbox and hhvm-wikidiff2 to the experimental section of apt.wikimedia.org (Bug: T158176) |
[production] |
| 14:03 |
<reedy@tin> |
Synchronized docroot/: Fixup filebackend symlinks (duration: 00m 41s) |
[production] |
| 13:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1060 weight - T158193 (duration: 00m 58s) |
[production] |
| 12:53 |
<marostegui> |
Just for the sake of having it logged: gtid_domain_id has been deployed in all the database servers - T149418 |
[production] |
| 12:53 |
<elukey> |
analytics1040 back in service - testing the new Debian configuration |
[production] |
| 12:39 |
<marostegui> |
Deploy ALTER table on db2028 (codfw s6 master) on the revision table - T159414 |
[production] |
| 12:34 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1060 with less weight - T158193 (duration: 00m 40s) |
[production] |
| 12:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2053 - T159414 (duration: 00m 43s) |
[production] |
| 12:03 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2034 - T132416 (duration: 00m 50s) |
[production] |
| 11:41 |
<gehel> |
cleaning empty log file on elastic2001 (cronspam) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=trendingedits']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=pdfrender']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=eventstreams']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=ores']) |
[production] |
| 11:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=cxserver']) |
[production] |