|
2017-12-07
ยง
|
| 20:31 |
<elukey> |
restart hhvm on mw1281 - hhvm stuck (hhvm-dump-debug timing out) |
[production] |
| 20:22 |
<joal@tin> |
Finished deploy [analytics/refinery@53bd630]: Regular analytics deploy - Long time no see, deployment :) - post-patch-2 (hopefully last for tonight) (duration: 05m 21s) |
[production] |
| 20:18 |
<herron> |
re-pooling eqiad puppet 4 masters via dns puppet.eqiad.wmnet puppet.wikimedia.org |
[production] |
| 20:17 |
<joal@tin> |
Started deploy [analytics/refinery@53bd630]: Regular analytics deploy - Long time no see, deployment :) - post-patch-2 (hopefully last for tonight) |
[production] |
| 20:14 |
<joal@tin> |
Finished deploy [analytics/refinery@3e52903]: Regular analytics deploy - Long time no see, deployment :) - post-patch (duration: 01m 20s) |
[production] |
| 20:12 |
<joal@tin> |
Started deploy [analytics/refinery@3e52903]: Regular analytics deploy - Long time no see, deployment :) - post-patch |
[production] |
| 19:52 |
<joal@tin> |
Finished deploy [analytics/refinery@bd9c6cc]: Regualr analytics deploy - Long time no see, deployment :) (duration: 12m 15s) |
[production] |
| 19:40 |
<joal@tin> |
Started deploy [analytics/refinery@bd9c6cc]: Regualr analytics deploy - Long time no see, deployment :) |
[production] |
| 19:35 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:396090|Start description usage tracking for commonswiki]] T106287 (duration: 00m 48s) |
[production] |
| 19:29 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.11/includes/specialpage/ChangesListSpecialPage.php: SWAT: [[gerrit:396054|WLFilters: Correctly check if RCFilters should be enabled on WL]] T182318 (duration: 00m 48s) |
[production] |
| 19:24 |
<thcipriani@tin> |
Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:392449|Remove obsolete WikibaseQualityConstraints settings]] (duration: 00m 48s) |
[production] |
| 19:14 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@3c4f51d]: Long awaited deploy: generic optimizations, gc metric, delay reporting (duration: 01m 15s) |
[production] |
| 19:13 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@3c4f51d]: Long awaited deploy: generic optimizations, gc metric, delay reporting |
[production] |
| 19:12 |
<thcipriani@tin> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:395918|Rm all past throttle overrides in throttle.php]] (duration: 00m 48s) |
[production] |
| 18:06 |
<mholloway-shell@tin> |
Finished deploy [mobileapps/deploy@2fa32ed]: Update mobileapps to 71f581c (duration: 05m 36s) |
[production] |
| 18:00 |
<mholloway-shell@tin> |
Started deploy [mobileapps/deploy@2fa32ed]: Update mobileapps to 71f581c |
[production] |
| 18:00 |
<herron> |
re-pooling eqiad puppet 4 masters as puppet.ulsfo.wnet |
[production] |
| 17:33 |
<demon@tin> |
Synchronized php-1.31.0-wmf.11/extensions/VisualEditor/lib/ve: Ief480487, Deskana made me do it (duration: 00m 49s) |
[production] |
| 17:25 |
<milimetric@tin> |
Finished deploy [analytics/aqs/deploy@4ec13b4]: (no justification provided) (duration: 07m 28s) |
[production] |
| 17:25 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=mw1314.eqiad.wmnet |
[production] |
| 17:25 |
<herron> |
puppetmaster1001 upgraded to puppet 4. re-enabling puppet agents across the fleet |
[production] |
| 17:18 |
<milimetric@tin> |
Started deploy [analytics/aqs/deploy@4ec13b4]: (no justification provided) |
[production] |
| 17:13 |
<herron> |
upgrading puppetmaster1001 to puppet 4 |
[production] |
| 17:08 |
<herron> |
temporarily disabling all puppet agents during puppetmaster1001 (puppet ca) upgrade to puppet 4 |
[production] |
| 16:14 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight - T178359 (duration: 00m 48s) |
[production] |
| 16:13 |
<herron> |
upgrading puppetmaster1002 to puppet 4 |
[production] |
| 16:03 |
<moritzm> |
uploaded openssl 1.0.2n for jessie-wikimedia to apt.wikimedia.org |
[production] |
| 16:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1093 back as main traffic in s6 - T178359 (duration: 00m 48s) |
[production] |
| 15:44 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight - T178359 (duration: 00m 48s) |
[production] |
| 15:42 |
<elukey> |
hhvm-dump-debug for mw1314 saved to /tmp/hhvm.17991.bt. |
[production] |
| 15:30 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=mw1314.eqiad.wmnet |
[production] |
| 15:24 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight - T178359 (duration: 00m 48s) |
[production] |
| 15:19 |
<otto@tin> |
Finished deploy [analytics/superset/deploy@f0f5adf]: initial deployment (duration: 00m 02s) |
[production] |
| 15:18 |
<otto@tin> |
Started deploy [analytics/superset/deploy@f0f5adf]: initial deployment |
[production] |
| 14:55 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db1099:331 with low weight - T178359 (duration: 00m 47s) |
[production] |
| 14:29 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1074 (duration: 00m 47s) |
[production] |
| 14:09 |
<zeljkof> |
EU SWAT finished |
[production] |
| 14:08 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:395835|alswiki: Set wgRestrictDisplayTitle = false (T182154)]] (duration: 00m 49s) |
[production] |
| 13:39 |
<moritzm> |
reimaging mw2246 to stretch |
[production] |
| 12:54 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: mw2152.codfw.wmnet |
[production] |
| 12:32 |
<addshore@tin> |
Synchronized wmf-config/Wikibase.php: [[gerrit:395966|Move Wikibase dispatchingLockManager to InitialiseSettings]] PT 2/2 (duration: 00m 48s) |
[production] |
| 12:31 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:395966|Move Wikibase dispatchingLockManager to InitialiseSettings]] PT 1/2 (duration: 00m 48s) |
[production] |
| 11:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase API traffic for db1074 (duration: 00m 48s) |
[production] |
| 11:41 |
<moritzm> |
reimaging mw2152 to stretch |
[production] |
| 11:35 |
<marostegui> |
Compress s8 on db1099 - T178359 |
[production] |
| 11:21 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase API traffic for db1074 (duration: 00m 48s) |
[production] |
| 11:10 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@097ba7d]: Add CORS headers to erroneous responses as well - T182103 (duration: 05m 24s) |
[production] |
| 11:05 |
<mobrovac@tin> |
Started deploy [restbase/deploy@097ba7d]: Add CORS headers to erroneous responses as well - T182103 |
[production] |
| 10:57 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1074 with low weight (duration: 00m 48s) |
[production] |
| 10:50 |
<elukey> |
powercycle analytics1003 - no serial console, ssh stuck in System is booting up. See pam_nologin(8) |
[production] |