|
2016-01-20
ยง
|
| 19:13 |
<marxarelli> |
including labswiki and labtestwiki in group1 promotion after all |
[production] |
| 19:09 |
<marxarelli> |
starting promotion of group1, but holding back labswiki and labtestwiki until Jan 21 'all' promotion |
[production] |
| 18:56 |
<hasharAway> |
beta cluster code has been stalled for roughly 2h30 |
[releng] |
| 18:55 |
<hasharAway> |
disconnecting Gearman plugin to remove deadlock for beta cluster rjobs |
[releng] |
| 18:54 |
<paravoid> |
manually triggering an ubuntu mirror update ("sudo -u mirror /usr/local/sbin/update-ubuntu-mirror" on carbon) |
[production] |
| 18:41 |
<jynus> |
schema change on wikidatawiki (wb_terms) finished- slaves already catching up |
[production] |
| 18:34 |
<mutante> |
restart hhvm on mw1206 |
[production] |
| 18:32 |
<godog> |
bounce stuck hhvm on mw1205 |
[production] |
| 18:30 |
<mforns> |
deployed EL in production with removal of queue |
[analytics] |
| 18:06 |
<paravoid> |
turning up BGP with Zayo in codfw |
[production] |
| 17:48 |
<jynus> |
restarting replication on db1026 after schema change |
[production] |
| 17:37 |
<mforns> |
restarted EventLogging because of Kafka consumption lag |
[analytics] |
| 17:09 |
<gwicke> |
restbase cassandra: set DTCS max_window_size_seconds to 70736000, large enough to accommodate a two-year window |
[production] |
| 17:06 |
<hashar> |
clearing files from beta-cluster to prepare for Swift migration. python pwb.py delete.py -family:betacommons -lang:en -cat:'GWToolset Batch Upload' -verbose -putthrottle:0 -summary:'Clearing out old batched upload to save up disk space for Swift migration' |
[releng] |
| 16:56 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Set default graph vega version back to 1 [[gerrit:265289]] (duration: 00m 32s) |
[production] |
| 16:46 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Add davidabian.com to wgCopyUploadsDomains [[gerrit:265286]] (duration: 00m 32s) |
[production] |
| 16:42 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/CommonSettings.php: SWAT: Change default graph version param. Part II [[gerrit:265282]] (duration: 00m 32s) |
[production] |
| 16:42 |
<wikibugs> |
Updated channels.yaml to: af30a77133e5b45db928e8f4850dd73a71169b16 add traffic channel |
[tools.wikibugs] |
| 16:42 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Change default graph version param. Part I [[gerrit:265282]] (duration: 00m 36s) |
[production] |
| 16:33 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Add davidabian.com to wgCopyUploadsDomains [[gerrit:259003]] (duration: 00m 32s) |
[production] |
| 16:21 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Add *.bodleian.ox.ac.uk to wgCopyUploadsDomains [[gerrit:265165]] (duration: 00m 33s) |
[production] |
| 16:19 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Add *.archives.gov to wgCopyUploadsDomains [[gerrit:265163]] (duration: 00m 32s) |
[production] |
| 16:13 |
<godog> |
bounce hhvm on mw1191 and syntaxlight runaway processes |
[production] |
| 16:05 |
<thcipriani@tin> |
thcipriani@tin Synchronized wmf-config/InitialiseSettings.php: SWAT: Disable active gadget user stats on enwiki since it takes too long [[gerrit:265185]] (duration: 00m 32s) |
[production] |
| 14:52 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.11/vendor/: Fix ?PHP properly from commit (duration: 00m 36s) |
[production] |
| 14:50 |
<chasemp> |
reboot tools-webgrid-lighttpd-1209 as frozen |
[tools] |
| 14:50 |
<godog> |
powercycle mw1123, hhvm oom |
[production] |
| 14:47 |
<ema> |
Finished reverting migration of mobile traffic to text cluster in codfw https://phabricator.wikimedia.org/T109286 |
[production] |
| 14:24 |
<hoo@tin> |
hoo@tin Synchronized wmf-config/db-eqiad.php: Set db1045 load to 0 (duration: 00m 32s) |
[production] |
| 14:23 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.11/: consistency (duration: 02m 38s) |
[production] |
| 14:15 |
<hoo@tin> |
hoo@tin Synchronized wmf-config/db-eqiad.php: Re-Pool lagged db1045 (duration: 00m 35s) |
[production] |
| 14:14 |
<_joe_> |
syncronizing /srv/deployment manually between the two deployment servers for the first time |
[production] |
| 14:11 |
<hoo@tin> |
hoo@tin Synchronized wmf-config/db-eqiad.php: Has not been synced before (duration: 00m 32s) |
[production] |
| 14:07 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.10/: consistency (duration: 02m 38s) |
[production] |
| 13:58 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.11/extensions/Validator/: noop for wikitech deploy (duration: 00m 32s) |
[production] |
| 13:58 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.11/extensions/SemanticMediaWiki/: noop for wikitech deploy (duration: 00m 34s) |
[production] |
| 13:57 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.11/extensions/SemanticResultFormats/: noop for wikitech deploy (duration: 00m 33s) |
[production] |
| 13:57 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.10/extensions/SemanticResultFormats/: noop for wikitech deploy (duration: 00m 33s) |
[production] |
| 13:55 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.10/extensions/SemanticMediaWiki/: noop for wikitech deploy (duration: 00m 33s) |
[production] |
| 13:54 |
<reedy@tin> |
reedy@tin Synchronized php-1.27.0-wmf.10/extensions/Validator/: noop for wikitech deploy (duration: 00m 33s) |
[production] |
| 13:52 |
<jynus@tin> |
jynus@tin Synchronized wmf-config/db-eqiad.php: Setting db1049 as API node as db1045 is lagged (duration: 00m 33s) |
[production] |
| 13:41 |
<ema> |
Revert migration of mobile traffic to text cluster in codfw https://phabricator.wikimedia.org/T109286 |
[production] |
| 12:55 |
<akosiaris> |
restart hhvm on mw1130 |
[production] |
| 12:43 |
<jynus> |
performing alter table on db1026 (ETA: 5 hours) |
[production] |
| 12:20 |
<jynus@tin> |
jynus@tin Synchronized wmf-config/db-eqiad.php: Setting s5 master as recentchanges role (duration: 00m 32s) |
[production] |
| 12:04 |
<jynus> |
trying schema change on wikidata (wb_terms) |
[production] |
| 10:05 |
<godog> |
bump cores to 165 |
[deployment-prep] |
| 10:04 |
<godog> |
bump ram quota to 350G |
[deployment-prep] |
| 09:36 |
<akosiaris> |
gnt-instance modify -H disk_aio=native cygnus.codfw.wmnet |
[production] |
| 09:18 |
<akosiaris> |
offline fr_archive volume on nas1001-a |
[production] |