|
2018-04-20
§
|
| 07:08 |
<moritzm> |
upgrading API servers in codfw to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build |
[production] |
| 07:06 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1110 after alter table (duration: 01m 16s) |
[production] |
| 07:03 |
<hashar> |
Replaced integration-slave-docker-1001 to get 4GB of RAM |
[releng] |
| 06:54 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore main traffic original weight for db1114 (duration: 01m 15s) |
[production] |
| 06:26 |
<ema> |
kafka::analytics remove strongswan leftovers T185136 |
[production] |
| 06:25 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1114 (duration: 01m 15s) |
[production] |
| 06:07 |
<marostegui> |
Stop mysql db1114 for a reboot |
[production] |
| 06:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1114 (duration: 01m 16s) |
[production] |
| 05:55 |
<_joe_> |
depooling mw1227 from live traffic for investigation |
[production] |
| 05:31 |
<marostegui> |
Start atop on db1114 with "-R" option enabled - T192551 |
[production] |
| 05:31 |
<marostegui> |
Deploy schema change on db1110 - T191519 T188299 T190148 |
[production] |
| 05:30 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1110 for alter table (duration: 01m 17s) |
[production] |
| 05:21 |
<ariel@tin> |
Finished deploy [dumps/dumps@c2d3bb4]: keep completed stubs/abstracts/logs files around for retries (duration: 00m 04s) |
[production] |
| 05:20 |
<ariel@tin> |
Started deploy [dumps/dumps@c2d3bb4]: keep completed stubs/abstracts/logs files around for retries |
[production] |
| 01:50 |
<krinkle@tin> |
Synchronized wmf-config/CommonSettings.php: If8fdce707d (duration: 01m 17s) |
[production] |
| 00:46 |
<awight> |
roll back ORES beta to master |
[releng] |
| 00:46 |
<awight> |
roll back ORES beta to master |
[deployment-prep] |
| 00:20 |
<zhuyifei1999_> |
deleted all instances I just created except k8s master because of chicken-and-egg problem |
[toolsbeta] |
| 00:08 |
<awight> |
Push ORES git-lfs to look at stuff |
[releng] |
| 00:08 |
<awight> |
Push ORES git-lfs to look at stuff |
[deployment-prep] |
|
2018-04-19
§
|
| 23:16 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.29/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Turn off cirrus ab test (duration: 01m 18s) |
[production] |
| 23:13 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.30/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Turn off cirrus ab test (duration: 01m 17s) |
[production] |
| 23:04 |
<thcipriani@tin> |
Synchronized php: complete group1 and group2 wikis back to 1.31.0-wmf.29 (duration: 01m 16s) |
[production] |
| 22:30 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: group1 and group2 wikis back to 1.31.0-wmf.29 |
[production] |
| 22:10 |
<zhuyifei1999_> |
the trusty instances ask me for my password. the jessie instances don't like my ssh key. :( |
[toolsbeta] |
| 21:59 |
<zhuyifei1999_> |
got 'Error: RecordSet belongs in a child zone: toolsbeta.wmflabs.org', using tools-beta.wmflabs.org instead |
[toolsbeta] |
| 21:57 |
<zhuyifei1999_> |
Add proxy toolsbeta.wmflabs.org => toolsbeta-proxy-01.toolsbeta.eqiad.wmflabs |
[toolsbeta] |
| 21:43 |
<zhuyifei1999_> |
Start creating instances for webservice setup T190893 |
[toolsbeta] |
| 21:41 |
<urandom> |
Start cleanup, restbase10{07,11,16}-c -- T189822 |
[production] |
| 21:23 |
<hashar> |
Pooling in the new integration-slave-docker-1002 and integration-slave-docker-1003 |
[releng] |
| 21:22 |
<urandom> |
Start cleanup, restbase10{07,11,16}-b -- T189822 |
[production] |
| 21:15 |
<urandom> |
Start cleanup, restbase10{07,11,16}-a -- T189822 |
[production] |
| 21:11 |
<urandom> |
restarting cassandra to (temporarily) rollback prometheus jmx exporter, restbase1010-c -- T189822, T192456 |
[production] |
| 21:08 |
<hashar> |
rebuilding integration-slave-docker-1002 and integration-slave-docker-1003 ci1.medium > m1.medium (+2G RAM) |
[releng] |
| 21:01 |
<hashar> |
Bringing back quibble (0.0.9), this time with COMPOSER_PROCESS_TIMEOUT=600 | T192576 |
[releng] |
| 21:00 |
<ebernhardson> |
issue move of enwiki_content shard 2 from overloaded elasti1027 to elastic1017 |
[production] |
| 20:48 |
<urandom> |
restarting cassandra to (temporarily) rollback prometheus jmx exporter, restbase1010-a -- T189822, T192456 |
[production] |
| 20:48 |
<urandom> |
restarting cassandra to (temporarily) rollback prometheus jmx exporter -- T189822, T192456 |
[production] |
| 20:39 |
<milimetric> |
launched virtual pageviews job, it has id 0026169-180330093100664-oozie-oozi-C |
[analytics] |
| 20:36 |
<milimetric> |
Synced latest refinery version to HDFS |
[analytics] |
| 20:32 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: All wikis to 1.31.0-wmf.30 |
[production] |
| 20:27 |
<milimetric@tin> |
Finished deploy [analytics/refinery@c1c9885]: Correcting hql from last deployment (duration: 05m 09s) |
[production] |
| 20:22 |
<milimetric@tin> |
Started deploy [analytics/refinery@c1c9885]: Correcting hql from last deployment |
[production] |
| 19:53 |
<thcipriani@tin> |
Synchronized php: group1 to 1.31.0-wmf.30 (duration: 01m 15s) |
[production] |
| 19:45 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: group1 to 1.31.0-wmf.30 |
[production] |
| 19:36 |
<andrewbogott> |
deleting project as per T190952 |
[editor-engagement] |
| 19:35 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.30/includes/page/Article.php: [[gerrit:427755|Do not pass USE INDEX to a $dbType parameter]] T192584 (duration: 01m 17s) |
[production] |
| 19:33 |
<ejegg> |
updated fundraising python tools from 626fe02a9f to 0c50f9e38f |
[production] |
| 19:22 |
<hashar> |
integration-slave-docker-1004 : wiping all jenkins workspace and all docker images |
[releng] |
| 19:22 |
<no_justification> |
gerrit: restarting services to pick up gc & indexing changes |
[production] |