|
2019-03-14
§
|
| 07:15 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] |
[production] |
| 07:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 55s) |
[production] |
| 06:52 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 54s) |
[production] |
| 06:51 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1097 (duration: 00m 55s) |
[production] |
| 06:50 |
<marostegui@deploy1001> |
sync-file aborted: More traffic to db1097 (duration: 00m 00s) |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster staging completed |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] |
[production] |
| 06:40 |
<marostegui> |
Upgrade mysql on dbstore2002 |
[production] |
| 06:34 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098:3317 (duration: 00m 55s) |
[production] |
| 06:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1098:3317 (duration: 00m 55s) |
[production] |
| 06:08 |
<kart_> |
Finished manual run of unpublished ContentTranslation draft purge script (T217818) |
[production] |
| 06:04 |
<marostegui> |
Upgrade MySQL on db1098 |
[production] |
| 06:04 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1098 (duration: 00m 56s) |
[production] |
| 04:00 |
<kart_> |
Started manual run of unpublished ContentTranslation draft purge script (T217818) |
[production] |
| 01:39 |
<ejegg> |
updated fundraising CiviCRM from 5c45e4c24d to b4e3cf16cc |
[production] |
|
2019-03-13
§
|
| 23:48 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.21/skins/MinervaNeue/: Remove unnecessary parameter from getHistoryPageAction (duration: 00m 56s) |
[production] |
| 23:45 |
<catrope@deploy1001> |
Synchronized wmf-config/WikibaseSearchSettings.php: Fix builder class definition for WBCS (duration: 00m 56s) |
[production] |
| 23:41 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.21/extensions/MobileFrontend/: Fix animation when visual section editing enabled on mobile only (T218167) (duration: 00m 58s) |
[production] |
| 23:39 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.21/extensions/WikibaseCirrusSearch/: Fix hook return values (duration: 00m 58s) |
[production] |
| 23:30 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.21/extensions/GrowthExperiments/: Instrumentation fixes (T217802) (duration: 00m 57s) |
[production] |
| 22:00 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Disabling api-request logging to eventgate-analytics for group0 wikis until we solve T218268 (duration: 00m 56s) |
[production] |
| 21:11 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 21:11 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster eqiad completed |
[production] |
| 21:11 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] |
[production] |
| 21:10 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 21:10 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster codfw completed |
[production] |
| 21:09 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] |
[production] |
| 20:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 20:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
| 20:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
| 20:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics install -n staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
| 20:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics install -n staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad,codfw] |
[production] |
| 20:35 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@e2e44bc]: Updating Parsoid to ea80d1b (duration: 06m 38s) |
[production] |
| 20:28 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@e2e44bc]: Updating Parsoid to ea80d1b |
[production] |
| 20:25 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) (duration: 03m 35s) |
[production] |
| 20:24 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Disabling api-request logging to eventgate-analytics for group1 wikis to investigate possible outage (duration: 00m 56s) |
[production] |
| 20:21 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) |
[production] |
| 20:14 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) (duration: 01m 49s) |
[production] |
| 20:03 |
<herron> |
increased index.mapping.total_fields.limit to 1350 on index logstash-2019.03.13 |
[production] |
| 19:46 |
<jijiki> |
Pooling mw2206 - T215415 |
[production] |
| 19:26 |
<herron> |
performing rolling restart of eqiad logstash instances |
[production] |
| 18:51 |
<jijiki> |
Depool mw1280 and mw2206 to hardware issues - T215415 T218006 |
[production] |
| 18:44 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enabling api-request logging to eventgate-analytics for group1 wikis (duration: 00m 58s) |
[production] |
| 18:30 |
<robh> |
thumbor1004 memtest in progress via T215411 |
[production] |
| 18:29 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe |
[production] |
| 18:29 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx |
[production] |
| 18:28 |
<ema> |
cp2002: depool varnish-fe after 1 hour ATS experiment T213263 |
[production] |
| 18:09 |
<bstorm_> |
rebooting labstore1006 T217473 |
[production] |
| 18:07 |
<bstorm_> |
downtime labstore1006 for troubleshooting T217473 |
[production] |