|
2020-08-06
ยง
|
| 16:14 |
<Operator873> |
Operator873 set flags +AV on sithjarjar666 in #cvn-simplewikis |
[cvn] |
| 15:40 |
<otto@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 15:40 |
<otto@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 15:29 |
<bd808> |
Restarted puppetdb on deployment-puppetdb03.deployment-prep.eqiad.wmflabs. Dead from OOM. |
[releng] |
| 15:10 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@97a02a3]: Regular analytics weekly train [analytics/refinery@97a02a3 (duration: 20m 01s) |
[production] |
| 14:50 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@97a02a3]: Regular analytics weekly train [analytics/refinery@97a02a3 |
[production] |
| 14:47 |
<fdans> |
deploying refinery |
[analytics] |
| 14:15 |
<addshore> |
ansible-playbook fedProps.yml --limit fedprops-opennext.wikidata-dev.eqiad.wmflabs # T259782 |
[wikidata-dev] |
| 14:15 |
<addshore> |
ansible-playbook fedProps.yml --limit fedprops-euspecies.wikidata-dev.eqiad.wmflabs # T259782 |
[wikidata-dev] |
| 14:00 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Add eventgate-* test.event streams - T251935 (duration: 01m 08s) |
[production] |
| 13:32 |
<jayme> |
updated helm to 2.16.9-2 on contint*, deploy* and chartmuseum* |
[production] |
| 13:24 |
<jayme> |
imported helm_2.16.9-2 and tiller_2.16.9-2 to buster-wikimedia, jessie-wikimedia and stretch-wikimedia |
[production] |
| 12:06 |
<kart_> |
Updated cxserver to 2020-08-05-070016-production (T258919, T199523, T257943, T256194) |
[production] |
| 12:03 |
<kartik@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 11:59 |
<kartik@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 11:57 |
<kartik@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . |
[production] |
| 11:54 |
<Lucas_WMDE> |
EU backport window done |
[production] |
| 11:54 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.36.0-wmf.3/extensions/Flow/: Backport: [[gerrit:618580|Pass jQuery objects into jqueryMsg]] (duration: 01m 09s) |
[production] |
| 11:53 |
<XioNoX> |
reboot cr2-eqord - T259621 |
[production] |
| 11:37 |
<XioNoX> |
drain traffic away cr2-eqord - T259621 |
[production] |
| 11:27 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.36.0-wmf.3/extensions/Wikibase/lib/: Backport: [[gerrit:618579|Fix CachingFallbackLabelDescriptionLookup failing in edge-cases (T259744)]] (duration: 01m 10s) |
[production] |
| 11:22 |
<XioNoX> |
reboot cr2-eqdfw - T259621 |
[production] |
| 11:13 |
<XioNoX> |
drain traffic away cr2-eqdfw - T259621 |
[production] |
| 10:52 |
<mvolz@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 10:52 |
<Lucas_WMDE> |
wikidata-federated-properties `ansible-playbook fedProps.yml --limit wikidata-federated-properties.wikidata-dev.eqiad.wmflabs` (relog with T259782) |
[wikidata-dev] |
| 10:50 |
<Lucas_WMDE> |
wikidata-federated-properties `ansible-playbook fedProps.yml --limit wikidata-federated-properties.wikidata-dev.eqiad.wmflabs` |
[wikidata-dev] |
| 10:48 |
<mvolz@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 10:45 |
<mvolz@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . |
[production] |
| 10:23 |
<mvolz@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . |
[production] |
| 10:16 |
<mvolz@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . |
[production] |
| 10:14 |
<jynus@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:12 |
<jynus@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:11 |
<mvolz@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . |
[production] |
| 08:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1127', diff saved to https://phabricator.wikimedia.org/P12188 and previous config saved to /var/cache/conftool/dbconfig/20200806-084406-marostegui.json |
[production] |
| 08:37 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1127', diff saved to https://phabricator.wikimedia.org/P12187 and previous config saved to /var/cache/conftool/dbconfig/20200806-083743-marostegui.json |
[production] |
| 08:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1127', diff saved to https://phabricator.wikimedia.org/P12186 and previous config saved to /var/cache/conftool/dbconfig/20200806-083033-marostegui.json |
[production] |
| 08:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1127', diff saved to https://phabricator.wikimedia.org/P12185 and previous config saved to /var/cache/conftool/dbconfig/20200806-081416-marostegui.json |
[production] |
| 08:07 |
<elukey> |
roll restart druid-brokers (on both clusters) to pick up new changes for monitorings |
[analytics] |
| 07:03 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) |
[production] |
| 06:57 |
<elukey@cumin1001> |
START - Cookbook sre.zookeeper.roll-restart-zookeeper |
[production] |
| 06:57 |
<marostegui> |
Truncate tables on zerowiki T227717 |
[production] |
| 06:53 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) |
[production] |
| 06:47 |
<elukey@cumin1001> |
START - Cookbook sre.zookeeper.roll-restart-zookeeper |
[production] |
| 06:43 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) |
[production] |
| 06:37 |
<elukey> |
roll restart of druid clusters' zookeeper and an-conf* zookeeper for openjdk-11 upgrades |
[production] |
| 06:36 |
<elukey@cumin1001> |
START - Cookbook sre.zookeeper.roll-restart-zookeeper |
[production] |
| 06:22 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 06:20 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:07 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1127 for MCR', diff saved to https://phabricator.wikimedia.org/P12184 and previous config saved to /var/cache/conftool/dbconfig/20200806-050743-marostegui.json |
[production] |
| 04:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1079', diff saved to https://phabricator.wikimedia.org/P12182 and previous config saved to /var/cache/conftool/dbconfig/20200806-045622-marostegui.json |
[production] |