|
2020-08-26
§
|
| 09:40 |
<hashar> |
Updating Jenkins jobs for ci-src-setup-simple:0.4.1 |
[releng] |
| 09:39 |
<hashar> |
Successfully tagged docker-registry.discovery.wmnet/releng/ci-src-setup-simple:0.4.1 |
[releng] |
| 09:18 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:00 |
<XioNoX> |
re-enable IPv6 BGP to Init7 in knams |
[production] |
| 08:54 |
<arturo> |
merged several patches by bryan for toolforge front proxy (cleanups, etc) example: https://gerrit.wikimedia.org/r/c/operations/puppet/+/622435 |
[tools] |
| 08:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1110 replication broken', diff saved to https://phabricator.wikimedia.org/P12360 and previous config saved to /var/cache/conftool/dbconfig/20200826-084044-marostegui.json |
[production] |
| 08:16 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1091 for MCR change', diff saved to https://phabricator.wikimedia.org/P12358 and previous config saved to /var/cache/conftool/dbconfig/20200826-054557-marostegui.json |
[production] |
| 05:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12357 and previous config saved to /var/cache/conftool/dbconfig/20200826-054409-marostegui.json |
[production] |
| 05:33 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12356 and previous config saved to /var/cache/conftool/dbconfig/20200826-053345-marostegui.json |
[production] |
| 05:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12355 and previous config saved to /var/cache/conftool/dbconfig/20200826-052355-marostegui.json |
[production] |
| 05:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12354 and previous config saved to /var/cache/conftool/dbconfig/20200826-050849-marostegui.json |
[production] |
| 05:03 |
<marostegui> |
Update db1135 and db1114 after MCR changes |
[production] |
| 01:11 |
<Reedy> |
restarted wikibugs because of apparent irc split brain (wikibugs and wikibugs____) |
[tools.wikibugs] |
|
2020-08-25
§
|
| 21:51 |
<mutante> |
xhgui1001/xhgui2001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) (T260397) |
[production] |
| 21:50 |
<mutante> |
xhgui1001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) ... |
[production] |
| 21:46 |
<mutante> |
importing xhgui 0.12.0-2-wmf1 to buster-wikimedia APT repo (T260397) |
[production] |
| 20:58 |
<wm-bot> |
<bd808> Deployed f486cee ([ImgBot] Optimize images) |
[tools.hatjitsu] |
| 19:40 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import (duration: 00m 54s) |
[production] |
| 19:39 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import |
[production] |
| 19:38 |
<andrewbogott> |
deleting tools-sgeexec-0943.tools.eqiad.wmflabs, tools-sgeexec-0944.tools.eqiad.wmflabs, tools-sgeexec-0945.tools.eqiad.wmflabs, tools-sgeexec-0946.tools.eqiad.wmflabs, tools-sgeexec-0948.tools.eqiad.wmflabs, tools-sgeexec-0949.tools.eqiad.wmflabs, tools-sgeexec-0953.tools.eqiad.wmflabs — they are broken and we're not very curious why; will retry this exercise when everything is standardized on |
[tools] |
| 19:15 |
<marxarelli> |
1.36.0-wmf.6 promoted to group0 (T257974). no new errors |
[production] |
| 19:09 |
<dduvall@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.6 |
[production] |
| 19:05 |
<moritzm> |
installing Java security updates on cloudelastic* hosts |
[production] |
| 19:02 |
<moritzm> |
installing Java security updates on elastic* hosts |
[production] |
| 18:19 |
<ryankemper@cumin1001> |
START - Cookbook sre.wdqs.data-reload |
[production] |
| 18:03 |
<dpifke> |
Restarted puppetdb on deployment-puppetdb03 (T248041) |
[releng] |
| 17:58 |
<dduvall@deploy1001> |
Finished scap: testwikis wikis to 1.36.0-wmf.6 (duration: 41m 58s) |
[production] |
| 17:30 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import (duration: 01m 52s) |
[production] |
| 17:28 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import |
[production] |
| 17:17 |
<dduvall@deploy1001> |
Started scap: testwikis wikis to 1.36.0-wmf.6 |
[production] |
| 17:08 |
<dduvall@deploy1001> |
Pruned MediaWiki: 1.36.0-wmf.4 (duration: 01m 40s) |
[production] |
| 17:01 |
<dduvall@deploy1001> |
Pruned MediaWiki: 1.36.0-wmf.3 (duration: 19m 12s) |
[production] |
| 17:01 |
<herron> |
imported logstash, elasticsearch, and kibana 7.9.0 -oss packages into buster-wikimedia thirdparty/elastic79 |
[production] |
| 16:58 |
<hashar> |
deployment-deploy01: upgraded scap (3.15.0-1+0~20200825155225.104~1.gbp6cd96d) over (3.15.0-1+0~20200825151423.100~1.gbpec9bb3) |
[releng] |
| 16:54 |
<hashar> |
Build Docker images to use a common ci-src-setup.sh script instead of copy pasted shells # https://gerrit.wikimedia.org/r/c/integration/config/+/622374 |
[releng] |
| 16:42 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@89b4f74]: test: Add wikidata ttl import (duration: 00m 49s) |
[production] |
| 16:41 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@89b4f74]: test: Add wikidata ttl import |
[production] |
| 16:34 |
<wm-bot> |
<jeanfred> jstop categorize_images, jsub new one |
[tools.heritage] |
| 16:26 |
<James_F> |
tox -e jenkins-jobs -- --conf jenkins_jobs.ini update ./jjb/ 'beta-scap-eqiad' |
[releng] |
| 16:21 |
<shdubsh> |
restart logstash on logstash1007 -- gc duration outlier |
[production] |
| 16:08 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@ae6dd8d]: test: Add wikidata ttl import (duration: 00m 54s) |
[production] |
| 16:07 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@ae6dd8d]: test: Add wikidata ttl import |
[production] |
| 16:00 |
<gehel> |
repool wdqs1005 - catched up on lag |
[production] |
| 15:47 |
<elukey> |
restart mariadb@analytics_meta on db1108 to apply a replication filter (exclude superset_staging database from replication) |
[analytics] |
| 15:47 |
<elukey> |
restart mariadb@analytics_meta on db1108 to apply a replication filter (exclude superset_staging database from replication) |
[production] |
| 15:44 |
<jgleeson> |
fundraising-tools updated from dcad0bfe75 to 3fe3a23114 |
[production] |
| 15:42 |
<wm-bot> |
<jeanfred> Deploy latest from Git master: f0d25be, b7d8ad4, 021ba20, 774663a, a0fa5f5, 7b66f3a, 072dfd7, eb61a9a, a2f600e, 7da8c34, 8ddfa1f, 8072796, 7b46c91, b1ec885, 79addba, 997c7a7, 12a3ec6 |
[tools.heritage] |