|
2022-01-06
ยง
|
| 23:23 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-test-coord1002.eqiad.wmnet with OS buster |
[production] |
| 22:55 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host an-test-coord1002.eqiad.wmnet with OS buster |
[production] |
| 22:29 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 22:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 22:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 22:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 22:25 |
<twentyafterfour@deploy1002> |
rebuilt and synchronized wikiversions files: all wikis to 1.38.0-wmf.16 refs T293958 |
[production] |
| 22:14 |
<twentyafterfour@deploy1002> |
Synchronized php-1.38.0-wmf.16/extensions/Scribunto/: sync Scribunto to deploy https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Scribunto/+/752006/ (duration: 01m 08s) |
[production] |
| 22:01 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 22:00 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 22:00 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 21:59 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:23 |
<ebernhardson@deploy1002> |
Finished deploy [wikimedia/discovery/analytics@3297991]: update rdf-spark-tools jar to 0.3.98 (duration: 02m 15s) |
[production] |
| 20:21 |
<ebernhardson@deploy1002> |
Started deploy [wikimedia/discovery/analytics@3297991]: update rdf-spark-tools jar to 0.3.98 |
[production] |
| 20:19 |
<inflatador> |
banned elastic2051 from both chi and omega search clusters - T298674 |
[production] |
| 20:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:07 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:07 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:01 |
<twentyafterfour@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Sync https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/751841 (duration: 01m 08s) |
[production] |
| 20:01 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 19:59 |
<ebernhardson@deploy1002> |
Finished deploy [wikimedia/discovery/analytics@63c162d]: generate entity revision maps for commons / wcqs (duration: 02m 07s) |
[production] |
| 19:57 |
<ebernhardson@deploy1002> |
Started deploy [wikimedia/discovery/analytics@63c162d]: generate entity revision maps for commons / wcqs |
[production] |
| 19:57 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 19:57 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 19:56 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 19:09 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 19:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 19:08 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 19:07 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 19:07 |
<taavi> |
UTC evening deploys done |
[production] |
| 19:05 |
<taavi@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:751538|Add data.nhm.ac.uk to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T298451)]] (duration: 01m 09s) |
[production] |
| 19:02 |
<razzi> |
systemctl restart haproxy on dbproxy1018 to repool clouddb1018 for T298505 |
[production] |
| 18:59 |
<mutante> |
puppetmaster1001 - creating missing Icinga contact for jgleeson in private puppet repo T298649 |
[production] |
| 18:51 |
<mutante> |
contint1001 - after contint2001 also re-enabled puppet and deployed 751816 zuul-merger refactor - service git-daemon refreshed and runnning |
[production] |
| 18:50 |
<razzi> |
run sudo maintain-views --databases centralauth --replace-all on clouddb1018 for T298505 |
[production] |
| 18:47 |
<mutante> |
contint* - deploying zuul-merger puppet refactor change, first codfw-only |
[production] |
| 18:00 |
<btullis@deploy1002> |
Finished deploy [cassandra/logstash-logback-encoder@fb10de1] (aqs): Deploying logstash-logback-encoder to production (duration: 00m 09s) |
[production] |
| 18:00 |
<btullis@deploy1002> |
Started deploy [cassandra/logstash-logback-encoder@fb10de1] (aqs): Deploying logstash-logback-encoder to production |
[production] |
| 17:45 |
<ebernhardson@deploy1002> |
Finished deploy [wikimedia/discovery/analytics@6f5caf9]: allow for null columns in export to relforge (duration: 02m 11s) |
[production] |
| 17:42 |
<ebernhardson@deploy1002> |
Started deploy [wikimedia/discovery/analytics@6f5caf9]: allow for null columns in export to relforge |
[production] |
| 16:42 |
<otto@deploy1002> |
Finished deploy [cassandra/logstash-logback-encoder@fb10de1] (aqs): Deploying logstash-logback-encoder to production (duration: 00m 34s) |
[production] |
| 16:41 |
<otto@deploy1002> |
Started deploy [cassandra/logstash-logback-encoder@fb10de1] (aqs): Deploying logstash-logback-encoder to production |
[production] |
| 16:37 |
<inflatador> |
restarting elastic2052 for configuration change - T298674 |
[production] |
| 16:33 |
<taavi> |
reset wikitech email for User:Iniquity per T298683 |
[production] |
| 16:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 16:26 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 16:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 16:25 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 16:21 |
<taavi@deploy1002> |
Synchronized wmf-config/wikitech.php: wikitech: Re-enable Phabricator and Gerrit users after unblock (duration: 01m 09s) |
[production] |