|
2021-10-21
§
|
| 16:03 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality' for release 'main' . |
[production] |
| 16:02 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 16:01 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/tests/: Backport: [[gerrit:732668|Remove dispatchViaJobsPruneChangesTableInJobEnabled repo setting (T292604)]] (3/3) (duration: 00m 56s) |
[production] |
| 15:59 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/config/: Backport: [[gerrit:732668|Remove dispatchViaJobsPruneChangesTableInJobEnabled repo setting (T292604)]] (2/3) (duration: 00m 55s) |
[production] |
| 15:58 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/includes/: Backport: [[gerrit:732668|Remove dispatchViaJobsPruneChangesTableInJobEnabled repo setting (T292604)]] (1/3) (duration: 00m 57s) |
[production] |
| 15:43 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:21 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:14 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/tests/: Backport: [[gerrit:732667|Remove dispatchViaJobsAllowedClients repo setting (T292604)]] (3/3) (duration: 00m 56s) |
[production] |
| 15:13 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 15:13 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/config/: Backport: [[gerrit:732667|Remove dispatchViaJobsAllowedClients repo setting (T292604)]] (1/3) (duration: 00m 54s) |
[production] |
| 15:12 |
<Lucas_WMDE> |
my next message accidentally says 1/3 again but it’s 2/3, sorry |
[production] |
| 15:11 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/includes/: Backport: [[gerrit:732667|Remove dispatchViaJobsAllowedClients repo setting (T292604)]] (1/3) (duration: 00m 56s) |
[production] |
| 15:10 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:56 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1001.eqiad.wmnet with OS buster |
[production] |
| 14:42 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/repo/config/Wikibase.default.php: Backport: [[gerrit:732666|Enable dispatching via jobs by default (T291828)]] (duration: 00m 55s) |
[production] |
| 14:41 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:39 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase/client/: Backport: [[gerrit:732674|Fix ExternalUserNames service wiring for local database]] (duration: 00m 57s) |
[production] |
| 14:38 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:33 |
<volans@cumin2002> |
START - Cookbook sre.hosts.reimage for host sretest1001.eqiad.wmnet with OS buster |
[production] |
| 14:26 |
<otto@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . |
[production] |
| 14:26 |
<otto@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . |
[production] |
| 14:19 |
<otto@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . |
[production] |
| 14:19 |
<otto@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . |
[production] |
| 14:05 |
<ottomata> |
rerun refine_eventlogging_analytics refine_eventlogging_legacy and refine_event with -ignore-done-flag=true --since=2021-10-21T01:00:00 --until=2021-10-21T04:00:00 for backfill of missing data after gobblin problems |
[analytics] |
| 13:56 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . |
[production] |
| 13:55 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . |
[production] |
| 13:49 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . |
[production] |
| 13:49 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . |
[production] |
| 13:39 |
<btullis> |
btullis@an-launcher1002:~$ sudo systemctl restart gobblin-event_default |
[analytics] |
| 13:34 |
<volans> |
uploaded spicerack_1.0.6 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia |
[production] |
| 13:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:05 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:04 |
<hashar@deploy1002> |
rebuilt and synchronized wikiversions files: all wikis to 1.38.0-wmf.5 refs T281169 |
[production] |
| 12:58 |
<mdipietro> |
upgraded to 923250f7cd0b522259abdad450fbd2dfb16357bf which was really not an upgrade as the diff gave nothing. Though now it is clear what is deployed. |
[paws] |
| 12:56 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 7 hosts with reason: Schema change s3 T278619 |
[production] |
| 12:56 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on 7 hosts with reason: Schema change s3 T278619 |
[production] |
| 12:52 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 14 hosts with reason: Schema change s1 T278619 |
[production] |
| 12:52 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on 14 hosts with reason: Schema change s1 T278619 |
[production] |
| 12:48 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 13 hosts with reason: Schema change s4 T278619 |
[production] |
| 12:48 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on 13 hosts with reason: Schema change s4 T278619 |
[production] |
| 12:43 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Schema change s2 T278619 |
[production] |
| 12:43 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 9 hosts with reason: Schema change s2 T278619 |
[production] |
| 12:34 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 11 hosts with reason: Schema change s7 T278619 |
[production] |
| 12:34 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 11 hosts with reason: Schema change s7 T278619 |
[production] |
| 11:55 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Schema change s5 T278619 |
[production] |
| 11:54 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 9 hosts with reason: Schema change s5 T278619 |
[production] |
| 11:47 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Schema change s6 T278619 |
[production] |
| 11:47 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 9 hosts with reason: Schema change s6 T278619 |
[production] |
| 11:35 |
<arturo> |
create project with btullis & elukey as projectadmins, quota 6 instances 12 cores and 18G ram (T292563) |
[data-engineering] |
| 11:13 |
<Lucas_WMDE> |
UTC morning backport+config window done |
[production] |