2023-07-14
§
|
22:45 |
<taavi> |
reboot tools-sgebastion-11 (dev.toolforge.org) to recover from stuck NFS client causing a high load average |
[tools] |
19:57 |
<jforrester@deploy1002> |
helmfile [staging] DONE helmfile.d/services/wikifunctions: apply |
[production] |
19:56 |
<jforrester@deploy1002> |
helmfile [staging] START helmfile.d/services/wikifunctions: apply |
[production] |
19:55 |
<jforrester@deploy1002> |
helmfile [staging] DONE helmfile.d/services/wikifunctions: apply |
[production] |
19:55 |
<jforrester@deploy1002> |
helmfile [staging] START helmfile.d/services/wikifunctions: apply |
[production] |
19:39 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host an-worker1153.eqiad.wmnet with OS bullseye |
[production] |
19:19 |
<xcollazo@deploy1002> |
Finished deploy [airflow-dags/analytics@37d3ad6]: Run page_content_change_to_wikitext_raw DAG serially. T335860 (duration: 00m 14s) |
[production] |
19:19 |
<xcollazo@deploy1002> |
Started deploy [airflow-dags/analytics@37d3ad6]: Run page_content_change_to_wikitext_raw DAG serially. T335860 |
[production] |
19:13 |
<James_F> |
jjb: First testing on quibble-vendor-mysql-php74-noselenium-docker |
[releng] |
18:56 |
<James_F> |
Docker: Building and publishing quibble images # T90875 T227900 T341840 |
[releng] |
18:45 |
<James_F> |
Tag Quibble 1.5.5 @ 85009d62de # T90875 T227900 T341840 |
[releng] |
18:42 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host an-worker1153.eqiad.wmnet with OS bullseye |
[production] |
16:05 |
<hnowlan@deploy1002> |
helmfile [staging] DONE helmfile.d/services/thumbor: apply |
[production] |
16:04 |
<hnowlan@deploy1002> |
helmfile [staging] START helmfile.d/services/thumbor: apply |
[production] |
14:56 |
<wm-bot> |
<lucaswerkmeister> restart to fix 5xx errors |
[tools.sal] |
14:25 |
<elukey@deploy1002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
14:22 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
13:10 |
<Daimona> |
Dropping default from campaign_events.event_answers_status column in beta wikishared # T341642 |
[releng] |
11:23 |
<Reedy> |
Updating development images on contint primary for various commits... |
[releng] |
10:43 |
<jelto@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/miscweb: apply |
[production] |
10:42 |
<jelto@deploy1002> |
helmfile [eqiad] START helmfile.d/services/miscweb: apply |
[production] |
10:41 |
<jelto@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/miscweb: apply |
[production] |
10:40 |
<jelto@deploy1002> |
helmfile [codfw] START helmfile.d/services/miscweb: apply |
[production] |
10:38 |
<jelto@deploy1002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
10:38 |
<jelto@deploy1002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
09:48 |
<dcaro> |
deploy builds-api 0.0.78, ci rebuild |
[tools] |
09:02 |
<klausman@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=ores2003.codfw.wmnet |
[production] |
09:02 |
<klausman> |
Setting ores2003 to pooled=inactive wheile we attempt repairs/decide on decom |
[production] |
08:51 |
<oblivian@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mw-web: apply |
[production] |
08:48 |
<oblivian@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mw-web: apply |
[production] |
08:48 |
<oblivian@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mw-web: apply |
[production] |
08:47 |
<_joe_> |
deploying to mw on k8s for T341825 |
[production] |
08:47 |
<oblivian@deploy1002> |
helmfile [codfw] START helmfile.d/services/mw-web: apply |
[production] |
07:16 |
<oblivian@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply |
[production] |
07:13 |
<hashar@deploy1002> |
Finished deploy [integration/docroot@56b5745]: Add mwbot-rs to doc.wikimedia.org - T341543 (duration: 00m 08s) |
[production] |
07:13 |
<hashar@deploy1002> |
Started deploy [integration/docroot@56b5745]: Add mwbot-rs to doc.wikimedia.org - T341543 |
[production] |
07:12 |
<oblivian@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mw-debug: apply |
[production] |
07:07 |
<oblivian@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mw-debug: sync |
[production] |
07:06 |
<oblivian@deploy1002> |
helmfile [codfw] START helmfile.d/services/mw-debug: sync |
[production] |
07:06 |
<oblivian@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mw-debug: apply |
[production] |
07:06 |
<oblivian@deploy1002> |
helmfile [codfw] START helmfile.d/services/mw-debug: apply |
[production] |
07:04 |
<oblivian@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mw-debug: apply |
[production] |
07:04 |
<oblivian@deploy1002> |
helmfile [codfw] START helmfile.d/services/mw-debug: apply |
[production] |