251-300 of 10000 results (22ms)
2024-10-17 ยง
16:52 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
16:51 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:51 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply [production]
16:50 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
16:49 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
16:49 <mutante> phab2002 T377396 - fix UIDs/GIDs for phab-related system users: vcs: uid 496 -> 497 | aphlict: uid 497 -> uid 496, gid 497 -> gid 496 | chown aphlict:aphlict /var/log/aphlict | chown aphlict:aphlict /run/aphlict [production]
16:48 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2219', diff saved to https://phabricator.wikimedia.org/P70283 and previous config saved to /var/cache/conftool/dbconfig/20241017-164830-ladsgroup.json [production]
16:42 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70282 and previous config saved to /var/cache/conftool/dbconfig/20241017-164256-arnaudb.json [production]
16:41 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:40 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:38 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:33 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70281 and previous config saved to /var/cache/conftool/dbconfig/20241017-163324-ladsgroup.json [production]
16:28 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:27 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70280 and previous config saved to /var/cache/conftool/dbconfig/20241017-162749-arnaudb.json [production]
16:12 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T367781)', diff saved to https://phabricator.wikimedia.org/P70279 and previous config saved to /var/cache/conftool/dbconfig/20241017-161242-arnaudb.json [production]
16:02 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/page-analytics: apply [production]
16:01 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/page-analytics: apply [production]
16:00 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/media-analytics: apply [production]
16:00 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/media-analytics: apply [production]
15:59 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:59 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/geo-analytics: apply [production]
15:59 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:58 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/geo-analytics: apply [production]
15:58 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:58 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:57 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/editor-analytics: apply [production]
15:57 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/editor-analytics: apply [production]
15:56 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
15:56 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
15:52 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/device-analytics: apply [production]
15:51 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/device-analytics: apply [production]
15:51 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
15:50 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
15:48 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/device-analytics: apply [production]
15:48 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/device-analytics: apply [production]
15:47 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply [production]
15:47 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply [production]
15:45 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
15:45 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
15:44 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
15:44 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
15:41 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
15:40 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
15:39 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestagemaster2005.codfw.wmnet with OS bookworm [production]
15:35 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P70278 and previous config saved to /var/cache/conftool/dbconfig/20241017-153546-ladsgroup.json [production]
15:34 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70277 and previous config saved to /var/cache/conftool/dbconfig/20241017-153257-ladsgroup.json [production]
15:33 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
15:33 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
15:32 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T376905)', diff saved to https://phabricator.wikimedia.org/P70276 and previous config saved to /var/cache/conftool/dbconfig/20241017-153238-ladsgroup.json [production]
15:20 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P70275 and previous config saved to /var/cache/conftool/dbconfig/20241017-152040-ladsgroup.json [production]