4801-4850 of 10000 results (89ms)
2023-02-21 §
08:04 <kartik@deploy1002> Started scap: Backport for [[gerrit:890482|Section Translation: Fix language code for Cantonese Wikipedia (T304865)]] [production]
07:49 <XioNoX> Staging the new Junos version on the codfw row B switches - T327991 [production]
01:06 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:890173|cswikibooks: Enable visualeditor for all users (T330015)]] (duration: 08m 47s) [production]
00:59 <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:890173|cswikibooks: Enable visualeditor for all users (T330015)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
00:57 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:890173|cswikibooks: Enable visualeditor for all users (T330015)]] [production]
2023-02-20 §
21:35 <zabe> close UTC late backport window [production]
21:33 <zabe@deploy1002> Finished scap: T329983 T330104 (duration: 11m 51s) [production]
21:23 <zabe@deploy1002> zabe: T329983 T330104 synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
21:21 <zabe@deploy1002> Started scap: T329983 T330104 [production]
21:16 <zabe> zabe@mwmaint1002:~$ mwscript namespaceDupes.php tawiki --fix # T329248 [production]
21:14 <zabe@deploy1002> Finished scap: Backport for [[gerrit:890198|[tawiki] Add Draft and Draft_talk namespaces (T329248)]] (duration: 08m 52s) [production]
21:07 <zabe@deploy1002> superpes and zabe: Backport for [[gerrit:890198|[tawiki] Add Draft and Draft_talk namespaces (T329248)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
21:05 <zabe@deploy1002> Started scap: Backport for [[gerrit:890198|[tawiki] Add Draft and Draft_talk namespaces (T329248)]] [production]
20:58 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-gp1002.eqiad.wmnet with OS bullseye [production]
20:41 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-gp1002.eqiad.wmnet with reason: host reimage [production]
20:39 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc-gp1002.eqiad.wmnet with reason: host reimage [production]
20:26 <jiji@cumin1001> START - Cookbook sre.hosts.reimage for host mc-gp1002.eqiad.wmnet with OS bullseye [production]
18:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2165 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P44693 and previous config saved to /var/cache/conftool/dbconfig/20230220-185659-root.json [production]
18:50 <taavi> taavi@mwmaint1002:~$ mwscript extensions/DiscussionTools/maintenance/persistRevisionThreadItems.php --wiki itwiki --current --all | tee T315510-itwiki.log # T315510 [production]
18:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2165 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P44692 and previous config saved to /var/cache/conftool/dbconfig/20230220-184154-root.json [production]
18:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2165 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P44691 and previous config saved to /var/cache/conftool/dbconfig/20230220-182649-root.json [production]
18:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2165 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P44690 and previous config saved to /var/cache/conftool/dbconfig/20230220-181144-root.json [production]
17:26 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
17:16 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
16:50 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/mathoid: sync [production]
16:49 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/mathoid: sync [production]
16:49 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mathoid: sync [production]
16:48 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/mathoid: sync [production]
16:41 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
16:40 <volans> upgraded spicerack to v6.2.1 to the cumin hosts [production]
16:38 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Christina Macholan out of all services on: 943 hosts [production]
16:38 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Christina Macholan out of all services on: 943 hosts [production]
16:36 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Christina Macholan out of all services on: 1069 hosts [production]
16:36 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Christina Macholan out of all services on: 1069 hosts [production]
16:31 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
16:28 <nfraison@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-presto1001.eqiad.wmnet with OS bullseye [production]
16:25 <volans@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:05:00 on cumin2002.codfw.wmnet with reason: test spicerack v6.2.1 [production]
16:25 <volans@cumin2002> START - Cookbook sre.hosts.downtime for 0:05:00 on cumin2002.codfw.wmnet with reason: test spicerack v6.2.1 [production]
16:20 <volans> uploaded spicerack_6.2.1 to apt.wikimedia.org bullseye-wikimedia [production]
16:18 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
16:09 <nfraison@cumin1001> START - Cookbook sre.hosts.reimage for host an-presto1001.eqiad.wmnet with OS bullseye [production]
16:08 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
15:57 <akosiaris@deploy1002> helmfile [staging] DONE helmfile.d/services/mathoid: sync [production]
15:57 <akosiaris@deploy1002> helmfile [staging] START helmfile.d/services/mathoid: sync [production]
15:54 <nfraison@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-presto1001.eqiad.wmnet with OS bullseye [production]
15:53 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:43 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
15:34 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:26 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-staging2001.codfw.wmnet [production]
15:24 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]