251-300 of 10000 results (101ms)
2025-02-17 §
12:51 <elukey@puppetserver1001> conftool action : set/pooled=yes:weight=10; selector: name=wikikube-worker1003.eqiad.wmnet,dc=eqiad,cluster=maps,service=kartotherian-k8s-ssl [production]
12:50 <elukey@puppetserver1001> conftool action : set/pooled=yes:weight=10; selector: name=wikikube-worker2003.codfw.wmnet,dc=codfw,cluster=maps,service=kartotherian-k8s-ssl [production]
12:49 <elukey@puppetserver1001> conftool action : set/pooled=yes:weight=10; selector: name=wikikube-worker2002.codfw.wmnet,dc=codfw,cluster=maps,service=kartotherian-k8s-ssl [production]
12:35 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1119204|[Growth] enwiki: Enable mentorship for 100% of new accounts (T384505)]] (duration: 21m 37s) [production]
12:14 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1119204|[Growth] enwiki: Enable mentorship for 100% of new accounts (T384505)]] [production]
12:14 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
12:13 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
11:59 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
11:58 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:10 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
09:10 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
09:09 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'readability' for release 'main' . [production]
09:09 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'logo-detection' for release 'main' . [production]
09:04 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
09:04 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
09:03 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
09:03 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . [production]
09:03 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
09:03 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . [production]
09:03 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
09:01 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
08:56 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
08:54 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
08:52 <jayme@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
08:51 <jayme@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
08:51 <jayme@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
08:50 <jayme@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
08:49 <jayme@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:48 <jayme@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
08:48 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . [production]
08:07 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:06 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
2025-02-15 §
03:39 <cmooney@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10 days, 0:00:00 on cr2-magru with reason: IBGP instability from cr1 to cr2 in magru causing ping faulures from alert1002 [production]
2025-02-14 §
18:03 <arnaudb@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade gitlab [production]
16:05 <otto@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-main: sync [production]
16:04 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-main: sync [production]
16:04 <ottomata> roll restart eventgate-main in codfw for T386138 -- the previous command roll restarted in eqiad. [production]
16:02 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-main: sync [production]
16:01 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-main: sync [production]
16:00 <ottomata> roll restart eventgate-main in codfw for T386138 [production]
15:55 <logmsgbot> Roses are red / Violets are blue / If you hack on MediaWiki / Wikimedians <3 you! #ilovefs #wmhack [production]
14:32 <arnaudb@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade gitlab [production]
14:31 <arnaudb@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade gitlab [production]
14:30 <arnaudb@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab [production]
14:23 <arnaudb@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade gitlab [production]
14:19 <arnaudb@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab [production]
14:18 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=93) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab [production]
14:18 <arnaudb@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab [production]
2025-02-13 §
22:44 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on relforge[1003-1007].eqiad.wmnet with reason: T386357 [production]
22:38 <zabe> zabe@mwmaint2002:~$ mwscript extensions/WikimediaMaintenance/migrateESRefToContentTable.php ttwiki --skip /home/zabe/text_table_cleanup/ttwiki --dump /home/zabe/text_table_dump/ttwiki --sleep 0.5 --start 867501 # T183490 [production]