7451-7500 of 10000 results (110ms)
2024-04-24 ยง
13:13 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1242 (re)pooling @ 5%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61150 and previous config saved to /var/cache/conftool/dbconfig/20240424-131336-arnaudb.json [production]
13:12 <urbanecm@deploy1002> daimona and urbanecm: Continuing with sync [production]
13:09 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart-reboot-durum rolling restart_daemons on A:durum [production]
13:07 <urbanecm@deploy1002> daimona and urbanecm: Backport for [[gerrit:1023101|Growth: Enable Levelling up features on all wikis (T348086)]], [[gerrit:1023796|WikiEduDashboard: allow removal when course is not synced (T363187)]], [[gerrit:1023797|WikiEduDashboard: allow removal when course is not synced (T363187)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:04 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:1023101|Growth: Enable Levelling up features on all wikis (T348086)]], [[gerrit:1023796|WikiEduDashboard: allow removal when course is not synced (T363187)]], [[gerrit:1023797|WikiEduDashboard: allow removal when course is not synced (T363187)]] [production]
13:03 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1242.eqiad.wmnet with OS bookworm [production]
12:59 <isaranto@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
12:58 <isaranto@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
12:57 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns rolling restart_daemons on A:wikidough and A:wikidough [production]
12:52 <jmm@cumin2002> START - Cookbook sre.elasticsearch.restart-nginx rolling restart_daemons on A:elastic-eqiad [production]
12:26 <arnaudb@cumin1002> START - Cookbook sre.hosts.reimage for host db1242.eqiad.wmnet with OS bookworm [production]
12:25 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depool db1242', diff saved to https://phabricator.wikimedia.org/P61149 and previous config saved to /var/cache/conftool/dbconfig/20240424-122520-arnaudb.json [production]
12:24 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1242.eqiad.wmnet with reason: T362746 [production]
12:24 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1242.eqiad.wmnet with reason: T362746 [production]
12:23 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on stat1010.eqiad.wmnet with reason: Connecting GPU power cable [production]
12:23 <btullis@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on stat1010.eqiad.wmnet with reason: Connecting GPU power cable [production]
12:20 <jmm@cumin2002> START - Cookbook sre.elasticsearch.restart-nginx rolling restart_daemons on A:elastic-codfw [production]
12:10 <jmm@cumin2002> END (PASS) - Cookbook sre.elasticsearch.restart-nginx (exit_code=0) rolling restart_daemons on A:elastic-canary [production]
12:10 <jmm@cumin2002> START - Cookbook sre.elasticsearch.restart-nginx rolling restart_daemons on A:elastic-canary [production]
11:50 <jmm@cumin2002> END (PASS) - Cookbook sre.elasticsearch.restart-nginx (exit_code=0) rolling restart_daemons on A:relforge [production]
11:49 <jmm@cumin2002> START - Cookbook sre.elasticsearch.restart-nginx rolling restart_daemons on A:relforge [production]
11:32 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 100%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61148 and previous config saved to /var/cache/conftool/dbconfig/20240424-113241-arnaudb.json [production]
11:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 75%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61147 and previous config saved to /var/cache/conftool/dbconfig/20240424-111735-arnaudb.json [production]
11:05 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kawikisource (T363242) [production]
11:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 50%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61146 and previous config saved to /var/cache/conftool/dbconfig/20240424-110230-arnaudb.json [production]
10:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 25%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61145 and previous config saved to /var/cache/conftool/dbconfig/20240424-104724-arnaudb.json [production]
10:40 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database kawikisource (T363242) [production]
10:39 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1248 (re)pooling @ 100%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61144 and previous config saved to /var/cache/conftool/dbconfig/20240424-103922-arnaudb.json [production]
10:39 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database mswikisource (T363249) [production]
10:39 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database mswikisource (T363249) [production]
10:38 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kaawiktionary (T363255) [production]
10:38 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database kaawiktionary (T363255) [production]
10:37 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database iglwiki (T363262) [production]
10:37 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database iglwiki (T363262) [production]
10:32 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database mywikisource (T363269) [production]
10:32 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database mywikisource (T363269) [production]
10:32 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 10%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61143 and previous config saved to /var/cache/conftool/dbconfig/20240424-103218-arnaudb.json [production]
10:30 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database bewwiki [production]
10:30 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database bewwiki [production]
10:24 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1248 (re)pooling @ 75%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61142 and previous config saved to /var/cache/conftool/dbconfig/20240424-102416-arnaudb.json [production]
10:22 <taavi@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) [production]
10:22 <taavi@cumin1002> Added views for new wiki: kuswiki T360302 [production]
10:21 <taavi@cumin1002> START - Cookbook sre.wikireplicas.add-wiki [production]
10:19 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 151326 [production]
10:18 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 151326 [production]
10:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1247 (re)pooling @ 5%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61141 and previous config saved to /var/cache/conftool/dbconfig/20240424-101713-arnaudb.json [production]
10:09 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1248 (re)pooling @ 50%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61140 and previous config saved to /var/cache/conftool/dbconfig/20240424-100910-arnaudb.json [production]
10:04 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1247.eqiad.wmnet with OS bookworm [production]
09:54 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1248 (re)pooling @ 25%: Post reimage', diff saved to https://phabricator.wikimedia.org/P61139 and previous config saved to /var/cache/conftool/dbconfig/20240424-095405-arnaudb.json [production]
09:45 <taavi> echo "https://en.wikipedia.org/static/images/mobile/copyright/wikipedia-tagline-ca-750k.svg" | mwscript purgeList.php --wiki enwiki # T363057 [production]