3551-3600 of 10000 results (70ms)
2023-07-31 ยง
13:38 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] (duration: 24m 24s) [production]
13:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 100%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49818 and previous config saved to /var/cache/conftool/dbconfig/20230731-133707-root.json [production]
13:29 <jforrester@deploy1002> jforrester and epicpupper: Continuing with sync [production]
13:29 <jforrester@deploy1002> jforrester and epicpupper: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:24 <moritzm> imported jenkins 2.401.3 to thirdparty/ci for bullseye-wikimedia T342572 [production]
13:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 75%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49817 and previous config saved to /var/cache/conftool/dbconfig/20230731-132201-root.json [production]
13:14 <jforrester@deploy1002> Started scap: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] [production]
13:13 <James_F> WikiLambda backport verified for T342891 T342687 T341500 T343006 T342901 and T343041 [production]
13:09 <jforrester@deploy1002> Synchronized php-1.41.0-wmf.19/extensions/WikiLambda/: (no justification provided) (duration: 07m 16s) [production]
13:06 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 50%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49816 and previous config saved to /var/cache/conftool/dbconfig/20230731-130657-root.json [production]
13:00 <jnuche> CI Jenkins upgraded to 2.401.3: https://phabricator.wikimedia.org/T342572 [production]
12:57 <moritzm> installing 6.1.38 kernels on Bookworm hosts [production]
12:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1166 (T342617)', diff saved to https://phabricator.wikimedia.org/P49815 and previous config saved to /var/cache/conftool/dbconfig/20230731-125513-ladsgroup.json [production]
12:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
12:54 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
12:53 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1196.eqiad.wmnet with reason: Maint [production]
12:53 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1196.eqiad.wmnet with reason: Maint [production]
12:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depool db1196 T342284', diff saved to https://phabricator.wikimedia.org/P49814 and previous config saved to /var/cache/conftool/dbconfig/20230731-125252-ladsgroup.json [production]
12:51 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 25%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49813 and previous config saved to /var/cache/conftool/dbconfig/20230731-125152-root.json [production]
12:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2127 (T342617)', diff saved to https://phabricator.wikimedia.org/P49812 and previous config saved to /var/cache/conftool/dbconfig/20230731-124912-ladsgroup.json [production]
12:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
12:48 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
12:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2109 (T342617)', diff saved to https://phabricator.wikimedia.org/P49811 and previous config saved to /var/cache/conftool/dbconfig/20230731-124851-ladsgroup.json [production]
12:36 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 10%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49810 and previous config saved to /var/cache/conftool/dbconfig/20230731-123647-root.json [production]
12:33 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P49809 and previous config saved to /var/cache/conftool/dbconfig/20230731-123345-ladsgroup.json [production]
12:32 <moritzm> installing xapian-core bugfix updates on Bullseye [production]
12:23 <moritzm> installing mariadb-10.5 updates from Bullseye 11.7 point release (libs/tools, unrelated to wmf-mariadb packages) [production]
12:21 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 5%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49808 and previous config saved to /var/cache/conftool/dbconfig/20230731-122142-root.json [production]
12:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P49807 and previous config saved to /var/cache/conftool/dbconfig/20230731-121839-ladsgroup.json [production]
12:06 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 3%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49806 and previous config saved to /var/cache/conftool/dbconfig/20230731-120638-root.json [production]
12:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2109 (T342617)', diff saved to https://phabricator.wikimedia.org/P49805 and previous config saved to /var/cache/conftool/dbconfig/20230731-120332-ladsgroup.json [production]
11:51 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 1%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49804 and previous config saved to /var/cache/conftool/dbconfig/20230731-115133-root.json [production]
11:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2114 T334650', diff saved to https://phabricator.wikimedia.org/P49803 and previous config saved to /var/cache/conftool/dbconfig/20230731-114645-root.json [production]
11:23 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
11:11 <btullis@cumin1001> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) [production]
11:11 <btullis@cumin1001> Added views for new wiki: wikifunctionswiki T289316 [production]
11:11 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
10:59 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
10:55 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
10:51 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
10:51 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
10:45 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
10:45 <btullis@cumin1001> START - Cookbook sre.wikireplicas.add-wiki [production]
10:36 <cgoubert@cumin1001> conftool action : set/pooled=yes; selector: dc=eqiad,name=parse1002.eqiad.wmnet [production]
10:36 <claime> Repooling parse1002 following CPU replacement - T339340 [production]
10:34 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for parse1002.eqiad.wmnet [production]
10:34 <cgoubert@cumin1001> START - Cookbook sre.hosts.remove-downtime for parse1002.eqiad.wmnet [production]
10:28 <_joe_> disabling puppet on mwdebug2002, testing noc.wikimedia.org [production]
10:20 <moritzm> installing bind9 security updates (client-side tools/libs) [production]
10:11 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs1016.eqiad.wmnet with OS bookworm [production]