851-900 of 10000 results (72ms)
2023-08-02 ยง
13:28 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde: Backport for [[gerrit:944848|Inject LanguageNameLookupFactory into WikibaseValueFormatterBuilders (T281726)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1184 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P49969 and previous config saved to /var/cache/conftool/dbconfig/20230802-132819-ladsgroup.json [production]
13:26 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host pc2016.mgmt.codfw.wmnet with reboot policy FORCED [production]
13:26 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:944848|Inject LanguageNameLookupFactory into WikibaseValueFormatterBuilders (T281726)]] [production]
13:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2108 (T342617)', diff saved to https://phabricator.wikimedia.org/P49968 and previous config saved to /var/cache/conftool/dbconfig/20230802-132632-ladsgroup.json [production]
13:26 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2108.codfw.wmnet with reason: Maintenance [production]
13:26 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:944898|uzwiki: Install WikiLove (T343270)]] (duration: 09m 58s) [production]
13:26 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: GitLab minor version upgrade [production]
13:26 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2108.codfw.wmnet with reason: Maintenance [production]
13:25 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host pc2015.codfw.wmnet with OS bullseye [production]
13:21 <pt1979@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti2014'] [production]
13:20 <lucaswerkmeister-wmde@deploy1002> stang and lucaswerkmeister-wmde: Continuing with sync [production]
13:17 <lucaswerkmeister-wmde@deploy1002> stang and lucaswerkmeister-wmde: Backport for [[gerrit:944898|uzwiki: Install WikiLove (T343270)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:16 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:944898|uzwiki: Install WikiLove (T343270)]] [production]
13:13 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php uzwiki wikilove # Create extension tables for Wikilove on uzwiki (T343270) [production]
13:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1184 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P49967 and previous config saved to /var/cache/conftool/dbconfig/20230802-131314-ladsgroup.json [production]
13:12 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ printf 'https://en.wikipedia.org/static/images/project-logos/simplewiktionary.png\n' | mwscript purgeList.php # T343084 [production]
13:11 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:942806|simplewiktionary: Update project logo (T343084)]] (duration: 08m 13s) [production]
13:06 <lucaswerkmeister-wmde@deploy1002> stang and lucaswerkmeister-wmde: Continuing with sync [production]
13:05 <lucaswerkmeister-wmde@deploy1002> stang and lucaswerkmeister-wmde: Backport for [[gerrit:942806|simplewiktionary: Update project logo (T343084)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:03 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:942806|simplewiktionary: Update project logo (T343084)]] [production]
12:58 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1184 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P49965 and previous config saved to /var/cache/conftool/dbconfig/20230802-125810-ladsgroup.json [production]
12:43 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1184 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P49964 and previous config saved to /var/cache/conftool/dbconfig/20230802-124305-ladsgroup.json [production]
12:42 <xcollazo@deploy1002> Finished deploy [airflow-dags/analytics_product@8bba01c]: Redeploy of analytics_product Airflow instance (duration: 00m 08s) [production]
12:42 <xcollazo@deploy1002> Started deploy [airflow-dags/analytics_product@8bba01c]: Redeploy of analytics_product Airflow instance [production]
12:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depool db1184 T342284', diff saved to https://phabricator.wikimedia.org/P49963 and previous config saved to /var/cache/conftool/dbconfig/20230802-123228-ladsgroup.json [production]
12:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1136 (T342617)', diff saved to https://phabricator.wikimedia.org/P49962 and previous config saved to /var/cache/conftool/dbconfig/20230802-122816-ladsgroup.json [production]
12:28 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
12:28 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
12:27 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127 (T342617)', diff saved to https://phabricator.wikimedia.org/P49961 and previous config saved to /var/cache/conftool/dbconfig/20230802-122756-ladsgroup.json [production]
12:21 <dcausse@deploy1002> Finished deploy [airflow-dags/search@8bba01c]: search: do not use hive partitions to wait for wmf_raw.mediawiki_page (duration: 00m 11s) [production]
12:21 <dcausse@deploy1002> Started deploy [airflow-dags/search@8bba01c]: search: do not use hive partitions to wait for wmf_raw.mediawiki_page [production]
12:19 <cgoubert@cumin1001> conftool action : set/pooled=inactive; selector: dc=eqiad,name=mw1498.eqiad.wmnet [production]
12:19 <cgoubert@cumin1001> conftool action : set/pooled=inactive; selector: dc=eqiad,name=mw1497.eqiad.wmnet [production]
12:19 <claime> Depool mw1497 and mw1498 for reimage as wikikube nodes - T343306 [production]
12:18 <eoghan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on people2003.codfw.wmnet with reason: Resizing disk [production]
12:17 <eoghan@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on people2003.codfw.wmnet with reason: Resizing disk [production]
12:13 <claime> Repool mw1451 and mw1452, more recent servers will be used - T343306 [production]
12:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127', diff saved to https://phabricator.wikimedia.org/P49960 and previous config saved to /var/cache/conftool/dbconfig/20230802-121249-ladsgroup.json [production]
12:11 <jelto> update gitlab-ce package to 16.0.8-ce.0 [production]
12:09 <cgoubert@cumin1001> conftool action : set/pooled=inactive; selector: dc=eqiad,name=mw1452.eqiad.wmnet [production]
12:09 <cgoubert@cumin1001> conftool action : set/pooled=inactive; selector: dc=eqiad,name=mw1451.eqiad.wmnet [production]
12:09 <claime> Depool mw1451 and mw1452 for reimage as wikikube nodes - T343306 [production]
11:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127', diff saved to https://phabricator.wikimedia.org/P49959 and previous config saved to /var/cache/conftool/dbconfig/20230802-115743-ladsgroup.json [production]
11:57 <jelto@cumin1001> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: GitLab minor version upgrade [production]
11:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127 (T342617)', diff saved to https://phabricator.wikimedia.org/P49958 and previous config saved to /var/cache/conftool/dbconfig/20230802-114237-ladsgroup.json [production]
11:41 <moritzm> installing libxml2 security updates [production]
11:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2100.codfw.wmnet with reason: Maintenance [production]
11:40 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2100.codfw.wmnet with reason: Maintenance [production]
11:40 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest2002.codfw.wmnet [production]