351-400 of 10000 results (97ms)
2025-11-26 ยง
18:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2168 (T410531)', diff saved to https://phabricator.wikimedia.org/P85779 and previous config saved to /var/cache/conftool/dbconfig/20251126-183031-marostegui.json [production]
18:30 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2168.codfw.wmnet with reason: Maintenance [production]
18:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410531)', diff saved to https://phabricator.wikimedia.org/P85778 and previous config saved to /var/cache/conftool/dbconfig/20251126-183007-marostegui.json [production]
18:19 <Dreamy_Jazz> Deployed private code change for T410300 [production]
18:15 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P85775 and previous config saved to /var/cache/conftool/dbconfig/20251126-181500-marostegui.json [production]
18:01 <taavi@deploy2002> mwscript-k8s job started: rebuildall.php --wiki=tokwiki # T404573 [production]
18:00 <taavi@deploy2002> mwscript-k8s job started: initSiteStats.php --wiki=tokwiki # T404573 [production]
18:00 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211737|Add SuggestedInvestigationsRevisionsPager (T410300)]], [[gerrit:1211735|Add SuggestedInvestigationsRevisionsPager (T410300)]] (duration: 07m 03s) [production]
17:59 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P85774 and previous config saved to /var/cache/conftool/dbconfig/20251126-175952-marostegui.json [production]
17:56 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
17:55 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1211737|Add SuggestedInvestigationsRevisionsPager (T410300)]], [[gerrit:1211735|Add SuggestedInvestigationsRevisionsPager (T410300)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:53 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1211737|Add SuggestedInvestigationsRevisionsPager (T410300)]], [[gerrit:1211735|Add SuggestedInvestigationsRevisionsPager (T410300)]] [production]
17:44 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410531)', diff saved to https://phabricator.wikimedia.org/P85773 and previous config saved to /var/cache/conftool/dbconfig/20251126-174445-marostegui.json [production]
17:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2159 (T410531)', diff saved to https://phabricator.wikimedia.org/P85772 and previous config saved to /var/cache/conftool/dbconfig/20251126-173857-marostegui.json [production]
17:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2159.codfw.wmnet with reason: Maintenance [production]
17:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T410531)', diff saved to https://phabricator.wikimedia.org/P85771 and previous config saved to /var/cache/conftool/dbconfig/20251126-173833-marostegui.json [production]
17:34 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211721|hCaptcha: Log the hCaptcha token (T411096)]] (duration: 08m 15s) [production]
17:32 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
17:30 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
17:29 <kharlan@deploy2002> kharlan: Continuing with sync [production]
17:28 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1211721|hCaptcha: Log the hCaptcha token (T411096)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:25 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1211721|hCaptcha: Log the hCaptcha token (T411096)]] [production]
17:23 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P85770 and previous config saved to /var/cache/conftool/dbconfig/20251126-172325-marostegui.json [production]
17:18 <taavi> taavi@deploy2002 ~ $ mwscript importDump.php --wiki=tokwiki --no-updates --username-prefix="" < /home/taavi/tokwiki/wikipesija-2025-11-26-rewritten.xml # T404573 [production]
17:15 <jgleeson> payments-wiki upgraded from f254a5ab to bb179e9c [production]
17:08 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P85769 and previous config saved to /var/cache/conftool/dbconfig/20251126-170817-marostegui.json [production]
17:00 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db1197 (T410589)', diff saved to https://phabricator.wikimedia.org/P85768 and previous config saved to /var/cache/conftool/dbconfig/20251126-170054-ladsgroup.json [production]
17:00 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1197.eqiad.wmnet with reason: Maintenance [production]
17:00 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1188 (T410589)', diff saved to https://phabricator.wikimedia.org/P85766 and previous config saved to /var/cache/conftool/dbconfig/20251126-170031-ladsgroup.json [production]
16:53 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T410531)', diff saved to https://phabricator.wikimedia.org/P85765 and previous config saved to /var/cache/conftool/dbconfig/20251126-165309-marostegui.json [production]
16:52 <fnegri@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1017.eqiad.wmnet [production]
16:52 <fnegri@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1018.eqiad.wmnet [production]
16:52 <fnegri@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1019.eqiad.wmnet [production]
16:51 <moritzm> installing Perl security updates [production]
16:48 <fnegri@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1020.eqiad.wmnet [production]
16:47 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2150 (T410531)', diff saved to https://phabricator.wikimedia.org/P85764 and previous config saved to /var/cache/conftool/dbconfig/20251126-164722-marostegui.json [production]
16:47 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2150.codfw.wmnet with reason: Maintenance [production]
16:46 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1236.eqiad.wmnet with reason: Maintenance [production]
16:46 <ejegg> donorwiki upgraded from 2a73a08d to bb179e9c [production]
16:45 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P85763 and previous config saved to /var/cache/conftool/dbconfig/20251126-164523-ladsgroup.json [production]
16:45 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) lswtest-d8-eqiad.mgmt.eqiad.wmnet on all recursors [production]
16:45 <cmooney@cumin1003> START - Cookbook sre.dns.wipe-cache lswtest-d8-eqiad.mgmt.eqiad.wmnet on all recursors [production]
16:45 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:45 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:36 <taavi@deploy2002> mwscript-k8s job started: foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https # T404571 [production]
16:36 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lswtest-d8-eqiad [production]
16:36 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device lswtest-d8-eqiad [production]
16:35 <taavi@deploy2002> Finished scap sync-world: Backport for [[gerrit:1205956|Set up tokwiki namespaces (T404457)]] (duration: 08m 17s) [production]
16:30 <taavi@deploy2002> taavi: Continuing with sync [production]
16:30 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P85762 and previous config saved to /var/cache/conftool/dbconfig/20251126-163015-ladsgroup.json [production]