401-450 of 10000 results (26ms)
2025-11-27 ยง
13:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T410531)', diff saved to https://phabricator.wikimedia.org/P85885 and previous config saved to /var/cache/conftool/dbconfig/20251127-135251-marostegui.json [production]
13:48 <AntiComposite> CVNBot10 load tok.wikipedia tok: (T404567) [cvn]
13:48 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1221 (T410531)', diff saved to https://phabricator.wikimedia.org/P85884 and previous config saved to /var/cache/conftool/dbconfig/20251127-134816-marostegui.json [production]
13:48 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on 6 hosts with reason: Maintenance [production]
13:47 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1221.eqiad.wmnet with reason: Maintenance [production]
13:47 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T410531)', diff saved to https://phabricator.wikimedia.org/P85883 and previous config saved to /var/cache/conftool/dbconfig/20251127-134730-marostegui.json [production]
13:47 <AntiComposite> CVNBot9 load ms.wikiquote q:ms: (T404700) [cvn]
13:45 <AntiComposite> CVNBot8 load min.wikisource s:min: (T408343) [cvn]
13:44 <AntiComposite> CVNBot7 load pcm.wikiquote q:pcm: (T408351) [cvn]
13:43 <AntiComposite> CVNBot6 load tl.wikisource s:tl: (T388654) [cvn]
13:42 <AntiComposite> CVNBot10 load bew.wiktionary wikt:bew: (T402134) [cvn]
13:41 <AntiComposite> CVNBot9 load zgh.wiktionary wikt:zgh: (T399785) [cvn]
13:41 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:40 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:40 <AntiComposite> CVNBot8 load min.wikibooks b:min: (T395499) [cvn]
13:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P85881 and previous config saved to /var/cache/conftool/dbconfig/20251127-133947-marostegui.json [production]
13:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1165 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P85880 and previous config saved to /var/cache/conftool/dbconfig/20251127-133838-marostegui.json [production]
13:38 <AntiComposite> CVNBot7 load rki.wikipedia rki: (T392499) [cvn]
13:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
13:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
13:38 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repool db1165', diff saved to https://phabricator.wikimedia.org/P85879 and previous config saved to /var/cache/conftool/dbconfig/20251127-133813-marostegui.json [production]
13:37 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:37 <AntiComposite> CVNBot6 load mad.wikisource s:mad: (T391767) [cvn]
13:34 <taavi@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database tokwiki (T404570) [production]
13:34 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:34 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2172 (T410531)', diff saved to https://phabricator.wikimedia.org/P85878 and previous config saved to /var/cache/conftool/dbconfig/20251127-133411-marostegui.json [production]
13:34 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
13:34 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T410531)', diff saved to https://phabricator.wikimedia.org/P85877 and previous config saved to /var/cache/conftool/dbconfig/20251127-133347-marostegui.json [production]
13:32 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P85875 and previous config saved to /var/cache/conftool/dbconfig/20251127-133223-marostegui.json [production]
13:22 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P85873 and previous config saved to /var/cache/conftool/dbconfig/20251127-132226-marostegui.json [production]
13:18 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P85872 and previous config saved to /var/cache/conftool/dbconfig/20251127-131839-marostegui.json [production]
13:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P85871 and previous config saved to /var/cache/conftool/dbconfig/20251127-131715-marostegui.json [production]
13:14 <taavi@deploy2002> mwscript-k8s job started: initEditCount --wiki=tokwiki [production]
13:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P85870 and previous config saved to /var/cache/conftool/dbconfig/20251127-130719-marostegui.json [production]
13:05 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1165 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P85869 and previous config saved to /var/cache/conftool/dbconfig/20251127-130509-marostegui.json [production]
13:05 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
13:04 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
13:03 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P85868 and previous config saved to /var/cache/conftool/dbconfig/20251127-130332-marostegui.json [production]
13:02 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcumin1001.eqiad.wmnet [production]
13:02 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T410531)', diff saved to https://phabricator.wikimedia.org/P85867 and previous config saved to /var/cache/conftool/dbconfig/20251127-130208-marostegui.json [production]
12:58 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudcumin1001.eqiad.wmnet [production]
12:57 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 1aecb0fe93 (l10n updates: tg-cyrl) [tools.wd-image-positions]
12:48 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T410531)', diff saved to https://phabricator.wikimedia.org/P85866 and previous config saved to /var/cache/conftool/dbconfig/20251127-124824-marostegui.json [production]
12:43 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1199 (T410531)', diff saved to https://phabricator.wikimedia.org/P85865 and previous config saved to /var/cache/conftool/dbconfig/20251127-124353-marostegui.json [production]
12:43 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1199.eqiad.wmnet with reason: Maintenance [production]
12:43 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1190 (T410531)', diff saved to https://phabricator.wikimedia.org/P85864 and previous config saved to /var/cache/conftool/dbconfig/20251127-124330-marostegui.json [production]
12:34 <moritzm> installing sqlite3 security updates [production]
12:30 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1212119|hCaptcha: Handle requests without a token (T411166)]] (duration: 10m 50s) [production]