401-450 of 10000 results (92ms)
2025-10-01 ยง
09:21 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T401906)', diff saved to https://phabricator.wikimedia.org/P83529 and previous config saved to /var/cache/conftool/dbconfig/20251001-092112-fceratto.json [production]
09:17 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
09:17 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply [production]
09:14 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:14 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:12 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:11 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:06 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:06 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:06 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P83528 and previous config saved to /var/cache/conftool/dbconfig/20251001-090604-fceratto.json [production]
08:57 <elukey@puppetserver1001> conftool action : set/pooled=true; selector: dnsdisc=kartotherian,name=codfw [production]
08:50 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P83527 and previous config saved to /var/cache/conftool/dbconfig/20251001-085056-fceratto.json [production]
08:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T401906)', diff saved to https://phabricator.wikimedia.org/P83526 and previous config saved to /var/cache/conftool/dbconfig/20251001-083549-fceratto.json [production]
08:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1162 (T401906)', diff saved to https://phabricator.wikimedia.org/P83525 and previous config saved to /var/cache/conftool/dbconfig/20251001-083435-fceratto.json [production]
08:34 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1162.eqiad.wmnet with reason: Maintenance [production]
08:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1156 (T401906)', diff saved to https://phabricator.wikimedia.org/P83524 and previous config saved to /var/cache/conftool/dbconfig/20251001-083412-fceratto.json [production]
08:19 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad [production]
08:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1156', diff saved to https://phabricator.wikimedia.org/P83523 and previous config saved to /var/cache/conftool/dbconfig/20251001-081905-fceratto.json [production]
08:13 <mvernon@cumin2002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad [production]
08:10 <Emperor> restart swift on ms-fe2012 T360913 [production]
08:08 <bwojtowicz@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
08:03 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1156', diff saved to https://phabricator.wikimedia.org/P83522 and previous config saved to /var/cache/conftool/dbconfig/20251001-080357-fceratto.json [production]
07:48 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1156 (T401906)', diff saved to https://phabricator.wikimedia.org/P83521 and previous config saved to /var/cache/conftool/dbconfig/20251001-074850-fceratto.json [production]
07:47 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1156 (T401906)', diff saved to https://phabricator.wikimedia.org/P83520 and previous config saved to /var/cache/conftool/dbconfig/20251001-074736-fceratto.json [production]
07:47 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
07:47 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1156.eqiad.wmnet with reason: Maintenance [production]
07:10 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192666|CreateAccount: Track interactions with the captchaWord field (T394744)]], [[gerrit:1192668|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]] (duration: 14m 09s) [production]
07:05 <kharlan@deploy2002> kharlan: Continuing with sync [production]
07:02 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1192666|CreateAccount: Track interactions with the captchaWord field (T394744)]], [[gerrit:1192668|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
06:55 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1192666|CreateAccount: Track interactions with the captchaWord field (T394744)]], [[gerrit:1192668|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]] [production]
06:40 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192670|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]], [[gerrit:1192667|CreateAccount: Track interactions with the captchaWord field (T394744)]] (duration: 22m 34s) [production]
06:35 <kharlan@deploy2002> kharlan: Continuing with sync [production]
06:22 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1192670|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]], [[gerrit:1192667|CreateAccount: Track interactions with the captchaWord field (T394744)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
06:17 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1192670|CreateAccount: Record the CAPTCHA class used in account creation funnel (T405239)]], [[gerrit:1192667|CreateAccount: Track interactions with the captchaWord field (T394744)]] [production]
04:54 <TimStarling> on x1 metawiki creating tables for CommunityRequests [production]
02:31 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192657|AbstractRenderer: fix extistence dependency on Votes subpage]] (duration: 12m 19s) [production]
02:26 <musikanimal@deploy2002> musikanimal: Continuing with sync [production]
02:26 <musikanimal@deploy2002> musikanimal: Backport for [[gerrit:1192657|AbstractRenderer: fix extistence dependency on Votes subpage]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
02:19 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1192657|AbstractRenderer: fix extistence dependency on Votes subpage]] [production]
01:52 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192655|Call WikiPage::doPurge to try and clear cache after language is set (T404748)]] (duration: 10m 47s) [production]
01:47 <musikanimal@deploy2002> musikanimal: Continuing with sync [production]
01:46 <musikanimal@deploy2002> musikanimal: Backport for [[gerrit:1192655|Call WikiPage::doPurge to try and clear cache after language is set (T404748)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:41 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1192655|Call WikiPage::doPurge to try and clear cache after language is set (T404748)]] [production]
01:28 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192652|migrateFromGadget: add a few more missing transformations (T405826 T404138 T404234)]] (duration: 10m 53s) [production]
01:23 <musikanimal@deploy2002> musikanimal: Continuing with sync [production]
01:22 <musikanimal@deploy2002> musikanimal: Backport for [[gerrit:1192652|migrateFromGadget: add a few more missing transformations (T405826 T404138 T404234)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:17 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1192652|migrateFromGadget: add a few more missing transformations (T405826 T404138 T404234)]] [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 33s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
00:37 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dbprov1007.eqiad.wmnet with OS bookworm [production]