1-50 of 10000 results (26ms)
2026-04-15 ยง
22:15 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1271945|PageRenderingHandler: Don't run repo-mode lang check in non-repo world either (T423515)]] (duration: 08m 48s) [production]
22:12 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1221 (T419635)', diff saved to https://phabricator.wikimedia.org/P90845 and previous config saved to /var/cache/conftool/dbconfig/20260415-221216-fceratto.json [production]
22:11 <jforrester@deploy1003> jforrester: Continuing with sync [production]
22:08 <jforrester@deploy1003> jforrester: Backport for [[gerrit:1271945|PageRenderingHandler: Don't run repo-mode lang check in non-repo world either (T423515)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:06 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1271945|PageRenderingHandler: Don't run repo-mode lang check in non-repo world either (T423515)]] [production]
21:50 <eileen> civicrm upgraded from 6f33b6d0 to 801847a7 [fundraising]
21:29 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for aqs1027.eqiad.wmnet [production]
21:29 <eevans@cumin1003> START - Cookbook sre.hosts.remove-downtime for aqs1027.eqiad.wmnet [production]
21:14 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
21:13 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
21:13 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:13 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.24 refs T420482 [production]
21:13 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:12 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:12 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:07 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
21:06 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:06 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
21:06 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on cloudelastic1012.eqiad.wmnet with reason: still fixing Puppet [production]
21:06 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:05 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:05 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
21:05 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:05 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:05 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:04 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:04 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
21:04 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:04 <swfrench@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
21:03 <swfrench@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
21:03 <swfrench@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
21:02 <swfrench@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
20:58 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1271894|PageRenderingHandler: Handle Wikibase's OutOfBoundsException for "we don't have a label" (T423514)]], [[gerrit:1271905|PageRenderingHandler: Don't run repo-mode stuff in non-repo world (T423515)]] (duration: 06m 08s) [production]
20:54 <jforrester@deploy1003> jforrester: Continuing with sync [production]
20:53 <jforrester@deploy1003> jforrester: Backport for [[gerrit:1271894|PageRenderingHandler: Handle Wikibase's OutOfBoundsException for "we don't have a label" (T423514)]], [[gerrit:1271905|PageRenderingHandler: Don't run repo-mode stuff in non-repo world (T423515)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:52 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1271894|PageRenderingHandler: Handle Wikibase's OutOfBoundsException for "we don't have a label" (T423514)]], [[gerrit:1271905|PageRenderingHandler: Don't run repo-mode stuff in non-repo world (T423515)]] [production]
20:46 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1268300|Drop 1.5x logos (T246054)]], [[gerrit:1271839|Enwikinews: disable lingering FlaggedRevs template processing (T423512)]], [[gerrit:1270583|Record file usage from TemplateStyles pages (T413707)]] (duration: 09m 15s) [production]
20:42 <jforrester@deploy1003> jforrester, bawolff, pppery: Continuing with sync [production]
20:42 <topranks> enable BGP over GRE between cr1-drmrs and cr2-eqiad [production]
20:38 <jforrester@deploy1003> jforrester, bawolff, pppery: Backport for [[gerrit:1268300|Drop 1.5x logos (T246054)]], [[gerrit:1271839|Enwikinews: disable lingering FlaggedRevs template processing (T423512)]], [[gerrit:1270583|Record file usage from TemplateStyles pages (T413707)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:36 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1268300|Drop 1.5x logos (T246054)]], [[gerrit:1271839|Enwikinews: disable lingering FlaggedRevs template processing (T423512)]], [[gerrit:1270583|Record file usage from TemplateStyles pages (T413707)]] [production]
20:36 <wmbot~lokal-profil@tools-bastion-15> Deploy 244e67c [tools.heritage]
20:36 <cmooney@dns2005> END - running authdns-update [production]
20:35 <cmooney@dns2005> START - running authdns-update [production]
20:34 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:34 <cmooney@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: generate v6 reverse records for 2a02:ec80:600:fe0a::1/64 - cmooney@cumin1003" [production]
20:33 <cmooney@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: generate v6 reverse records for 2a02:ec80:600:fe0a::1/64 - cmooney@cumin1003" [production]
20:30 <mstyles@deploy1003> Finished scap sync-world: Backport for [[gerrit:1271886|Force Reauth (T419621)]], [[gerrit:1271830|Rename Test Kitchen Experiment (T420007)]], [[gerrit:1271831|Rename Test Kitchen Experiment (T420007)]], [[gerrit:1271833|Rename Test Kitchen Experiment (T420007)]], [[gerrit:1271832|Rename Test Kitchen Experiment (T420007)]] (duration: 07m 48s) [production]
20:30 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
20:27 <mstyles@deploy1003> mstyles: Continuing with sync [production]