2501-2550 of 10000 results (127ms)
2025-04-14 §
18:27 <jforrester@deploy1003> jforrester: Continuing with sync [production]
18:27 <James_F> Run `mwscript sql --wiki=testwiki /srv/mediawiki-staging/php-1.44.0-wmf.24/extensions/WikiLambda/sql/mysql/table-usage.sql` for T391885 [production]
18:24 <jforrester@deploy1003> jforrester: Backport for [[gerrit:1136368|Complete our RecentChanges entry generation and formatting (T386020)]], [[gerrit:1136379|Switch test Wikifunctions client deployment from test2wiki to test2iki (T391584)]], [[gerrit:1136380|Document Wikifunctions options, adding wgWikiLambdaClientModeOffline (T391584)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:18 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2190 (T391056)', diff saved to https://phabricator.wikimedia.org/P74982 and previous config saved to /var/cache/conftool/dbconfig/20250414-181802-fceratto.json [production]
18:17 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2190.codfw.wmnet with reason: Maintenance [production]
18:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T391056)', diff saved to https://phabricator.wikimedia.org/P74981 and previous config saved to /var/cache/conftool/dbconfig/20250414-181740-fceratto.json [production]
18:05 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1136368|Complete our RecentChanges entry generation and formatting (T386020)]], [[gerrit:1136379|Switch test Wikifunctions client deployment from test2wiki to test2iki (T391584)]], [[gerrit:1136380|Document Wikifunctions options, adding wgWikiLambdaClientModeOffline (T391584)]] [production]
18:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P74980 and previous config saved to /var/cache/conftool/dbconfig/20250414-180232-fceratto.json [production]
17:47 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P74979 and previous config saved to /var/cache/conftool/dbconfig/20250414-174725-fceratto.json [production]
17:32 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T391056)', diff saved to https://phabricator.wikimedia.org/P74978 and previous config saved to /var/cache/conftool/dbconfig/20250414-173218-fceratto.json [production]
17:30 <swfrench-wmf> running: cumin -b8 -s60 'A:cp-text' 'run-puppet-agent -e "merging ATS config change - T391421"' [production]
17:25 <hashar@deploy1003> Finished deploy [integration/docroot@e92740c]: opensource: remove OOjs Router - T358813 (duration: 00m 10s) [production]
17:25 <hashar@deploy1003> Started deploy [integration/docroot@e92740c]: opensource: remove OOjs Router - T358813 [production]
17:25 <swfrench-wmf> running: run-puppet-agent -e "merging ATS config change - T391421" on cp4040 [production]
17:20 <swfrench-wmf> running: cumin 'A:cp-text' 'disable-puppet "merging ATS config change - T391421"' [production]
17:17 <swfrench@deploy1003> Finished scap sync-world: Backport for [[gerrit:1135507|Remove PHP 8.1 migration WikimediaEvents settings (T391421)]] (duration: 13m 10s) [production]
17:16 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2177 (T391056)', diff saved to https://phabricator.wikimedia.org/P74977 and previous config saved to /var/cache/conftool/dbconfig/20250414-171622-fceratto.json [production]
17:16 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
17:15 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T391056)', diff saved to https://phabricator.wikimedia.org/P74976 and previous config saved to /var/cache/conftool/dbconfig/20250414-171558-fceratto.json [production]
17:10 <swfrench@deploy1003> swfrench: Continuing with sync [production]
17:10 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1181.eqiad.wmnet with OS bullseye [production]
17:08 <swfrench@deploy1003> swfrench: Backport for [[gerrit:1135507|Remove PHP 8.1 migration WikimediaEvents settings (T391421)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
17:04 <swfrench@deploy1003> Started scap sync-world: Backport for [[gerrit:1135507|Remove PHP 8.1 migration WikimediaEvents settings (T391421)]] [production]
17:00 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P74975 and previous config saved to /var/cache/conftool/dbconfig/20250414-170052-fceratto.json [production]
16:56 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload_magru [production]
16:56 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text_magru [production]
16:45 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P74974 and previous config saved to /var/cache/conftool/dbconfig/20250414-164545-fceratto.json [production]
16:38 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1181.eqiad.wmnet with OS bullseye [production]
16:30 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T391056)', diff saved to https://phabricator.wikimedia.org/P74973 and previous config saved to /var/cache/conftool/dbconfig/20250414-163037-fceratto.json [production]
16:21 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1181.eqiad.wmnet with OS bullseye [production]
16:15 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2156 (T391056)', diff saved to https://phabricator.wikimedia.org/P74972 and previous config saved to /var/cache/conftool/dbconfig/20250414-161512-fceratto.json [production]
16:15 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
16:14 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
16:14 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T391056)', diff saved to https://phabricator.wikimedia.org/P74971 and previous config saved to /var/cache/conftool/dbconfig/20250414-161432-fceratto.json [production]
16:06 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1181.eqiad.wmnet with OS bullseye [production]
16:05 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1181.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:03 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text_ulsfo and not P{cp4037.ulsfo.wmnet} and A:cp [production]
15:59 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P74970 and previous config saved to /var/cache/conftool/dbconfig/20250414-155925-fceratto.json [production]
15:58 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1181.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
15:57 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1181.eqiad.wmnet with OS bullseye [production]
15:56 <fceratto@dns1004> END - running authdns-update [production]
15:53 <fceratto@dns1004> START - running authdns-update [production]
15:45 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P74969 and previous config saved to /var/cache/conftool/dbconfig/20250414-154419-fceratto.json [production]
15:44 <fceratto@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:43 <fceratto@cumin1002> START - Cookbook sre.dns.netbox [production]
15:40 <fceratto@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:37 <urandom> bootstrapping Cassandra/restbase1044-a — T389423 [production]
15:37 <fceratto@cumin1002> START - Cookbook sre.dns.netbox [production]
15:32 <eevans@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase1044.eqiad.wmnet with reason: Bootstrapping — T389423 [production]
15:30 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload_ulsfo and not P{cp4047.ulsfo.wmnet} and not P{cp4045.ulsfo.wmnet} and A:cp [production]