251-300 of 10000 results (73ms)
2023-04-06 §
00:50 <urandom> rebooting sessionstore1001 — T327954 [production]
00:18 <urandom> rebooting Cassandra on sessionstore1001 — T327954 [production]
2023-04-05 §
23:58 <legoktm@deploy2002> Finished scap: Backport for [[gerrit:804805|Remove misleading "disable" of Special:Mostlinkedcategories (T310456)]] (duration: 07m 55s) [production]
23:55 <urandom> rebooting Cassandra on sessionstore1001 — T327954 [production]
23:52 <legoktm@deploy2002> legoktm: Backport for [[gerrit:804805|Remove misleading "disable" of Special:Mostlinkedcategories (T310456)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
23:50 <legoktm@deploy2002> Started scap: Backport for [[gerrit:804805|Remove misleading "disable" of Special:Mostlinkedcategories (T310456)]] [production]
23:44 <legoktm@deploy2002> Finished scap: Backport for [[gerrit:896837|Add <link rel="me"> to verify Mastodon account on mediawiki.org]] (duration: 07m 47s) [production]
23:38 <legoktm@deploy2002> legoktm: Backport for [[gerrit:896837|Add <link rel="me"> to verify Mastodon account on mediawiki.org]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
23:36 <legoktm@deploy2002> Started scap: Backport for [[gerrit:896837|Add <link rel="me"> to verify Mastodon account on mediawiki.org]] [production]
22:36 <topranks> enabling lsw1-e1-eqiad port et-0/0/51 to ssw1-e1-eqiad et-0/0/80 T322937 [production]
22:33 <urandom> rebooting Cassandra on sessionstore1001 — T327954 [production]
22:20 <urandom> restarting Cassandra on sessionstore1001 to apply (intentionally) unreachable native transport — T327954 [production]
22:05 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs5005.eqsin.wmnet with OS bullseye [production]
21:45 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs5005.eqsin.wmnet with reason: host reimage [production]
21:41 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs5005.eqsin.wmnet with reason: host reimage [production]
21:31 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:31 <cmooney@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for ssw link addresses in eqiad - cmooney@cumin1001" [production]
21:30 <cmooney@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for ssw link addresses in eqiad - cmooney@cumin1001" [production]
21:28 <cjming> end of UTC late backport window [production]
21:23 <cjming@deploy2002> Finished scap: Backport for [[gerrit:905960|[mgwiki] Replace the wordmark on Vector 2022 (T334022)]] (duration: 07m 58s) [production]
21:21 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
21:16 <cjming@deploy2002> superpes and cjming: Backport for [[gerrit:905960|[mgwiki] Replace the wordmark on Vector 2022 (T334022)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
21:16 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host lvs5005.eqsin.wmnet with OS bullseye [production]
21:15 <cjming@deploy2002> Started scap: Backport for [[gerrit:905960|[mgwiki] Replace the wordmark on Vector 2022 (T334022)]] [production]
21:10 <cjming@deploy2002> Finished scap: Backport for [[gerrit:905769|Add static mobile United_States page to facilitate synthetic testing of T331681 (T331681)]] (duration: 10m 06s) [production]
21:10 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:10 <cmooney@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for ssw link addresses in eqiad - cmooney@cumin1001" [production]
21:09 <cmooney@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for ssw link addresses in eqiad - cmooney@cumin1001" [production]
21:07 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
21:02 <cjming@deploy2002> cjming and nray: Backport for [[gerrit:905769|Add static mobile United_States page to facilitate synthetic testing of T331681 (T331681)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
21:01 <cjming> UTC late backport & config window continuing [production]
21:00 <cjming@deploy2002> Started scap: Backport for [[gerrit:905769|Add static mobile United_States page to facilitate synthetic testing of T331681 (T331681)]] [production]
20:58 <cjming@deploy2002> Finished scap: Backport for [[gerrit:896936|Undeploy SimilarEditors from Beta (T331718)]] (duration: 35m 41s) [production]
20:57 <brett> Disable Puppet/PyBal on lvs5005 in preparation for reimaging - T321309 [production]
20:44 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs5004.eqsin.wmnet with OS bullseye [production]
20:44 <cjming@deploy2002> tsepothoabala and cjming: Backport for [[gerrit:896936|Undeploy SimilarEditors from Beta (T331718)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:24 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs5004.eqsin.wmnet with reason: host reimage [production]
20:22 <cjming@deploy2002> Started scap: Backport for [[gerrit:896936|Undeploy SimilarEditors from Beta (T331718)]] [production]
20:21 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs5004.eqsin.wmnet with reason: host reimage [production]
20:17 <mforns@deploy2002> Finished deploy [airflow-dags/analytics@2192f15]: (no justification provided) (duration: 00m 12s) [production]
20:17 <mforns@deploy2002> Started deploy [airflow-dags/analytics@2192f15]: (no justification provided) [production]
20:03 <mforns@deploy2002> Finished deploy [analytics/refinery@eb4c2b2] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@eb4c2b2] (duration: 01m 34s) [production]
20:01 <mforns@deploy2002> Started deploy [analytics/refinery@eb4c2b2] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@eb4c2b2] [production]
20:01 <mforns@deploy2002> Finished deploy [analytics/refinery@eb4c2b2] (thin): Regular analytics weekly train THIN [analytics/refinery@eb4c2b2] (duration: 00m 08s) [production]
20:01 <mforns@deploy2002> Started deploy [analytics/refinery@eb4c2b2] (thin): Regular analytics weekly train THIN [analytics/refinery@eb4c2b2] [production]
20:01 <mforns@deploy2002> Finished deploy [analytics/refinery@eb4c2b2]: Regular analytics weekly train [analytics/refinery@eb4c2b2] (duration: 06m 26s) [production]
19:54 <mforns@deploy2002> Started deploy [analytics/refinery@eb4c2b2]: Regular analytics weekly train [analytics/refinery@eb4c2b2] [production]
19:52 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host lvs5004.eqsin.wmnet with OS bullseye [production]
19:30 <brett> Disable Puppet/PyBal on lvs5004 in preparation for reimaging - T321309 [production]
19:27 <mforns@deploy2002> Finished deploy [analytics/refinery@944a995] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@944a995] (duration: 01m 29s) [production]