4851-4900 of 10000 results (79ms)
2022-12-09 §
02:39 <cwhite@deploy1002> rebuilt and synchronized wikiversions files: Revert "group2 wikis to 1.40.0-wmf.13" [production]
02:27 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2003.codfw.wmnet with OS buster [production]
02:27 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
02:23 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
02:11 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2003.codfw.wmnet with reason: host reimage [production]
02:08 <eevans@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2003.codfw.wmnet with reason: host reimage [production]
01:49 <eevans@cumin1001> START - Cookbook sre.hosts.reimage for host cassandra-dev2003.codfw.wmnet with OS buster [production]
01:48 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2002.codfw.wmnet with OS buster [production]
01:48 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
01:47 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
01:33 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
01:30 <eevans@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
01:11 <eevans@cumin1001> START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS buster [production]
01:07 <eevans@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cassandra-dev2003 [production]
01:06 <eevans@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cassandra-dev2003 [production]
01:06 <eevans@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cassandra-dev2002 [production]
01:05 <eevans@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cassandra-dev2002 [production]
01:05 <eevans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
01:05 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Rename restbase-dev200x hosts to cassandra-dev200x - eevans@cumin1001" [production]
01:04 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Rename restbase-dev200x hosts to cassandra-dev200x - eevans@cumin1001" [production]
01:01 <eevans@cumin1001> START - Cookbook sre.dns.netbox [production]
00:47 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts restbase-dev2003.codfw.wmnet [production]
00:46 <eevans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
00:46 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase-dev2003.codfw.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
00:45 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase-dev2003.codfw.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
00:43 <eevans@cumin1001> START - Cookbook sre.dns.netbox [production]
00:39 <eevans@cumin1001> START - Cookbook sre.hosts.decommission for hosts restbase-dev2003.codfw.wmnet [production]
00:38 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts restbase-dev2002.codfw.wmnet [production]
00:38 <eevans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
00:38 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase-dev2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
00:37 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase-dev2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
00:34 <eevans@cumin1001> START - Cookbook sre.dns.netbox [production]
00:30 <eevans@cumin1001> START - Cookbook sre.hosts.decommission for hosts restbase-dev2002.codfw.wmnet [production]
2022-12-08 §
23:32 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:866470|Make wikibase.client.init module target mobile (T235712)]] (duration: 08m 42s) [production]
23:25 <ladsgroup@deploy1002> ladsgroup and ladsgroup: Backport for [[gerrit:866470|Make wikibase.client.init module target mobile (T235712)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
23:23 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:866470|Make wikibase.client.init module target mobile (T235712)]] [production]
23:14 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2001.codfw.wmnet with OS buster [production]
23:14 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
23:13 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - eevans@cumin1001" [production]
23:11 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:866469|File pages: Add mobile targets to modules that are silently being removed (T324723 T320518)]] (duration: 09m 12s) [production]
23:03 <ladsgroup@deploy1002> ladsgroup and ladsgroup: Backport for [[gerrit:866469|File pages: Add mobile targets to modules that are silently being removed (T324723 T320518)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
23:02 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:866469|File pages: Add mobile targets to modules that are silently being removed (T324723 T320518)]] [production]
22:58 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2001.codfw.wmnet with reason: host reimage [production]
22:55 <eevans@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2001.codfw.wmnet with reason: host reimage [production]
22:37 <eevans@cumin1001> START - Cookbook sre.hosts.reimage for host cassandra-dev2001.codfw.wmnet with OS buster [production]
22:29 <ryankemper@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - ryankemper@cumin1001 - T322776 [production]
22:28 <TheresNoTime> close UTC late backport and config training (+28m) [production]
22:27 <samtar@deploy1002> Finished scap: Backport for [[gerrit:866502|Start mobile DiscussionTools A/B test (T321961)]] (duration: 09m 57s) [production]
22:19 <samtar@deploy1002> samtar and matmarex: Backport for [[gerrit:866502|Start mobile DiscussionTools A/B test (T321961)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
22:17 <samtar@deploy1002> Started scap: Backport for [[gerrit:866502|Start mobile DiscussionTools A/B test (T321961)]] [production]