3001-3050 of 10000 results (76ms)
2022-06-28 ยง
17:11 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1478.eqiad.wmnet with reason: host reimage [production]
17:11 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1470.eqiad.wmnet with reason: host reimage [production]
17:10 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1476.eqiad.wmnet with reason: host reimage [production]
17:10 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1474.eqiad.wmnet with reason: host reimage [production]
17:10 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1473.eqiad.wmnet with reason: host reimage [production]
17:08 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1471.eqiad.wmnet with reason: host reimage [production]
17:08 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1470.eqiad.wmnet with reason: host reimage [production]
17:05 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1472.eqiad.wmnet with OS buster [production]
17:04 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
17:04 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
17:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
17:03 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1484.eqiad.wmnet with OS buster [production]
17:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
17:03 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1483.eqiad.wmnet with OS buster [production]
17:02 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1482.eqiad.wmnet with OS buster [production]
17:02 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1481.eqiad.wmnet with OS buster [production]
17:01 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1480.eqiad.wmnet with OS buster [production]
17:01 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1479.eqiad.wmnet with OS buster [production]
17:00 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1478.eqiad.wmnet with OS buster [production]
16:59 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1476.eqiad.wmnet with OS buster [production]
16:59 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1474.eqiad.wmnet with OS buster [production]
16:59 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1473.eqiad.wmnet with OS buster [production]
16:58 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1471.eqiad.wmnet with OS buster [production]
16:57 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host cloudcontrol2005-dev.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:57 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host mw1470.eqiad.wmnet with OS buster [production]
16:53 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:49 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:11 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:10 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
16:08 <sukhe> enable puppet on P{R:Class = bird} (complete rollback of Ieab3abb6) [production]
16:07 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:04 <dancy@deploy1002> Installation of scap version "4.10.0" completed for 561 hosts [production]
16:04 <dancy@deploy1002> Installing scap version "4.10.0" for 561 hosts [production]
15:59 <papaul> PDU maintenance in RAck D1 codfw complete [production]
15:54 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:50 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
15:37 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
15:36 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
15:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
15:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:22 <urbanecm@deploy1002> Synchronized wmf-config/: ensuring wmf-config is up2date at appservers (at least mw1417/mw1418 have old config) (duration: 03m 39s) [production]
15:13 <sukhe> upload prometheus-bird-exporter (1.2.2-1wm1) buster-wikimedia - T310574 [production]
14:49 <sukhe> disable puppet on P{R:Class = bird} [production]
14:39 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1462.eqiad.wmnet with OS buster [production]
14:32 <papaul> on going PDU maintenance in RACk D1 codfw [production]
14:32 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1468.eqiad.wmnet with OS buster [production]
14:29 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1464.eqiad.wmnet with OS buster [production]
14:29 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1461.eqiad.wmnet with OS buster [production]
14:27 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1460.eqiad.wmnet with OS buster [production]
14:26 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1466.eqiad.wmnet with OS buster [production]