1451-1500 of 10000 results (13ms)
2024-09-05 §
08:21 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:18 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:08 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:08 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
07:55 <elukey> re-enabling puppet on all nodes after puppetdb restarts [production]
07:39 <elukey> restart puppetdb on puppetdb[12]003 to pick up the new jvm [production]
07:15 <elukey> disable puppet fleetwide to restart puppetdb jvms (without impacting ongoing puppet runs, getting noise etc..) [production]
2024-09-04 §
16:02 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:58 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:14 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:11 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:06 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:02 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
08:19 <elukey> upgrade ruby-nokogiri on serpens and seaborgium for security upgrades [production]
2024-09-03 §
13:58 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:55 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:54 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:51 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:48 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:45 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:37 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:34 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:29 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:25 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:20 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:16 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:10 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:07 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:02 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:02 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:57 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:56 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:45 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:45 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:18 <elukey> upgrade spicerack to 8.12.0 on cumin1002 [production]
08:13 <elukey> upgrade python3-nbconvert on various DE hosts for security upgrades [production]
2024-09-02 §
15:51 <elukey> spicerack 8.12.0 installed on cumin2002 [production]
15:50 <elukey> uploaded spicerack_8.12.0 to apt.wikimedia.org bullseye-wikimedia [production]
09:14 <elukey> update netboot images for Bullseye and Bookworm point releases (11.11 and 12.7) following https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Debian-installer [production]
09:01 <elukey> restart puppetserver on puppetserver1002 to pick up new JVM settings - T373527 [production]
2024-08-30 §
10:06 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/services/proton: sync [production]
10:04 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/services/proton: sync [production]
09:59 <elukey@deploy1003> helmfile [codfw] DONE helmfile.d/services/proton: sync [production]
09:58 <elukey@deploy1003> helmfile [codfw] START helmfile.d/services/proton: sync [production]
09:56 <elukey@deploy1003> helmfile [staging] DONE helmfile.d/services/proton: sync [production]
09:55 <elukey@deploy1003> helmfile [staging] START helmfile.d/services/proton: sync [production]
09:43 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
09:39 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
09:27 <elukey@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: sync [production]
09:21 <elukey@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: sync [production]