901-950 of 10000 results (105ms)
2023-05-04 ยง
08:47 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1121.eqiad.wmnet with reason: Maintenance [production]
08:46 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2099.codfw.wmnet with reason: Maintenance [production]
08:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2099.codfw.wmnet with reason: Maintenance [production]
08:40 <akosiaris@deploy1002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
08:40 <akosiaris@deploy1002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
08:37 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for kubernetes1006.eqiad.wmnet [production]
08:37 <cgoubert@cumin1001> START - Cookbook sre.hosts.remove-downtime for kubernetes1006.eqiad.wmnet [production]
08:14 <cgoubert@cumin1001> START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:wikikube-worker-eqiad [production]
08:07 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
08:07 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
08:04 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:914393|[Growth] Deploy Personalized praise to AR, BN, CS (T334630)]] (duration: 07m 24s) [production]
07:58 <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:914393|[Growth] Deploy Personalized praise to AR, BN, CS (T334630)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
07:57 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:914393|[Growth] Deploy Personalized praise to AR, BN, CS (T334630)]] [production]
07:57 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db1132.eqiad.wmnet with reason: Onsite maintenance T334722 [production]
07:56 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db1132.eqiad.wmnet with reason: Onsite maintenance T334722 [production]
07:56 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:914305|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914837|Mentor dashboard: Move away from alpha/beta/stable (T334630)]] (duration: 07m 08s) [production]
07:50 <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:914305|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914837|Mentor dashboard: Move away from alpha/beta/stable (T334630)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
07:49 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:914305|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914837|Mentor dashboard: Move away from alpha/beta/stable (T334630)]] [production]
07:37 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:914836|Mentor dashboard: Move away from alpha/beta/stable (T334630)]], [[gerrit:914302|EditPage: Support preloading from i18n messages (T330337)]], [[gerrit:914303|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914304|EditPage: Support preloading from i18n messages (T330337)]] (duration: 07m 58s) [production]
07:37 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 134823 [production]
07:35 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 134823 [production]
07:34 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 293 [production]
07:33 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 293 [production]
07:31 <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:914836|Mentor dashboard: Move away from alpha/beta/stable (T334630)]], [[gerrit:914302|EditPage: Support preloading from i18n messages (T330337)]], [[gerrit:914303|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914304|EditPage: Support preloading from i18n messages (T330337)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2 [production]
07:29 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:914836|Mentor dashboard: Move away from alpha/beta/stable (T334630)]], [[gerrit:914302|EditPage: Support preloading from i18n messages (T330337)]], [[gerrit:914303|ApiVisualEditor: Support preloading from i18n messages (T330337)]], [[gerrit:914304|EditPage: Support preloading from i18n messages (T330337)]] [production]
07:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install5002.wikimedia.org [production]
07:15 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host install5002.wikimedia.org [production]
07:13 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host bast2003.wikimedia.org with OS bookworm [production]
07:11 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install6002.wikimedia.org [production]
07:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host install6002.wikimedia.org [production]
06:58 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on pc2011.codfw.wmnet with reason: Onsite maintenance T334722 [production]
06:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp1002.wikimedia.org [production]
06:58 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on pc2011.codfw.wmnet with reason: Onsite maintenance T334722 [production]
06:57 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on bast2003.wikimedia.org with reason: host reimage [production]
06:57 <marostegui@deploy1002> Finished scap: Backport for [[gerrit:915150|ProductionServices.php: Promote pc2014 to pc1 master (T334722)]] (duration: 07m 23s) [production]
06:54 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on bast2003.wikimedia.org with reason: host reimage [production]
06:54 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host idp1002.wikimedia.org [production]
06:54 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host krb2002.codfw.wmnet [production]
06:52 <marostegui> Promote pc2014 as pc1 master codfw dbmaint - T334722 [production]
06:51 <marostegui@deploy1002> marostegui: Backport for [[gerrit:915150|ProductionServices.php: Promote pc2014 to pc1 master (T334722)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
06:49 <marostegui@deploy1002> Started scap: Backport for [[gerrit:915150|ProductionServices.php: Promote pc2014 to pc1 master (T334722)]] [production]
06:48 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host krb2002.codfw.wmnet [production]
06:46 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2002.wikimedia.org [production]
06:46 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
06:44 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
06:43 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host idp-test2002.wikimedia.org [production]
06:33 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host bast2003.wikimedia.org with OS bookworm [production]
06:30 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast4004.wikimedia.org [production]
06:27 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1002.eqiad.wmnet with OS bookworm [production]
06:27 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]