1651-1700 of 10000 results (111ms)
2024-10-03 §
07:50 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] [production]
07:16 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] (duration: 10m 39s) [production]
07:12 <kartik@deploy2002> kartik: Continuing with sync [production]
07:08 <kartik@deploy2002> kartik: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:06 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] [production]
06:51 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
06:50 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
2024-10-02 §
23:46 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077494|Revert "logging: Enable logging for debug GrowthExperiments events" (T376124)]] (duration: 07m 07s) [production]
23:39 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1077494|Revert "logging: Enable logging for debug GrowthExperiments events" (T376124)]] [production]
22:35 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077484|logging: Enable logging for debug GrowthExperiments events (T376124)]] (duration: 06m 52s) [production]
22:28 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1077484|logging: Enable logging for debug GrowthExperiments events (T376124)]] [production]
21:55 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wdqs-categories1001.eqiad.wmnet with reason: T375687 [production]
21:54 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wdqs-categories1001.eqiad.wmnet with reason: T375687 [production]
21:24 <mutante> phab1004 - link=$(/usr/bin/readlink -f /srv/phab) ; /usr/bin/git config -f /etc/gitconfig.d/10-phab-deploy-safedir.gitconfig --add safe.directory $link ; /bin/cat /etc/gitconfig.d/*.gitconfig > /etc/gitconfig - T360756 [production]
20:57 <eileen> civicrm upgraded from 28fd5e3b to 90199f62 [production]
20:01 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-misc1001.eqiad.wmnet with OS bookworm [production]
20:01 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
20:00 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
19:58 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-misc1002.eqiad.wmnet with OS bookworm [production]
19:58 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
19:57 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
19:45 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-misc1001.eqiad.wmnet with reason: host reimage [production]
19:42 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-misc1002.eqiad.wmnet with reason: host reimage [production]
19:38 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mc-misc1001.eqiad.wmnet with reason: host reimage [production]
19:38 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mc-misc1002.eqiad.wmnet with reason: host reimage [production]
19:27 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host mc-misc1002.eqiad.wmnet with OS bookworm [production]
19:26 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host mc-misc1001.eqiad.wmnet with OS bookworm [production]
19:23 <cstone> SmashPig upgraded from 715e91fa to df2a9c42 [production]
19:21 <brett> cumin -b11 "A:cp" "run-puppet-agent --enable 'rolling out 1038884'" [production]
19:16 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply [production]
19:15 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply [production]
19:13 <brett@cumin2002> conftool action : set/pooled=yes; selector: name=cp4041.ulsfo.wmnet [production]
19:06 <brett@cumin2002> conftool action : set/pooled=no; selector: name=cp4041.ulsfo.wmnet [production]
18:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
18:23 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
18:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
18:21 <denisse@deploy2002> Finished deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 24.9.1 - T376256 (duration: 00m 12s) [production]
18:21 <denisse@deploy2002> Started deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 24.9.1 - T376256 [production]
18:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
18:10 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.25 refs T375656 [production]
18:06 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
18:03 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
17:22 <aokoth@cumin1002> END (PASS) - Cookbook sre.vrts.upgrade (exit_code=0) on VRTS host vrts1003.eqiad.wmnet [production]
17:20 <aokoth@cumin1002> START - Cookbook sre.vrts.upgrade on VRTS host vrts1003.eqiad.wmnet [production]
17:02 <aokoth@cumin1002> END (FAIL) - Cookbook sre.vrts.upgrade (exit_code=93) on VRTS host vrts1003.eqiad.wmnet [production]
17:02 <aokoth@cumin1002> START - Cookbook sre.vrts.upgrade on VRTS host vrts1003.eqiad.wmnet [production]
17:01 <btullis@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1019.eqiad.wmnet [production]
17:00 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077364|ReassignMentees: Add additional logging (T376124)]], [[gerrit:1077365|ReassignMentees: Add additional logging (T376124)]] (duration: 14m 42s) [production]
16:58 <btullis@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1019.eqiad.wmnet [production]
16:56 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]