2901-2950 of 10000 results (93ms)
2023-11-02 §
11:48 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-host for host netflow6001.drmrs.wmnet [production]
11:46 <fnegri@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol1006.eqiad.wmnet with reason: host reimage [production]
11:45 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
11:45 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
11:33 <fnegri@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.eqiad.wmnet with OS bookworm [production]
11:19 <hnowlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/page-analytics: apply [production]
11:19 <hnowlan@deploy2002> helmfile [eqiad] START helmfile.d/services/page-analytics: apply [production]
11:18 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/page-analytics: apply [production]
11:18 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/page-analytics: apply [production]
11:16 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/page-analytics: apply [production]
11:16 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/page-analytics: apply [production]
11:15 <vgutierrez@cumin1001> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-ulsfo and not P{cp4037.ulsfo.wmnet} and A:cp [production]
11:12 <fnegri@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcontrol1006.eqiad.wmnet with OS bookworm [production]
11:10 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on P{cp4037.ulsfo.wmnet} and A:cp [production]
11:10 <vgutierrez> rolling upgrade of HAProxy to version 2.6.15-1~bpo11+1 in ulsfo [production]
11:09 <vgutierrez@cumin1001> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on P{cp4037.ulsfo.wmnet} and A:cp [production]
11:00 <cmooney@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 34 hosts with reason: testing new bgp policy [production]
11:00 <cmooney@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on 34 hosts with reason: testing new bgp policy [production]
10:39 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host ganeti2014.codfw.wmnet [production]
10:26 <fnegri@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.eqiad.wmnet with OS bookworm [production]
10:23 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host ganeti2014.codfw.wmnet [production]
09:32 <moritzm> installing openssl bugfix updates from Bullseye point release (update to 1.1.1w) [production]
09:25 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on ldap-rw[1001,2001].wikimedia.org with reason: setup in progress [production]
09:25 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on ldap-rw[1001,2001].wikimedia.org with reason: setup in progress [production]
09:13 <jayme> published image php7.4-fpm-multiversion-base:7.4.33-6 now based on icu67 php packages - T345561 [production]
09:06 <zabe@deploy2002> Finished scap: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] (duration: 07m 25s) [production]
09:05 <moritzm> installing krb5 security updates on buster/bullseye/bookworm [production]
09:04 <moritzm> installing krb5 security updates on bullseye [production]
09:01 <zabe@deploy2002> zabe: Continuing with sync [production]
09:00 <zabe@deploy2002> zabe: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:59 <zabe@deploy2002> Started scap: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] [production]
08:57 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on dbproxy1017.eqiad.wmnet with reason: decomissionning via T348956 [production]
08:57 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on dbproxy1017.eqiad.wmnet with reason: decomissionning via T348956 [production]
08:48 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: cloudcontrol2006-dev.codfw.wmnet [production]
08:48 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: cloudcontrol2006-dev.codfw.wmnet [production]
08:12 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Downtime as we setup the new WMDE Airflow instance [production]
08:12 <stevemunene@cumin1001> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Downtime as we setup the new WMDE Airflow instance [production]
07:05 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1001.eqiad.wmnet [production]
07:01 <jelto@cumin1001> START - Cookbook sre.hosts.reboot-single for host vrts1001.eqiad.wmnet [production]
03:13 <eileen> civicrm upgraded from 86b620ef to 84ec2957 [production]
03:03 <eileen> civicrm upgraded from bcfd8a7e to 86b620ef [production]
02:27 <eileen> civicrm upgraded from 60bdd8d3 to bcfd8a7e [production]
02:18 <eileen> civicrm upgraded from 770b114c to 60bdd8d3 [production]
2023-11-01 §
22:39 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:970758|Revert "Add খসড়া as draft namespace alias on bnwiki" and add "খসড়া" by copy-paste from wiki page]] (duration: 06m 44s) [production]
22:32 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:970758|Revert "Add খসড়া as draft namespace alias on bnwiki" and add "খসড়া" by copy-paste from wiki page]] [production]
22:18 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
22:18 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:18 <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-reload (exit_code=97) [production]
22:16 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:15 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]