2501-2550 of 10000 results (95ms)
2023-06-22 ยง
10:24 <mvolz@deploy1002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
10:23 <mvolz@deploy1002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
10:23 <mvolz@deploy1002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
10:22 <mvolz@deploy1002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
10:07 <moritzm> installing Apache security updates on Bullseye [production]
09:51 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:931720|Fix adding a domain when the page doesn't exist]] (duration: 08m 05s) [production]
09:44 <ladsgroup@deploy1002> ladsgroup: Backport for [[gerrit:931720|Fix adding a domain when the page doesn't exist]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
09:43 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:931720|Fix adding a domain when the page doesn't exist]] [production]
09:40 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:40 <root@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2003.codfw.wmnet [production]
09:33 <root@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti-test2003.codfw.wmnet [production]
09:33 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:29 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:29 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:27 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:26 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2003.codfw.wmnet [production]
09:12 <vgutierrez> increasing maxconns to 2000 in haproxy for port 80 - T339898 [production]
08:50 <vgutierrez> tighten HAProxy timeouts on port 80 globally - T339898 [production]
08:23 <jbond@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "test 931926 - jbond@cumin2002" [production]
08:22 <jbond@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "test 931926 - jbond@cumin2002" [production]
07:43 <moritzm> installing containerd security updates [production]
06:55 <apergos> rsync in ariel screensession on dumpsdata1003 pulling from dumpsdata1004, bwlimit 100000 (=1G) of misc dumps files [production]
06:39 <kart_> Updated cxserver to 2023-06-21-112200-production (T339896, T338123) [production]
06:38 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
06:38 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
06:36 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
06:35 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
06:35 <marostegui@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
06:35 <marostegui@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy102[47] - marostegui@cumin1001" [production]
06:34 <marostegui@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy102[47] - marostegui@cumin1001" [production]
06:32 <marostegui@cumin1001> START - Cookbook sre.dns.netbox [production]
06:32 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
06:31 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
06:29 <marostegui@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
06:29 <marostegui@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy1023 - marostegui@cumin1001" [production]
06:29 <marostegui@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy1023 - marostegui@cumin1001" [production]
06:27 <marostegui@cumin1001> START - Cookbook sre.dns.netbox [production]
05:57 <ryankemper@puppetmaster1001> conftool action : set/weight=0:pooled=inactive; selector: name=wdqs2021.* [production]
05:17 <marostegui@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
05:17 <marostegui@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy1022 - marostegui@cumin1001" [production]
05:16 <marostegui@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ipv6 for dbproxy1022 - marostegui@cumin1001" [production]
05:14 <marostegui@cumin1001> START - Cookbook sre.dns.netbox [production]
03:17 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
03:16 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
03:07 <rzl@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
03:05 <rzl@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
02:52 <rzl@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
02:51 <rzl@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
02:37 <rzl@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
02:35 <rzl@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]