3701-3750 of 10000 results (90ms)
2024-03-19 ยง
16:42 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:41 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:37 <dancy@deploy2002> Installation of scap version "4.73.0" completed for 373 hosts [production]
16:36 <dancy@deploy2002> Installing scap version "4.73.0" for 373 hosts [production]
16:33 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:33 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove asw-a-codfw mgmt DNS - pt1979@cumin2002" [production]
16:32 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove asw-a-codfw mgmt DNS - pt1979@cumin2002" [production]
16:30 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:28 <oblivian@deploy2002> Finished scap: null k8s-only deployment to test scap-master-sync (duration: 08m 47s) [production]
16:19 <oblivian@deploy2002> Started scap: null k8s-only deployment to test scap-master-sync [production]
16:10 <moritzm> installing dpdk security updates [production]
16:02 <moritzm> installing wireshark security updates [production]
15:54 <herron> kafka-logging1001:~# kafka reassign-partitions -reassignment-json-file udp_localhost-info.json --execute --throttle 50000000 T326419 [production]
15:42 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2098.codfw.wmnet [production]
15:39 <herron> kafka-logging1001:~# kafka reassign-partitions -reassignment-json-file udp_localhost-err.json --execute --throttle 50000000 T326419 [production]
15:37 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:37 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
15:36 <effie> restart kartotherian on codfw [production]
15:36 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:36 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
15:36 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2098.codfw.wmnet [production]
15:35 <herron> kafka-logging1001:~# kafka reassign-partitions -reassignment-json-file rsyslog-warning.json --execute --throttle 50000000 T326419 [production]
15:32 <brennen@deploy2002> Finished deploy [phabricator/deployment@9617e09]: deploy to phab1004 for T358610 (duration: 01m 19s) [production]
15:31 <brennen@deploy2002> Started deploy [phabricator/deployment@9617e09]: deploy to phab1004 for T358610 [production]
15:31 <brennen@deploy2002> Finished deploy [phabricator/deployment@9617e09]: deploy to phab2002 for T358610 (duration: 00m 23s) [production]
15:30 <brennen@deploy2002> Started deploy [phabricator/deployment@9617e09]: deploy to phab2002 for T358610 [production]
15:30 <brennen> starting phabricator/phorge update (T358610) [production]
15:30 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: Phabricator/Phorge update [production]
15:29 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab1004.eqiad.wmnet with reason: Phabricator/Phorge update [production]
15:29 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2002.codfw.wmnet with reason: Phabricator/Phorge update [production]
15:29 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab2002.codfw.wmnet with reason: Phabricator/Phorge update [production]
15:26 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
15:25 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
15:23 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
15:22 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
15:20 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: mariadb::misc::db_inventory [production]
15:20 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:19 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
15:19 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:18 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
15:17 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp4037.ulsfo.wmnet [production]
15:17 <claime> Raising mw-web and mw-api-ext replicas for additional read-only traffic - T357547 [production]
15:15 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet [production]
15:14 <fabfur> repooling cp4037 for brief time (T358109) [production]
15:12 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
15:12 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
15:12 <herron> kafka-logging1001:~# kafka reassign-partitions -reassignment-json-file rsyslog-notice.json --execute --throttle 50000000 T326419 [production]
15:12 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
15:12 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
15:05 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: mariadb::misc::db_inventory [production]