4251-4300 of 10000 results (28ms)
2021-04-27 ยง
16:18 <effie> uploading scap_3.17.1-1 [production]
16:18 <effie> uploading cap_3.17.1-1 [production]
15:58 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1026.eqiad.wmnet [production]
14:48 <moritzm> installing file/libmagic updates from buster point release [production]
14:47 <bblack> lvs2009 - disable puppet + stop pybal (internal services will move to lvs2010, please avoid LVS service definition changes for now!) - T279457 [production]
14:39 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2003.codfw.wmnet [production]
14:36 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp203[56].codfw.wmnet [production]
14:36 <bblack> cp203[56] - depool all etcd services via confctl - T279457 [production]
14:33 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore2003.codfw.wmnet [production]
14:33 <bblack> dns2001 - depooling for T279457 (disable puppet + stop bird) [production]
14:32 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2002.codfw.wmnet [production]
14:31 <moritzm> installing imagemagick security updates [production]
14:28 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore2002.codfw.wmnet [production]
14:25 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2001.codfw.wmnet [production]
14:23 <jayme@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) [production]
14:20 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore2001.codfw.wmnet [production]
14:20 <jayme@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) [production]
14:19 <moritzm> installing xen security updates [production]
14:17 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
14:17 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
14:16 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
14:16 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
14:15 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
14:15 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
14:14 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1003.eqiad.wmnet [production]
14:09 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1003.eqiad.wmnet [production]
14:08 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
14:08 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
14:04 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1002.eqiad.wmnet [production]
14:01 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 105 hosts with reason: upgrading openstack [production]
14:01 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on 105 hosts with reason: upgrading openstack [production]
14:00 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 9 hosts with reason: upgrading openstack [production]
14:00 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on 9 hosts with reason: upgrading openstack [production]
13:58 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1002.eqiad.wmnet [production]
13:56 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1001.eqiad.wmnet [production]
13:55 <moritzm> imported jenkins 2.277.3 to thirdparty/ci [production]
13:50 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1001.eqiad.wmnet [production]
13:48 <moritzm> uploaded openjdk-8 8u292-b10-0~deb10u1 (buster forward port of latest Java 8 security release) [production]
13:46 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
13:45 <akosiaris@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:45 <akosiaris> switchover api-gateway, changeprop, cpjobqueue to use the new redis cluster servers (rdb2007-rdb2010) [production]
13:45 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:45 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
13:44 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
13:44 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:34 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
13:34 <akosiaris@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
13:33 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
13:33 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
13:30 <hashar> Upgrading CI Jenkins from 2.263.3 to 2.277.2 [production]