8251-8300 of 10000 results (96ms)
2023-06-14 ยง
14:29 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
14:29 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
14:22 <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: EventStreamConfig - Declare mediawiki.page_outlink_topic_prediction_change.v1 stream - T328899 (duration: 10m 25s) [production]
14:19 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
14:17 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
14:17 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
14:16 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
14:15 <bblack> dns2006: updating gdnsd package [production]
14:15 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
14:13 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
14:12 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
14:12 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
13:59 <topranks> adjusting port buffer partition asw2-esams T284592 [production]
13:58 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/recommendation-api: sync [production]
13:58 <topranks> adjusting port buffer partition asw1-eqsin T284592 [production]
13:58 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/recommendation-api: sync [production]
13:57 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync [production]
13:57 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/recommendation-api: sync [production]
13:57 <topranks> adjusting port buffer partition asw2-ulsfo T284592 [production]
13:53 <topranks> adjusting port buffer partition asw-d-codfw T284592 [production]
13:52 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
13:49 <topranks> adjusting port buffer partition asw-c-codfw T284592 [production]
13:46 <topranks> adjusting port buffer partition asw-b-codfw T284592 [production]
13:44 <moritzm> imported jenkins 2.401.1 to thirdparty/ci for buster-wikimedia [production]
13:42 <topranks> adjusting port buffer partition asw-a-codfw T284592 [production]
13:42 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
13:14 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
13:05 <klausman@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:57 <klausman@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:47 <jnuche@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.13 refs T337527 (duration: 06m 10s) [production]
12:41 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.13 refs T337527 [production]
12:29 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] (duration: 08m 21s) [production]
12:23 <ladsgroup@deploy1002> ladsgroup: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
12:21 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw1492.eqiad.wmnet [production]
12:21 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] [production]
12:07 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw1492.eqiad.wmnet [production]
12:01 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "fix mgmt for cloudservices2004-dev - jbond@cumin1001" [production]
12:00 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "fix mgmt for cloudservices2004-dev - jbond@cumin1001" [production]
11:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1021.eqiad.wmnet with reason: T337961 [production]
11:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on clouddb1021.eqiad.wmnet with reason: T337961 [production]
11:11 <XioNoX> eqiad row D, move VRRP primary back to cr2 - T313463 [production]
11:06 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "fix mgmt - jbond@cumin1001" [production]
11:05 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "fix mgmt - jbond@cumin1001" [production]
11:00 <XioNoX> disable cr2<->row D link for link migration - T313463 [production]
10:40 <XioNoX> eqiad row D, move VRRP primary to cr1 - T313463 [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ms-be[1040-1043].eqiad.wmnet [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ms-be[1040-1043].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - mvernon@cumin1001" [production]
10:24 <mvernon@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ms-be[1040-1043].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - mvernon@cumin1001" [production]
10:22 <mvernon@cumin1001> START - Cookbook sre.dns.netbox [production]