1501-1550 of 10000 results (103ms)
2023-06-14 ยง
13:59 <topranks> adjusting port buffer partition asw2-esams T284592 [production]
13:58 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/recommendation-api: sync [production]
13:58 <topranks> adjusting port buffer partition asw1-eqsin T284592 [production]
13:58 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/recommendation-api: sync [production]
13:57 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync [production]
13:57 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/recommendation-api: sync [production]
13:57 <topranks> adjusting port buffer partition asw2-ulsfo T284592 [production]
13:53 <topranks> adjusting port buffer partition asw-d-codfw T284592 [production]
13:52 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
13:49 <topranks> adjusting port buffer partition asw-c-codfw T284592 [production]
13:46 <topranks> adjusting port buffer partition asw-b-codfw T284592 [production]
13:44 <moritzm> imported jenkins 2.401.1 to thirdparty/ci for buster-wikimedia [production]
13:42 <topranks> adjusting port buffer partition asw-a-codfw T284592 [production]
13:42 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
13:14 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
13:05 <klausman@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:57 <klausman@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:47 <jnuche@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.13 refs T337527 (duration: 06m 10s) [production]
12:41 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.13 refs T337527 [production]
12:29 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] (duration: 08m 21s) [production]
12:23 <ladsgroup@deploy1002> ladsgroup: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
12:21 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw1492.eqiad.wmnet [production]
12:21 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:929980|Fix cases of LogicException in $update->getParserOutputForMetaData() (T339094)]] [production]
12:07 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw1492.eqiad.wmnet [production]
12:01 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "fix mgmt for cloudservices2004-dev - jbond@cumin1001" [production]
12:00 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "fix mgmt for cloudservices2004-dev - jbond@cumin1001" [production]
11:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1021.eqiad.wmnet with reason: T337961 [production]
11:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on clouddb1021.eqiad.wmnet with reason: T337961 [production]
11:11 <XioNoX> eqiad row D, move VRRP primary back to cr2 - T313463 [production]
11:06 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "fix mgmt - jbond@cumin1001" [production]
11:05 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "fix mgmt - jbond@cumin1001" [production]
11:00 <XioNoX> disable cr2<->row D link for link migration - T313463 [production]
10:40 <XioNoX> eqiad row D, move VRRP primary to cr1 - T313463 [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ms-be[1040-1043].eqiad.wmnet [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:30 <mvernon@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ms-be[1040-1043].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - mvernon@cumin1001" [production]
10:24 <mvernon@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ms-be[1040-1043].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - mvernon@cumin1001" [production]
10:22 <mvernon@cumin1001> START - Cookbook sre.dns.netbox [production]
10:11 <XioNoX> disable cr1<->row D link for link migration - T313463 [production]
10:03 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.13 refs T337527 [production]
10:03 <mvernon@cumin1001> START - Cookbook sre.hosts.decommission for hosts ms-be[1040-1043].eqiad.wmnet [production]
10:01 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
10:00 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
09:54 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:28 <jnuche@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.13 refs T337527 (duration: 06m 56s) [production]
09:21 <moritzm> installing php7.4 security updates [production]
09:21 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.13 refs T337527 [production]
09:11 <hashar> zuul: rolled back config changes for T309376 and restarted Zuul. CI is back up. [production]
09:00 <tgr_> UTC morning deploys done [production]
08:59 <tgr@deploy1002> Finished scap: Backport for [[gerrit:929967|Section images: Pass section parameters to VE in add image tasks (T339046)]] (duration: 07m 55s) [production]