2101-2150 of 10000 results (86ms)
2024-03-26 ยง
14:55 <jnuche@deploy1002> Installing scap version "4.73.2" for 364 hosts [production]
14:26 <jayme@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:25 <jayme@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
14:25 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
14:24 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
14:24 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
14:22 <jayme@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
14:21 <jayme@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:20 <jayme@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
14:20 <claime> Deploying split listener for 10% of backend restbase traffic to mw-api-int - T358213 [production]
14:19 <claime> enabling and running puppet on P:restbase - T358213 [production]
14:19 <jayme@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:19 <jayme@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
14:18 <TheresNoTime> UTC afternoon backport window done [production]
14:15 <samtar@deploy1002> Finished scap: Backport for [[gerrit:1014509|dewiki: Enable mobile page tabs for everyone (T360246)]], [[gerrit:1011097|frwiki: update legacy vector logo (T359741)]] (duration: 17m 23s) [production]
14:13 <vriley@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts parse1014.eqiad.wmnet [production]
14:04 <samtar@deploy1002> anzx and samtar: Continuing with sync [production]
14:03 <jayme@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:02 <jayme@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
14:02 <jayme@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
14:01 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
14:01 <vriley@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts parse1014.eqiad.wmnet [production]
14:00 <samtar@deploy1002> anzx and samtar: Backport for [[gerrit:1014509|dewiki: Enable mobile page tabs for everyone (T360246)]], [[gerrit:1011097|frwiki: update legacy vector logo (T359741)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:57 <samtar@deploy1002> Started scap: Backport for [[gerrit:1014509|dewiki: Enable mobile page tabs for everyone (T360246)]], [[gerrit:1011097|frwiki: update legacy vector logo (T359741)]] [production]
13:55 <samtar@deploy1002> Finished scap: Backport for [[gerrit:1010881|knwikisource, knwiktionary: update logo, wordmark (T360022)]] (duration: 15m 53s) [production]
13:43 <samtar@deploy1002> anzx and samtar: Continuing with sync [production]
13:41 <samtar@deploy1002> anzx and samtar: Backport for [[gerrit:1010881|knwikisource, knwiktionary: update logo, wordmark (T360022)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:39 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1158 (T352010)', diff saved to https://phabricator.wikimedia.org/P58921 and previous config saved to /var/cache/conftool/dbconfig/20240326-133932-ladsgroup.json [production]
13:39 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1014,1018,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
13:39 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on clouddb[1014,1018,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
13:39 <samtar@deploy1002> Started scap: Backport for [[gerrit:1010881|knwikisource, knwiktionary: update logo, wordmark (T360022)]] [production]
13:39 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1158.eqiad.wmnet with reason: Maintenance [production]
13:38 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1158.eqiad.wmnet with reason: Maintenance [production]
13:36 <samtar@deploy1002> Finished scap: Backport for [[gerrit:1014073|Add throttle rule for editathon (T360533)]] (duration: 13m 40s) [production]
13:27 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:27 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add dbprov2005 dns - pt1979@cumin2002" [production]
13:26 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add dbprov2005 dns - pt1979@cumin2002" [production]
13:25 <samtar@deploy1002> samtar and zoranzoki21: Continuing with sync [production]
13:25 <samtar@deploy1002> samtar and zoranzoki21: Backport for [[gerrit:1014073|Add throttle rule for editathon (T360533)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:22 <samtar@deploy1002> Started scap: Backport for [[gerrit:1014073|Add throttle rule for editathon (T360533)]] [production]
13:20 <samtar@deploy1002> Finished scap: Backport for [[gerrit:1013234|Update mediawiki.web_ui_actions stream config (T360955)]] (duration: 18m 03s) [production]
13:19 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
13:09 <samtar@deploy1002> phuedx and samtar: Continuing with sync [production]
13:04 <samtar@deploy1002> phuedx and samtar: Backport for [[gerrit:1013234|Update mediawiki.web_ui_actions stream config (T360955)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:02 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:02 <samtar@deploy1002> Started scap: Backport for [[gerrit:1013234|Update mediawiki.web_ui_actions stream config (T360955)]] [production]
13:01 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
12:59 <samtar@deploy1002> Finished scap: Backport for [[gerrit:1014113|[officewiki, testwiki]: enable CodeMirrorV6 (T357795)]] (duration: 17m 40s) [production]
12:54 <claime> enabling and running puppet on restbase1035.eqiad.wmnet - T358213 [production]
12:54 <claime> enabling and running puppet on restbase2021.codfw.wmnet - T358213 [production]