5951-6000 of 10000 results (94ms)
2023-06-19 ยง
14:46 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
14:46 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
14:45 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
14:45 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
14:39 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:931073|file: Make pre-gen rendering of multi-page files (pdf, ...) serial (T337649)]] (duration: 20m 07s) [production]
14:27 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
14:27 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
14:26 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
14:26 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
14:24 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
14:23 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
14:20 <ladsgroup@deploy1002> ladsgroup: Backport for [[gerrit:931073|file: Make pre-gen rendering of multi-page files (pdf, ...) serial (T337649)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
14:19 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:931073|file: Make pre-gen rendering of multi-page files (pdf, ...) serial (T337649)]] [production]
14:17 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
14:17 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
14:04 <elukey> move varnishafka instances in eqsin to PKI [production]
13:44 <kamila_> updated DNS: added discovery records for rest-gateway and device-analytics T335505 [production]
13:14 <moritzm> installing openjdk-17 security updates [production]
12:21 <moritzm> uploaded wmfmariadbpy 0.10+deb12u1 T339835 [production]
12:01 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
12:01 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
12:00 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
12:00 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:55 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:55 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:54 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:54 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:53 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:53 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:39 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts analytics1060.eqiad.wmnet [production]
11:39 <stevemunene@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:39 <stevemunene@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: analytics1060.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1001" [production]
11:38 <stevemunene@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: analytics1060.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1001" [production]
11:36 <stevemunene@cumin1001> START - Cookbook sre.dns.netbox [production]
11:28 <stevemunene@cumin1001> START - Cookbook sre.hosts.decommission for hosts analytics1060.eqiad.wmnet [production]
11:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 100%: Maint over (T338354)', diff saved to https://phabricator.wikimedia.org/P49449 and previous config saved to /var/cache/conftool/dbconfig/20230619-110207-ladsgroup.json [production]
10:59 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts analytics1059.eqiad.wmnet [production]
10:59 <stevemunene@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:59 <stevemunene@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: analytics1059.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1001" [production]
10:58 <stevemunene@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: analytics1059.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1001" [production]
10:56 <stevemunene@cumin1001> START - Cookbook sre.dns.netbox [production]
10:55 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1124.eqiad.wmnet with OS bookworm [production]
10:52 <moritzm> imported megacli and ssacli to thirdparty/hwraid for bookworm-wikimedia T339847 [production]
10:48 <stevemunene@cumin1001> START - Cookbook sre.hosts.decommission for hosts analytics1059.eqiad.wmnet [production]
10:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 75%: Maint over (T338354)', diff saved to https://phabricator.wikimedia.org/P49448 and previous config saved to /var/cache/conftool/dbconfig/20230619-104702-ladsgroup.json [production]
10:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 25%: Maint over (T338354)', diff saved to https://phabricator.wikimedia.org/P49447 and previous config saved to /var/cache/conftool/dbconfig/20230619-103157-ladsgroup.json [production]
10:17 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
10:16 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
10:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 10%: Maint over (T338354)', diff saved to https://phabricator.wikimedia.org/P49446 and previous config saved to /var/cache/conftool/dbconfig/20230619-101653-ladsgroup.json [production]
10:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 25%: 10', diff saved to https://phabricator.wikimedia.org/P49445 and previous config saved to /var/cache/conftool/dbconfig/20230619-101623-ladsgroup.json [production]