7101-7150 of 10000 results (96ms)
2023-02-27 ยง
20:50 <zabe@deploy1002> Started scap: install Translate on vewikimedia and update interwiki cache [production]
20:49 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
20:48 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
20:48 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
20:48 <zabe@deploy1002> Finished scap: create vewikimedia T320890 (duration: 07m 29s) [production]
20:42 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
20:42 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
20:40 <zabe@deploy1002> Started scap: create vewikimedia T320890 [production]
20:39 <zabe> create Wikimedia Venezuela wiki # T320890 [production]
20:38 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2072.mgmt.codfw.wmnet with reboot policy FORCED [production]
20:38 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2071.mgmt.codfw.wmnet with reboot policy FORCED [production]
20:30 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2071.mgmt.codfw.wmnet with reboot policy FORCED [production]
20:29 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be2071.mgmt.codfw.wmnet with reboot policy FORCED [production]
20:24 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2071.mgmt.codfw.wmnet with reboot policy FORCED [production]
20:17 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:17 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ms-fe and thanos nodes - pt1979@cumin2002" [production]
20:16 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
20:11 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ms-fe and thanos nodes - pt1979@cumin2002" [production]
20:11 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
20:10 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
20:07 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
20:06 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
20:05 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
20:01 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
19:55 <urandom> power cycling restbase1026 [production]
19:42 <zabe@deploy1002> Finished scap: create gurwiki T327813 (duration: 07m 19s) [production]
19:38 <samtar@deploy1002> Backport cancelled. [production]
19:37 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2070.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:35 <zabe@deploy1002> Started scap: create gurwiki T327813 [production]
19:34 <zabe> create Wikipedia Farefare (Gurene) # T327813 [production]
19:18 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
19:09 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2070.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:59 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
18:39 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:38 <pt1979@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ms-be nodes - pt1979@cumin2002" [production]
18:37 <dcaro@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1004.eqiad.wmnet with OS bullseye [production]
18:37 <dcaro@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - dcaro@cumin1001" [production]
18:31 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ms-be nodes - pt1979@cumin2002" [production]
18:29 <zabe> start running "foreachwikiindblist s3.dblist migrateRevisionCommentTemp.php --sleep 2" in screen # T275246 [production]
18:29 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
18:24 <dcaro@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - dcaro@cumin1001" [production]
18:09 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@c8dc6d5]: cirrus namespaces: Work arround missing domain_name in upstream (duration: 02m 29s) [production]
18:07 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@c8dc6d5]: cirrus namespaces: Work arround missing domain_name in upstream [production]
18:03 <elukey@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. [production]
18:03 <elukey@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. [production]
18:01 <zabe@deploy1002> Synchronized wmf-config/interwiki.php: (no justification provided) (duration: 06m 54s) [production]
17:38 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host dse-k8s-worker1008.eqiad.wmnet with OS bullseye [production]
17:38 <elukey@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. [production]
17:38 <elukey@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. [production]
17:37 <zabe@deploy1002> Finished scap: create gucwiki T321880 (duration: 11m 05s) [production]