851-900 of 10000 results (78ms)
2023-05-16 ยง
17:47 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:47 <volans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a8-codfw - volans@cumin1001" [production]
17:46 <volans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a8-codfw - volans@cumin1001" [production]
17:45 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host dns2006.wikimedia.org with OS bullseye [production]
17:44 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
17:40 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:40 <volans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a8-codfw - volans@cumin1001" [production]
17:40 <moritzm> installing avahi security updates on buster [production]
17:39 <volans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a8-codfw - volans@cumin1001" [production]
17:37 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
17:37 <volans@cumin1001> START - Cookbook sre.network.provision for device ssw1-a8-codfw.mgmt.codfw.wmnet [production]
17:34 <joal@deploy1002> Finished deploy [airflow-dags/analytics@7816937]: Regular analytics weekly train - Hotfix [airflow-dags@7816937] (duration: 00m 10s) [production]
17:34 <joal@deploy1002> Started deploy [airflow-dags/analytics@7816937]: Regular analytics weekly train - Hotfix [airflow-dags@7816937] [production]
17:27 <volans@cumin1001> END (FAIL) - Cookbook sre.network.provision (exit_code=99) for device ssw1-a1-codfw.mgmt.codfw.wmnet [production]
17:27 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:27 <volans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin1001" [production]
17:27 <brett> Rolling out maglev LVS scheduler in drmrs - T263797 [production]
17:26 <volans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin1001" [production]
17:24 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
17:20 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:20 <volans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a1-codfw - volans@cumin1001" [production]
17:19 <volans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a1-codfw - volans@cumin1001" [production]
17:18 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts dns2002.wikimedia.org [production]
17:18 <sukhe@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:18 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: dns2002.wikimedia.org decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
17:17 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
17:17 <volans@cumin1001> START - Cookbook sre.network.provision for device ssw1-a1-codfw.mgmt.codfw.wmnet [production]
17:16 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: dns2002.wikimedia.org decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
17:14 <sukhe@cumin2002> START - Cookbook sre.dns.netbox [production]
17:09 <sukhe@cumin2002> START - Cookbook sre.hosts.decommission for hosts dns2002.wikimedia.org [production]
17:00 <sukhe> homer "cr*-codfw*" commit "Gerrit: 920320 remove to-be decommissioned host dns2002" T335777 [production]
16:59 <moritzm> installing 5.10.179 kernels on Bullseye hosts [production]
16:55 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor100[1256].eqiad.wmnet [production]
16:30 <aikochou@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
16:30 <volans> restarting wikibugs ( https://www.mediawiki.org/wiki/Wikibugs#Help ) [production]
16:06 <mutante> gitlab-runner2003 - installed rsync client for debugging an issue with rsync from inside containers, comparing to from outside container [production]
15:49 <sukhe> run authdns-update for CR 920314 [production]
15:41 <joal@deploy1002> Finished deploy [airflow-dags/analytics@7fa2dcd]: Regular analytics weekly train [airflow-dags@7fa2dcd] (duration: 00m 10s) [production]
15:41 <joal@deploy1002> Started deploy [airflow-dags/analytics@7fa2dcd]: Regular analytics weekly train [airflow-dags@7fa2dcd] [production]
15:36 <hashar> Some CI jobs started failing after an upgrade of some Jenkins plugins. I have upgraded a couple more and it seems to work now T336775 [production]
15:33 <sukhe> set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.10 208.80.153.48 208.80.153.74 ]: T326688 [production]
15:33 <sukhe> set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.10 208.80.153.48 208.80.153.74 ] [production]
15:32 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
15:32 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
15:27 <hashar> Restarting CI Jenkins [production]
15:26 <Emperor> rebalance codfw swift rings T335280 [production]
15:18 <hashar> CI Jenkins jobs are stall following the plugins upgrade :/ [production]
15:07 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
15:04 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
15:03 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]