901-950 of 10000 results (77ms)
2023-08-16 §
01:30 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
01:22 <ryankemper@deploy1002> Finished deploy [wdqs/wdqs@f1a6177]: deploy to freshly reimaged host (duration: 00m 10s) [production]
01:22 <ryankemper@deploy1002> Started deploy [wdqs/wdqs@f1a6177]: deploy to freshly reimaged host [production]
01:21 <ryankemper@deploy1002> Finished deploy [wdqs/wdqs@f1a6177]: deploy to freshly reimaged host (duration: 00m 10s) [production]
01:21 <ryankemper@deploy1002> Started deploy [wdqs/wdqs@f1a6177]: deploy to freshly reimaged host [production]
2023-08-15 §
23:26 <hmonroy@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Set wikidiff2 maxSplitSize = 10 on group0 wikis T341754 (duration: 07m 39s) [production]
22:27 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1012.eqiad.wmnet with OS bullseye [production]
22:22 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1013.eqiad.wmnet with OS bullseye [production]
21:53 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1013.eqiad.wmnet with reason: host reimage [production]
21:50 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1012.eqiad.wmnet with reason: host reimage [production]
21:47 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1013.eqiad.wmnet with reason: host reimage [production]
21:47 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1012.eqiad.wmnet with reason: host reimage [production]
21:32 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1013.eqiad.wmnet with OS bullseye [production]
21:32 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1012.eqiad.wmnet with OS bullseye [production]
21:16 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:16 <robh@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: pdus - robh@cumin1001" [production]
21:15 <robh@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: pdus - robh@cumin1001" [production]
21:09 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
21:07 <robh@cumin1001> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
21:07 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
20:55 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs3010.esams.wmnet with OS bullseye [production]
20:55 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:54 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:37 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs3010.esams.wmnet with reason: host reimage [production]
20:36 <ebernhardson> T342444 start cirrussearch reindex of all wikis to enable new text analysis components from mwmaint1002 [production]
20:33 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs3010.esams.wmnet with reason: host reimage [production]
20:20 <ryankemper@deploy1002> Finished scap: Backport for [[gerrit:833861|elastic: allow only 1 enwiki_content per host (T343820)]] (duration: 09m 25s) [production]
20:20 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs3008.esams.wmnet with OS bullseye [production]
20:20 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:19 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:19 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3080.esams.wmnet with OS bullseye [production]
20:19 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:18 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:17 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3072.esams.wmnet with OS bullseye [production]
20:17 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:16 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
20:14 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host lvs3010.esams.wmnet with OS bullseye [production]
20:13 <ryankemper@deploy1002> ryankemper: Continuing with sync [production]
20:12 <ryankemper@deploy1002> ryankemper: Backport for [[gerrit:833861|elastic: allow only 1 enwiki_content per host (T343820)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
20:11 <ryankemper@deploy1002> Started scap: Backport for [[gerrit:833861|elastic: allow only 1 enwiki_content per host (T343820)]] [production]
20:01 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs3008.esams.wmnet with reason: host reimage [production]
20:01 <sukhe> running dummy authdns-update [production]
19:57 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs3008.esams.wmnet with reason: host reimage [production]
19:55 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3080.esams.wmnet with reason: host reimage [production]
19:53 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3072.esams.wmnet with reason: host reimage [production]
19:51 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3080.esams.wmnet with reason: host reimage [production]
19:49 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3072.esams.wmnet with reason: host reimage [production]
19:45 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns3004.wikimedia.org with OS bullseye [production]
19:45 <fabfur@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1001" [production]
19:44 <fabfur@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1001" [production]