4201-4250 of 10000 results (122ms)
2024-10-09 ยง
13:45 <brouberol@cumin1002> START - Cookbook sre.hosts.reboot-single for host flink-zk1001.eqiad.wmnet [production]
13:45 <brouberol@cumin1002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host flink-zk1001.eqiad.wmnet [production]
13:44 <brouberol@cumin1002> START - Cookbook sre.hosts.reboot-single for host flink-zk1001.eqiad.wmnet [production]
13:44 <lucaswerkmeister-wmde@deploy2002> albertoleoncio, lucaswerkmeister-wmde: Continuing with sync [production]
13:44 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM idp1004.wikimedia.org [production]
13:43 <lucaswerkmeister-wmde@deploy2002> albertoleoncio, lucaswerkmeister-wmde: Backport for [[gerrit:1078774|[brwikimedia] Enable the CampaignEvents extension (T376747)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:43 <slyngshede@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idp-test1004.wikimedia.org [production]
13:43 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T367856)', diff saved to https://phabricator.wikimedia.org/P69516 and previous config saved to /var/cache/conftool/dbconfig/20241009-134305-ladsgroup.json [production]
13:42 <brouberol@cumin1002> END (ERROR) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=97) for Zookeeper A:zookeeper-flink-eqiad cluster: Roll restart of jvm daemons. [production]
13:42 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1028.eqiad.wmnet [production]
13:41 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1078774|[brwikimedia] Enable the CampaignEvents extension (T376747)]] [production]
13:41 <brouberol@cumin1002> START - Cookbook sre.zookeeper.roll-restart-zookeeper for Zookeeper A:zookeeper-flink-eqiad cluster: Roll restart of jvm daemons. [production]
13:39 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM idp-test1004.wikimedia.org [production]
13:39 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart-reboot-durum rolling reboot on A:durum [production]
13:39 <Lucas_WMDE> lucaswerkmeister-wmde@deploy2002 $ printf 'https://en.wikipedia.org/static/images/%s\n' 'project-logos/sdwiki.png' 'project-logos/sdwiki-1.5x.png' 'project-logos/sdwiki-2x.png' 'mobile/copyright/wikipedia-wordmark-sd.svg' 'mobile/copyright/wikipedia-tagline-sd.svg' | mwscript-k8s --attach -- purgeList.php # T376536 [production]
13:35 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1078680|sdwiki: Add new logo and tagline (T376536)]] (duration: 19m 34s) [production]
13:33 <slyngshede@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idm2001.wikimedia.org [production]
13:32 <jelto@cumin1002> START - Cookbook sre.hosts.reboot-single for host gerrit2003.wikimedia.org [production]
13:31 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM idm2001.wikimedia.org [production]
13:30 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, ammarpad: Continuing with sync [production]
13:30 <slyngshede@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idm1001.wikimedia.org [production]
13:28 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM idm1001.wikimedia.org [production]
13:27 <slyngshede@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idm-test1001.wikimedia.org [production]
13:23 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM idm-test1001.wikimedia.org [production]
13:22 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host etherpad1004.eqiad.wmnet [production]
13:18 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, ammarpad: Backport for [[gerrit:1078680|sdwiki: Add new logo and tagline (T376536)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:18 <jelto@cumin1002> START - Cookbook sre.hosts.reboot-single for host etherpad1004.eqiad.wmnet [production]
13:16 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host etherpad2002.codfw.wmnet [production]
13:15 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1078680|sdwiki: Add new logo and tagline (T376536)]] [production]
13:14 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1078929|QuickSurveys: Deploy Safety Survey with zero coverage (T376517)]] (duration: 10m 37s) [production]
13:12 <jelto@cumin1002> START - Cookbook sre.hosts.reboot-single for host etherpad2002.codfw.wmnet [production]
13:09 <kharlan@deploy2002> kharlan: Continuing with sync [production]
13:06 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1078929|QuickSurveys: Deploy Safety Survey with zero coverage (T376517)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:03 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1078929|QuickSurveys: Deploy Safety Survey with zero coverage (T376517)]] [production]
12:59 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
12:41 <ayounsi@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts rpki2002.codfw.wmnet [production]
12:41 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:41 <ayounsi@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: rpki2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - ayounsi@cumin1002" [production]
12:41 <ayounsi@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: rpki2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - ayounsi@cumin1002" [production]
12:38 <ayounsi@cumin1002> START - Cookbook sre.dns.netbox [production]
12:33 <ayounsi@cumin1002> START - Cookbook sre.hosts.decommission for hosts rpki2002.codfw.wmnet [production]
12:24 <jelto@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
12:24 <jelto@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
12:23 <jelto@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:23 <jelto@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:18 <moritzm> installing initramfs-tools bugfix updates from Bookworm point release [production]
12:16 <jelto@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:15 <jelto@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
12:15 <jelto@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
12:15 <jelto@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]