551-600 of 10000 results (20ms)
2024-10-02 §
07:32 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org [production]
07:09 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp[3071-3072].esams.wmnet with reason: HW maintenance [production]
07:09 <vgutierrez@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp[3071-3072].esams.wmnet with reason: HW maintenance [production]
06:50 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging AndyRussG out of all services on: 1497 hosts [production]
06:49 <root@cumin2002> START - Cookbook sre.idm.logout Logging AndyRussG out of all services on: 1497 hosts [production]
06:48 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging AndyRussG out of all services on: 706 hosts [production]
06:48 <root@cumin2002> START - Cookbook sre.idm.logout Logging AndyRussG out of all services on: 706 hosts [production]
02:40 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
01:20 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
01:18 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host logging-hd2005.codfw.wmnet with OS bookworm [production]
2024-10-01 §
23:42 <zabe> zabe@mwmaint2002:~$ cat /home/zabe/s3.txt | xargs -I{} bash -c "echo {}; mwscript extensions/WikimediaMaintenance/migrateESRefToContentTable.php {} --skip /home/zabe/text_table_cleanup/{} --dump /home/zabe/text_table_dump/{} --sleep 1" # T183490 [production]
22:02 <wmbot~bd808@tools-bastion-12> Rootate OAuth credentials (T376217) [tools.schedule-deployment]
21:45 <wmbot~bd808@tools-bastion-12> Rotate OAuth credentials (T376216) [tools.phab-ban]
21:35 <wmbot~bd808@tools-bastion-12> Rotate OAuth credentntials (T376214) [tools.gitlab-account-approval]
20:34 <hashar> UTC late backport window completed [production]
20:28 <hashar> mwscript purgeList.php --wiki=tlywiki --namespace=4 # T367009 [production]
20:12 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1076254|Update wgMetaNamespace for tlywiki (T367009)]] (duration: 07m 21s) [production]
20:07 <hashar@deploy2002> nmw03, hashar: Continuing with sync [production]
20:06 <hashar@deploy2002> nmw03, hashar: Backport for [[gerrit:1076254|Update wgMetaNamespace for tlywiki (T367009)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:04 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1076254|Update wgMetaNamespace for tlywiki (T367009)]] [production]
20:02 <hashar> Restarting CI Jenkins [production]
19:48 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
19:47 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
17:59 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077079|Allow storing of passwords for local users in wikitech (T376140)]] (duration: 09m 03s) [production]
17:56 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:55 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
17:55 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:53 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1077079|Allow storing of passwords for local users in wikitech (T376140)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
17:50 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1077079|Allow storing of passwords for local users in wikitech (T376140)]] [production]
17:50 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
17:44 <wmbot~bd808@tools-bastion-12> Switched OAuth credentials in the proper config file this time (T376176) [tools.stashbot]
17:41 <bd808> test [tools.stashbot]
17:35 <bd808> test [tools.stashbot]
17:26 <wmbot~bd808@tools-bastion-12> Switched OAuth credentials (T376176) [tools.stashbot]
17:13 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [tools]
17:07 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [tools]
17:07 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [toolsbeta]
17:06 <mutante> welcome new deployment user zoe T373666 [production]
17:06 <jhathaway@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
17:03 <aikochou@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revision-models' for release 'main' . [production]
17:03 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
17:02 <taavi> run extensions/CentralAuth/maintenance/migratePass0 on wikitech [production]
16:54 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [tools]
16:48 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [tools]
16:46 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [toolsbeta]
16:44 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T375977) [mwoffliner]
16:44 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T375977) [mwoffliner]
16:42 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
16:41 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm [production]
16:38 <gmodena> deployed refinery source v0.2.51 [analytics]