201-250 of 10000 results (19ms)
2024-11-12 §
08:02 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
08:02 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
08:02 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
08:02 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
07:53 <jmm@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti-test2003 [production]
07:53 <jmm@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti-test2003 [production]
07:52 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled [production]
07:52 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 5 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled [production]
05:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.43.0-wmf.28 (duration: 01m 52s) [production]
2024-11-11 §
23:20 <tgr|away> UTC late deploys done [production]
23:08 <tgr@deploy2002> scap failed: <CalledProcessError> Command '['sudo', '-u', 'mwbuilder', '-n', '--', '/usr/bin/scap', 'mwscript', '--no-local-config', '--directory', '/srv/mediawiki-staging', '--user', 'www-data', '--network', '--', 'purgeMessageBlobStore.php']' returned non-zero exit status 1. (scap version: 4.122.0) (duration: 11m 44s) [production]
23:02 <tgr@deploy2002> d3r1ck01, tgr: Continuing with sync [production]
22:59 <tgr@deploy2002> d3r1ck01, tgr: Backport for [[gerrit:1089807|PageUpdater: restore call to RevisionFromEditComplete (T379152)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:56 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1089807|PageUpdater: restore call to RevisionFromEditComplete (T379152)]] [production]
22:30 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1089864|contactpage: Update AffCom contact form messages (Resubmit) (T375392)]] (duration: 25m 48s) [production]
22:21 <tgr@deploy2002> tgr: Continuing with sync [production]
22:19 <tgr@deploy2002> tgr: Backport for [[gerrit:1089864|contactpage: Update AffCom contact form messages (Resubmit) (T375392)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:13 <eileen> civicrm upgraded from 4330588d to bcd072a1 [production]
22:05 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1089864|contactpage: Update AffCom contact form messages (Resubmit) (T375392)]] [production]
21:38 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1082174|contactpages: Update Affcom UserGroup application form (T375392)]] (duration: 28m 07s) [production]
21:33 <tgr@deploy2002> ammarpad, tgr: Continuing with sync [production]
21:12 <tgr@deploy2002> ammarpad, tgr: Backport for [[gerrit:1082174|contactpages: Update Affcom UserGroup application form (T375392)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:10 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1082174|contactpages: Update Affcom UserGroup application form (T375392)]] [production]
20:21 <eileen> civicrm upgraded from 65a8de90 to 4330588d [production]
19:46 <wmbot~lucaswerkmeister@tools-bastion-13> deployed a6d0e2ad43 (l10n updates: ar) [tools.wd-image-positions]
17:55 <oblivian@cumin1002> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Add superset links - oblivian@cumin1002 - T379567" [production]
17:55 <oblivian@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Add superset links - oblivian@cumin1002 - T379567 [production]
17:54 <oblivian@cumin1002> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Add superset links - oblivian@cumin1002 - T379567 [production]
17:54 <oblivian@cumin1002> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Add superset links - oblivian@cumin1002 - T379567" [production]
17:34 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component tools-webservice [toolsbeta]
17:34 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component tools-webservice [toolsbeta]
16:23 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
16:19 <elukey> restart pybal on lvs2013 (primary) to pick up new kartotherian-k8s-ssl service [production]
16:17 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
16:17 <elukey> restart pybal on lvs2014 (secondary) to pick up new kartotherian-k8s-ssl service [production]
16:10 <elukey> restart pybal on lvs1019 (primary) to pick up new kartotherian-k8s-ssl service [production]
16:09 <elukey> restart pybal on lvs1020 (secondary) to pick up new kartotherian-k8s-ssl service [production]
16:09 <moritzm> installing libarchive security updates [production]
16:06 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [toolsbeta]
16:06 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.openstack.cloudvirt.vm_console [toolsbeta]
16:06 <dhinus> revoke expired cert for mwv-builder-03.mediawiki-vagrant.eqiad.wmflabs (puppetserver ca clean from cloudinfra-cloudvps-puppetserver-1) [cloudinfra]
16:04 <dhinus> tried and failed to regenerate puppet certs on mwv-puppetserver-01 (puppetserver ca was failing with "certificate expired") [mediawiki-vagrant]
16:04 <dcaro@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255) [toolsbeta]
16:04 <dcaro@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.vm_console [toolsbeta]
16:03 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [toolsbeta]
16:03 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.openstack.cloudvirt.vm_console [toolsbeta]
16:02 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on tools-db-4.tools.eqiad1.wikimedia.cloud (T352206) [tools]
16:02 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [toolsbeta]
16:02 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.openstack.cloudvirt.vm_console [toolsbeta]
16:02 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [toolsbeta]