| 2024-10-04
      
      § | 
    
  | 13:32 | <bking@cumin2002> | START - Cookbook sre.wdqs.categories-reload reloading categories to wdqs-categories1001.eqiad.wmnet | [production] | 
            
  | 13:19 | <ayounsi@cumin1002> | START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet | [production] | 
            
  | 12:00 | <jnuche@deploy2002> | Finished deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) (duration: 01m 13s) | [production] | 
            
  | 11:59 | <jnuche@deploy2002> | Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) | [production] | 
            
  | 11:47 | <jnuche@deploy2002> | Finished deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) (duration: 00m 47s) | [production] | 
            
  | 11:46 | <jnuche@deploy2002> | Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) | [production] | 
            
  | 10:19 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2004.wikimedia.org | [production] | 
            
  | 10:16 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host irc2004.wikimedia.org | [production] | 
            
  | 10:13 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1004.wikimedia.org | [production] | 
            
  | 10:09 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host irc1004.wikimedia.org | [production] | 
            
  | 10:07 | <moritzm> | upload ircstream 0.13.0+sse12u1 to apt.wikimedia.org bookworm/ircstream-sse component (seperate build using the experimental eventstream feature branch of ircstream) T376014 | [production] | 
            
  | 09:43 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database shnwikinews (T375432) | [production] | 
            
  | 09:35 | <moritzm> | upload ircstream 0.13.0+wmf12u1 to apt.wikimedia.org T376014 | [production] | 
            
  | 09:18 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database shnwikinews (T375432) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kgewiki (T374814) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database kgewiki (T374814) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database gorwikiquote (T375094) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database gorwikiquote (T375094) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database madwiktionary (T375023) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database madwiktionary (T375023) | [production] | 
            
  | 09:15 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database moswiki (T375568) | [production] | 
            
  | 09:15 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database moswiki (T375568) | [production] | 
            
  | 09:09 | <jelto@deploy2002> | helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply | [production] | 
            
  | 08:58 | <jelto@deploy2002> | helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply | [production] | 
            
  | 07:51 | <oblivian@puppetserver1001> | conftool action : set/weight=10; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet | [production] | 
            
  | 07:51 | <oblivian@puppetserver1001> | conftool action : set/weight=1; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet | [production] | 
            
  | 07:30 | <hashar> | upgrading Jenkins on CI Jenkins | [production] | 
            
  | 07:04 | <moritzm> | import jenkins 2.462.3 to thirdparty/ci T376449 | [production] | 
            
  | 01:45 | <ejegg> | payments-wiki upgraded from e88750e6 to ed2d78b3 | [production] | 
            
  
    | 2024-10-03
      
      § | 
    
  | 22:37 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] (duration: 07m 04s) | [production] | 
            
  | 22:33 | <brennen@deploy2002> | brennen: Continuing with sync | [production] | 
            
  | 22:32 | <brennen@deploy2002> | brennen: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:30 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 22:18 | <brennen@deploy2002> | scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m | [production] | 
            
  | 22:18 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 22:15 | <brennen@deploy2002> | scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m | [production] | 
            
  | 22:15 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 21:39 | <bking@cumin2002> | END (FAIL) - Cookbook sre.wdqs.categories-reload (exit_code=99) reloading categories to wdqs-categories1001.eqiad.wmnet | [production] | 
            
  | 21:38 | <bking@cumin2002> | START - Cookbook sre.wdqs.categories-reload reloading categories to wdqs-categories1001.eqiad.wmnet | [production] | 
            
  | 21:28 | <brennen> | end of UTC late backport & config window | [production] | 
            
  | 21:28 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077460|Turn on Parsoid Selective Update metrics (T371713)]] (duration: 15m 30s) | [production] | 
            
  | 21:23 | <brennen@deploy2002> | cscott, brennen: Continuing with sync | [production] | 
            
  | 21:15 | <brennen@deploy2002> | cscott, brennen: Backport for [[gerrit:1077460|Turn on Parsoid Selective Update metrics (T371713)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:13 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077460|Turn on Parsoid Selective Update metrics (T371713)]] | [production] | 
            
  | 21:11 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077792|RefreshLinksJob: Fix exception due to null/false confusion (take 2)]] (duration: 10m 09s) | [production] | 
            
  | 21:06 | <brennen@deploy2002> | cscott, brennen: Continuing with sync | [production] | 
            
  | 21:02 | <brennen@deploy2002> | cscott, brennen: Backport for [[gerrit:1077792|RefreshLinksJob: Fix exception due to null/false confusion (take 2)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:00 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077792|RefreshLinksJob: Fix exception due to null/false confusion (take 2)]] | [production] | 
            
  | 20:56 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1022.eqiad.wmnet with OS bullseye | [production] | 
            
  | 20:44 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077734|Update jquery.ime from upstream]] (duration: 09m 25s) | [production] |