| 2024-05-06
      
      ยง | 
    
  | 22:22 | <dzahn@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:20 | <dzahn@deploy1002> | helmfile [eqiad] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:20 | <dzahn@deploy1002> | helmfile [codfw] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:18 | <dzahn@deploy1002> | helmfile [codfw] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:14 | <dzahn@deploy1002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:13 | <dzahn@deploy1002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 21:29 | <dancy@deploy1002> | Installation of scap version "4.82.0" completed for 320 hosts | [production] | 
            
  | 21:28 | <dancy@deploy1002> | Installing scap version "4.82.0" for 320 hosts | [production] | 
            
  | 20:47 | <jdrewniak@deploy1002> | Finished scap: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] (duration: 15m 10s) | [production] | 
            
  | 20:37 | <mutante> | deleting buster deployment server deploy-1004, replaced by deploy-1006  - T360964 | [devtools] | 
            
  | 20:34 | <jdrewniak@deploy1002> | jdrewniak: Continuing with sync | [production] | 
            
  | 20:34 | <jdrewniak@deploy1002> | jdrewniak: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:32 | <jdrewniak@deploy1002> | Started scap: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] | [production] | 
            
  | 20:29 | <Reedy> | Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1028596 | [releng] | 
            
  | 20:27 | <jdrewniak@deploy1002> | Finished scap: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] (duration: 21m 33s) | [production] | 
            
  | 20:14 | <jdrewniak@deploy1002> | esanders and jdrewniak: Continuing with sync | [production] | 
            
  | 20:14 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed e5e9116fc9 (optimize GitLab CI; pulled without webservice restart) | [tools.wd-image-positions] | 
            
  | 20:09 | <jdrewniak@deploy1002> | esanders and jdrewniak: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:05 | <jdrewniak@deploy1002> | Started scap: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] | [production] | 
            
  | 19:50 | <Reedy> | Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/1028587 | [releng] | 
            
  | 19:46 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s7 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 19:25 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete rcenhancedfilters-seen-highlight-button-counter # T364269 | [production] | 
            
  | 19:23 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ mwscript userOptions.php --wiki=enwiki --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 19:21 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete rcenhancedfilters-seen-highlight-button-counter # T364269 | [production] | 
            
  | 19:17 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete rcenhancedfilters-tried-highlight # T364269 | [production] | 
            
  | 19:17 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete rcenhancedfilters-tried-highlight # T364269 | [production] | 
            
  | 19:15 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s3 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 19:01 | <dancy> | Rebooting deployment-mediawiki12.deployment-prep to verify that it is reboot safe (T356692) | [releng] | 
            
  | 18:27 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed e8d438134b (add GitLab CI for T363626; pulled without webservice restart) | [tools.wd-image-positions] | 
            
  | 18:20 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 18:20 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 18:20 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s4 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 18:20 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s2 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 18:18 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ mwscript userOptions.php --wiki=loginwiki --delete wlenhancedfilters-seen-tour # T364269 | [production] | 
            
  | 18:17 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61979 and previous config saved to /var/cache/conftool/dbconfig/20240506-181706-marostegui.json | [production] | 
            
  | 18:01 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P61978 and previous config saved to /var/cache/conftool/dbconfig/20240506-180158-marostegui.json | [production] | 
            
  | 17:46 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P61977 and previous config saved to /var/cache/conftool/dbconfig/20240506-174651-marostegui.json | [production] | 
            
  | 17:31 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61976 and previous config saved to /var/cache/conftool/dbconfig/20240506-173143-marostegui.json | [production] | 
            
  | 17:21 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61975 and previous config saved to /var/cache/conftool/dbconfig/20240506-172126-marostegui.json | [production] | 
            
  | 17:21 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2216.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 17:21 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 4:00:00 on db2216.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 17:21 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212 (T361627)', diff saved to https://phabricator.wikimedia.org/P61974 and previous config saved to /var/cache/conftool/dbconfig/20240506-172103-marostegui.json | [production] | 
            
  | 17:15 | <Rook> | upgrade pywikibot T364188 | [paws] | 
            
  | 17:05 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P61973 and previous config saved to /var/cache/conftool/dbconfig/20240506-170556-marostegui.json | [production] | 
            
  | 17:04 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed c5618f5968 (set bot flag in bulk mode) | [tools.lexeme-forms] | 
            
  | 16:52 | <sukhe> | sudo cumin 'A:ncredir' 'run-puppet-agent --enable "merging CR 1028514"' | [production] | 
            
  | 16:50 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P61972 and previous config saved to /var/cache/conftool/dbconfig/20240506-165048-marostegui.json | [production] | 
            
  | 16:45 | <sukhe> | disable puppet on A:ncredir to merge CR 1028514 | [production] | 
            
  | 16:38 | <jayme@cumin1002> | END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw2382.codfw.wmnet | [production] | 
            
  | 16:38 | <jayme@cumin1002> | START - Cookbook sre.hosts.remove-downtime for mw2382.codfw.wmnet | [production] |