| 2025-07-28
      
      § | 
    
  | 20:47 | <cjming@deploy1003> | cjming, anzx: Continuing with sync | [production] | 
            
  | 20:46 | <cjming@deploy1003> | cjming, anzx: Backport for [[gerrit:1173397|aswikisource: add publisher (প্ৰকাশক) namespace (T399269)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:44 | <cjming@deploy1003> | Started scap sync-world: Backport for [[gerrit:1173397|aswikisource: add publisher (প্ৰকাশক) namespace (T399269)]] | [production] | 
            
  | 20:40 | <cjming@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] (duration: 09m 08s) | [production] | 
            
  | 20:40 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P80144 and previous config saved to /var/cache/conftool/dbconfig/20250728-204028-marostegui.json | [production] | 
            
  | 20:35 | <cjming@deploy1003> | cjming, anzx: Continuing with sync | [production] | 
            
  | 20:34 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P80143 and previous config saved to /var/cache/conftool/dbconfig/20250728-203458-fceratto.json | [production] | 
            
  | 20:33 | <cjming@deploy1003> | cjming, anzx: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:31 | <cjming@deploy1003> | Started scap sync-world: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] | [production] | 
            
  | 20:27 | <cjming@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] (duration: 08m 39s) | [production] | 
            
  | 20:25 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P80142 and previous config saved to /var/cache/conftool/dbconfig/20250728-202521-marostegui.json | [production] | 
            
  | 20:21 | <cjming@deploy1003> | cjming, anzx: Continuing with sync | [production] | 
            
  | 20:20 | <cjming@deploy1003> | cjming, anzx: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:19 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2182 (T399728)', diff saved to https://phabricator.wikimedia.org/P80141 and previous config saved to /var/cache/conftool/dbconfig/20250728-201950-fceratto.json | [production] | 
            
  | 20:18 | <cjming@deploy1003> | Started scap sync-world: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] | [production] | 
            
  | 20:16 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db2182 (T399728)', diff saved to https://phabricator.wikimedia.org/P80140 and previous config saved to /var/cache/conftool/dbconfig/20250728-201655-fceratto.json | [production] | 
            
  | 20:16 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2182.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 20:16 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80139 and previous config saved to /var/cache/conftool/dbconfig/20250728-201633-fceratto.json | [production] | 
            
  | 20:10 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2146 (T399249)', diff saved to https://phabricator.wikimedia.org/P80138 and previous config saved to /var/cache/conftool/dbconfig/20250728-201013-marostegui.json | [production] | 
            
  | 20:01 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P80137 and previous config saved to /var/cache/conftool/dbconfig/20250728-200125-fceratto.json | [production] | 
            
  | 19:47 | <dancy@deploy1003> | Finished deploy [releng/jenkins-deploy@b89eed0] (releasing): Disabling the MediaWiki publish WMF single-version image job (T398873) (duration: 01m 11s) | [production] | 
            
  | 19:46 | <dancy@deploy1003> | Started deploy [releng/jenkins-deploy@b89eed0] (releasing): Disabling the MediaWiki publish WMF single-version image job (T398873) | [production] | 
            
  | 19:46 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P80136 and previous config saved to /var/cache/conftool/dbconfig/20250728-194618-fceratto.json | [production] | 
            
  | 19:31 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80135 and previous config saved to /var/cache/conftool/dbconfig/20250728-193110-fceratto.json | [production] | 
            
  | 19:28 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80134 and previous config saved to /var/cache/conftool/dbconfig/20250728-192817-fceratto.json | [production] | 
            
  | 19:28 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2168.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 19:27 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80133 and previous config saved to /var/cache/conftool/dbconfig/20250728-192754-fceratto.json | [production] | 
            
  | 19:27 | <fabfur> | restarting haproxykafka on A:cp-ulsfo (T400620) | [production] | 
            
  | 19:17 | <fabfur> | updating haproxykafka to v0.3.11 on A:cp-ulsfo (T400620) | [production] | 
            
  | 19:12 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P80132 and previous config saved to /var/cache/conftool/dbconfig/20250728-191247-fceratto.json | [production] | 
            
  | 18:57 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P80131 and previous config saved to /var/cache/conftool/dbconfig/20250728-185739-fceratto.json | [production] | 
            
  | 18:42 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80130 and previous config saved to /var/cache/conftool/dbconfig/20250728-184232-fceratto.json | [production] | 
            
  | 18:39 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80129 and previous config saved to /var/cache/conftool/dbconfig/20250728-183939-fceratto.json | [production] | 
            
  | 18:39 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2159.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 18:39 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2150 (T399728)', diff saved to https://phabricator.wikimedia.org/P80128 and previous config saved to /var/cache/conftool/dbconfig/20250728-183916-fceratto.json | [production] | 
            
  | 18:26 | <ejegg> | payments-wiki upgraded from b942983f to a0f165ad | [production] | 
            
  | 18:24 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P80127 and previous config saved to /var/cache/conftool/dbconfig/20250728-182409-fceratto.json | [production] | 
            
  | 18:22 | <fabfur> | haproxykafka 0.3.11 uploaded to apt repo (T400620) | [production] | 
            
  | 18:21 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db2146 (T399249)', diff saved to https://phabricator.wikimedia.org/P80126 and previous config saved to /var/cache/conftool/dbconfig/20250728-182134-marostegui.json | [production] | 
            
  | 18:21 | <marostegui@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2146.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 18:21 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2145 (T399249)', diff saved to https://phabricator.wikimedia.org/P80125 and previous config saved to /var/cache/conftool/dbconfig/20250728-182111-marostegui.json | [production] | 
            
  | 18:15 | <fabfur> | repooled cp4037 (T400620) | [production] | 
            
  | 18:15 | <fabfur@cumin1002> | conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet | [production] | 
            
  | 18:14 | <fabfur> | depooling cp4037 to upgrade new haproxykafka version (T400620) | [production] | 
            
  | 18:13 | <fabfur@cumin1002> | conftool action : set/pooled=no; selector: name=cp4037.ulsfo.wmnet | [production] | 
            
  | 18:09 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P80124 and previous config saved to /var/cache/conftool/dbconfig/20250728-180901-fceratto.json | [production] | 
            
  | 18:06 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P80123 and previous config saved to /var/cache/conftool/dbconfig/20250728-180603-marostegui.json | [production] | 
            
  | 17:53 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2150 (T399728)', diff saved to https://phabricator.wikimedia.org/P80122 and previous config saved to /var/cache/conftool/dbconfig/20250728-175354-fceratto.json | [production] | 
            
  | 17:51 | <fabfur@cumin1002> | conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet | [production] | 
            
  | 17:51 | <fabfur> | repooling cp4037 after upgrading haproxykafka (T400620) | [production] |