| 2024-05-29
      
      § | 
    
  | 02:34 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 6:00:00 on db1202.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 02:34 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1194 (T364299)', diff saved to https://phabricator.wikimedia.org/P63497 and previous config saved to /var/cache/conftool/dbconfig/20240529-023409-marostegui.json | [production] | 
            
  | 02:19 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P63496 and previous config saved to /var/cache/conftool/dbconfig/20240529-021901-marostegui.json | [production] | 
            
  | 02:03 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P63495 and previous config saved to /var/cache/conftool/dbconfig/20240529-020353-marostegui.json | [production] | 
            
  | 01:48 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1194 (T364299)', diff saved to https://phabricator.wikimedia.org/P63494 and previous config saved to /var/cache/conftool/dbconfig/20240529-014845-marostegui.json | [production] | 
            
  | 00:43 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db1194 (T364299)', diff saved to https://phabricator.wikimedia.org/P63493 and previous config saved to /var/cache/conftool/dbconfig/20240529-004343-marostegui.json | [production] | 
            
  | 00:43 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1194.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 00:43 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 6:00:00 on db1194.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 00:43 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1191 (T364299)', diff saved to https://phabricator.wikimedia.org/P63492 and previous config saved to /var/cache/conftool/dbconfig/20240529-004319-marostegui.json | [production] | 
            
  | 00:28 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P63491 and previous config saved to /var/cache/conftool/dbconfig/20240529-002811-marostegui.json | [production] | 
            
  | 00:13 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P63490 and previous config saved to /var/cache/conftool/dbconfig/20240529-001303-marostegui.json | [production] | 
            
  
    | 2024-05-28
      
      § | 
    
  | 23:57 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1191 (T364299)', diff saved to https://phabricator.wikimedia.org/P63489 and previous config saved to /var/cache/conftool/dbconfig/20240528-235755-marostegui.json | [production] | 
            
  | 22:55 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db1191 (T364299)', diff saved to https://phabricator.wikimedia.org/P63488 and previous config saved to /var/cache/conftool/dbconfig/20240528-225541-marostegui.json | [production] | 
            
  | 22:55 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1191.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 22:55 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 6:00:00 on db1191.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 22:55 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1181 (T364299)', diff saved to https://phabricator.wikimedia.org/P63487 and previous config saved to /var/cache/conftool/dbconfig/20240528-225516-marostegui.json | [production] | 
            
  | 22:50 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:50 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:48 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:48 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:45 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:45 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:43 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:43 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:41 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:41 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:40 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P63486 and previous config saved to /var/cache/conftool/dbconfig/20240528-224008-marostegui.json | [production] | 
            
  | 22:39 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:39 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:37 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:37 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:34 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:34 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:32 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:32 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:30 | <logmsgbot> | @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:30 | <logmsgbot> | @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:25 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P63485 and previous config saved to /var/cache/conftool/dbconfig/20240528-222500-marostegui.json | [production] | 
            
  | 22:09 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1181 (T364299)', diff saved to https://phabricator.wikimedia.org/P63484 and previous config saved to /var/cache/conftool/dbconfig/20240528-220950-marostegui.json | [production] | 
            
  | 21:10 | <ejegg> | payments-wiki upgraded from 0bed1814 to 8ff002ef | [production] | 
            
  | 21:06 | <ejegg> | donorwiki upgraded from fa7de70f to 8ff002ef | [production] | 
            
  | 21:05 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db1181 (T364299)', diff saved to https://phabricator.wikimedia.org/P63483 and previous config saved to /var/cache/conftool/dbconfig/20240528-210533-marostegui.json | [production] | 
            
  | 21:05 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 21:05 | <ejegg> | payments-wiki upgraded from 2bfd247a to 0bed1814 | [production] | 
            
  | 21:05 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 21:05 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1174 (T364299)', diff saved to https://phabricator.wikimedia.org/P63482 and previous config saved to /var/cache/conftool/dbconfig/20240528-210510-marostegui.json | [production] | 
            
  | 21:01 | <jdrewniak@deploy1002> | Synchronized portals: Wikimedia Portals Update: [[gerrit:1036737| Bumping portals to master (T128546)]] (duration: 10m 21s) | [production] | 
            
  | 20:51 | <jdrewniak@deploy1002> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:1036737| Bumping portals to master (T128546)]] (duration: 11m 23s) | [production] | 
            
  | 20:50 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P63481 and previous config saved to /var/cache/conftool/dbconfig/20240528-205001-marostegui.json | [production] | 
            
  | 20:34 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P63479 and previous config saved to /var/cache/conftool/dbconfig/20240528-203453-marostegui.json | [production] |