| 
      
        2021-06-24
      
      ยง
     | 
  
    
  | 18:18 | 
  <cmjohnson@cumin1001> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 18:17 | 
  <cmjohnson@cumin1001> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 18:12 | 
  <cmjohnson@cumin1001> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 17:12 | 
  <dduvall@deploy1002> | 
  Synchronized php: group1 wikis to 1.37.0-wmf.11 (duration: 01m 06s) | 
  [production] | 
            
  | 17:11 | 
  <dduvall@deploy1002> | 
  rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.11 | 
  [production] | 
            
  | 17:08 | 
  <dduvall> | 
  re-rolling group1 to 1.37.0-wmf.11 (T281152) following deployment of blocker fixes (cc risky patch contacts Amir1 Krinkle DannyS712) | 
  [production] | 
            
  | 16:12 | 
  <twentyafterfour> | 
  restarted php7.3-fpm on phab1001 | 
  [production] | 
            
  | 15:43 | 
  <hnowlan> | 
  running `nodetool decommission` on maps2007 | 
  [production] | 
            
  | 15:42 | 
  <hnowlan@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=maps2007.codfw.wmnet | 
  [production] | 
            
  | 15:42 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps2007.codfw.wmnet with reason: depooling and reimaging as buster replica | 
  [production] | 
            
  | 15:42 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps2007.codfw.wmnet with reason: depooling and reimaging as buster replica | 
  [production] | 
            
  | 15:31 | 
  <moritzm> | 
  installing jackson-databind security updates | 
  [production] | 
            
  | 15:26 | 
  <moritzm> | 
  installing ruby-websocket-extensions security updates | 
  [production] | 
            
  | 15:02 | 
  <hnowlan> | 
  reenabling puppet on P{C:Postgresql::Slave} | 
  [production] | 
            
  | 14:59 | 
  <moritzm> | 
  restarting mw canaries to pick up libxml2 security update | 
  [production] | 
            
  | 14:57 | 
  <moritzm> | 
  installing libxml2 security updates on buster | 
  [production] | 
            
  | 14:46 | 
  <hnowlan> | 
  Disabling puppet on P{C:Postgresql::Slave} (netboxdb2001,puppetdb2002, most maps hosts) to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/700071 | 
  [production] | 
            
  | 13:29 | 
  <volans> | 
  uploaded python3-wmflib_0.0.8 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia | 
  [production] | 
            
  | 12:45 | 
  <tgr> | 
  EU deploys done | 
  [production] | 
            
  | 12:44 | 
  <tgr@deploy1002> | 
  Finished scap: Backport: [[gerrit:701364|Re-apply "Add custom signup flow for donors", step 3 (T284799 T284740 T284800 T285281)]] (duration: 26m 07s) | 
  [production] | 
            
  | 12:18 | 
  <tgr@deploy1002> | 
  Started scap: Backport: [[gerrit:701364|Re-apply "Add custom signup flow for donors", step 3 (T284799 T284740 T284800 T285281)]] | 
  [production] | 
            
  | 12:08 | 
  <tgr@deploy1002> | 
  Synchronized php-1.37.0-wmf.9/extensions/GrowthExperiments: Backport: [[gerrit:701363|Re-apply "Add custom signup flow for donors", step 2 (T284799 T284740 T284800 T285281)]] (duration: 01m 06s) | 
  [production] | 
            
  | 11:53 | 
  <jayme> | 
  import dragonfly_1.0.6-1 into buster-wikimedia | 
  [production] | 
            
  | 11:44 | 
  <jayme@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on registry2008.codfw.wmnet with reason: Dragonfly tests (jayme) | 
  [production] | 
            
  | 11:44 | 
  <jayme@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on registry2008.codfw.wmnet with reason: Dragonfly tests (jayme) | 
  [production] | 
            
  | 11:37 | 
  <jayme> | 
  depooling registry2008 for some dragonfly testing | 
  [production] | 
            
  | 11:37 | 
  <jayme@cumin1001> | 
  conftool action : set/pooled=inactive; selector: name=registry2008.codfw.wmnet,dc=codfw,cluster=docker-registry | 
  [production] | 
            
  | 11:34 | 
  <tgr@deploy1002> | 
  Synchronized php-1.37.0-wmf.9/extensions/GrowthExperiments: Backport: [[gerrit:701361|Re-apply "Add custom signup flow for donors", step 1 (T284799 T284740 T284800 T285281)]] (duration: 01m 06s) | 
  [production] | 
            
  | 11:25 | 
  <tgr@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:699290|Update $wgNamespacesToBeSearchedDefault for wikimania (T284793)]] (duration: 01m 07s) | 
  [production] | 
            
  | 11:21 | 
  <tgr@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:701225|Enable OCR tool on all Wikisources (T285311)]] (duration: 01m 06s) | 
  [production] | 
            
  | 11:10 | 
  <tgr@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:701351|GrowthExperiments: Enable link recommendation feature for more wikis (T284481)]] (duration: 01m 07s) | 
  [production] | 
            
  | 09:22 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16723 and previous config saved to /var/cache/conftool/dbconfig/20210624-092226-marostegui.json | 
  [production] | 
            
  | 09:21 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16722 and previous config saved to /var/cache/conftool/dbconfig/20210624-092157-marostegui.json | 
  [production] | 
            
  | 09:21 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16721 and previous config saved to /var/cache/conftool/dbconfig/20210624-092105-marostegui.json | 
  [production] | 
            
  | 09:20 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16720 and previous config saved to /var/cache/conftool/dbconfig/20210624-092029-marostegui.json | 
  [production] | 
            
  | 09:19 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16719 and previous config saved to /var/cache/conftool/dbconfig/20210624-091949-marostegui.json | 
  [production] | 
            
  | 09:17 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s2 weights T284897', diff saved to https://phabricator.wikimedia.org/P16718 and previous config saved to /var/cache/conftool/dbconfig/20210624-091753-marostegui.json | 
  [production] | 
            
  | 09:02 | 
  <ladsgroup@deploy1002> | 
  Synchronized php-1.37.0-wmf.11/includes: Backport: [[gerrit:701191|media: Make the file metadata "_error" check looser (T285431)]] (duration: 01m 12s) | 
  [production] | 
            
  | 08:55 | 
  <legoktm> | 
  root@lists1001:/var/log/mailman# rm -rf * | 
  [production] | 
            
  | 08:41 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s3 weights T284897', diff saved to https://phabricator.wikimedia.org/P16717 and previous config saved to /var/cache/conftool/dbconfig/20210624-084147-marostegui.json | 
  [production] | 
            
  | 08:14 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16716 and previous config saved to /var/cache/conftool/dbconfig/20210624-081409-marostegui.json | 
  [production] | 
            
  | 08:12 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16715 and previous config saved to /var/cache/conftool/dbconfig/20210624-081251-marostegui.json | 
  [production] | 
            
  | 08:11 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16714 and previous config saved to /var/cache/conftool/dbconfig/20210624-081137-marostegui.json | 
  [production] | 
            
  | 08:09 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Remove db1130 from s5 api T284897', diff saved to https://phabricator.wikimedia.org/P16713 and previous config saved to /var/cache/conftool/dbconfig/20210624-080945-marostegui.json | 
  [production] | 
            
  | 08:09 | 
  <kormat@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:45:00 on 216 hosts with reason: Change replication monitoring config T284897 | 
  [production] | 
            
  | 08:08 | 
  <kormat@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 0:45:00 on 216 hosts with reason: Change replication monitoring config T284897 | 
  [production] | 
            
  | 07:56 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s6 weights T284897', diff saved to https://phabricator.wikimedia.org/P16712 and previous config saved to /var/cache/conftool/dbconfig/20210624-075613-marostegui.json | 
  [production] | 
            
  | 07:42 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s7 weights T284897', diff saved to https://phabricator.wikimedia.org/P16711 and previous config saved to /var/cache/conftool/dbconfig/20210624-074200-marostegui.json | 
  [production] | 
            
  | 07:35 | 
  <eileen> | 
  civicrm revision changed from 6d3dd6e5a5 to 9d1203fb28, config revision is 735af27f0d | 
  [production] | 
            
  | 07:26 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Adjust s8 weights T284897', diff saved to https://phabricator.wikimedia.org/P16710 and previous config saved to /var/cache/conftool/dbconfig/20210624-072657-marostegui.json | 
  [production] |