| 
      
        2020-01-07
      
      ยง
     | 
  
    
  | 15:23 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1088', diff saved to https://phabricator.wikimedia.org/P10069 and previous config saved to /var/cache/conftool/dbconfig/20200107-152304-marostegui.json | 
  [production] | 
            
  | 15:16 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1088', diff saved to https://phabricator.wikimedia.org/P10068 and previous config saved to /var/cache/conftool/dbconfig/20200107-151633-marostegui.json | 
  [production] | 
            
  | 15:11 | 
  <moritzm> | 
  installing urldownloader2001 T241979 | 
  [production] | 
            
  | 15:09 | 
  <moritzm> | 
  reimaging mw2282 | 
  [production] | 
            
  | 15:04 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Depool db1088 for upgrade', diff saved to https://phabricator.wikimedia.org/P10067 and previous config saved to /var/cache/conftool/dbconfig/20200107-150440-marostegui.json | 
  [production] | 
            
  | 14:39 | 
  <_joe_> | 
  uploading python3-docker-report to {buster,stretch}-wikimedia, T241206 | 
  [production] | 
            
  | 14:35 | 
  <marostegui> | 
  Power off db2076 for on-site maintenance T241647 | 
  [production] | 
            
  | 14:32 | 
  <marostegui> | 
  Stop MySQL on db2076 for maintenance T241647 | 
  [production] | 
            
  | 14:22 | 
  <marostegui> | 
  Deploy schema change on s7 codfw master, this will generate lag on s7 codfw - T234052 | 
  [production] | 
            
  | 14:21 | 
  <marostegui> | 
  Deploy schema change on s2 codfw master, this will generate lag on s2 codfw - T234052 | 
  [production] | 
            
  | 14:05 | 
  <jmm@cumin2001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 14:03 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1126', diff saved to https://phabricator.wikimedia.org/P10066 and previous config saved to /var/cache/conftool/dbconfig/20200107-140300-marostegui.json | 
  [production] | 
            
  | 14:02 | 
  <jmm@cumin2001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 13:43 | 
  <moritzm> | 
  reimaging mw2282 | 
  [production] | 
            
  | 13:42 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Depool db1126', diff saved to https://phabricator.wikimedia.org/P10065 and previous config saved to /var/cache/conftool/dbconfig/20200107-134251-marostegui.json | 
  [production] | 
            
  | 13:34 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Repool db1104', diff saved to https://phabricator.wikimedia.org/P10064 and previous config saved to /var/cache/conftool/dbconfig/20200107-133439-marostegui.json | 
  [production] | 
            
  | 12:56 | 
  <Lucas_WMDE> | 
  EU SWAT done | 
  [production] | 
            
  | 12:56 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:502480|Fix WBRepoCanonicalUriProperty setting for testwikidatawiki]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:52 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:502479|Fix wgImportSources setting for wikidata dblist]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:39 | 
  <Urbanecm> | 
  Run mwscript initSiteStats.php --wiki=tawiktionary --update (T241684) | 
  [production] | 
            
  | 12:38 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: 5be01f0: Modify $wgArticleCount to any for ta.wiktionary (T241684) (duration: 00m 55s) | 
  [production] | 
            
  | 12:32 | 
  <urbanecm@deploy1001> | 
  Synchronized static/images/project-logos/: SWAT: d6ee5fe: Modify ge.wikimedia project logos (T241327) (duration: 00m 57s) | 
  [production] | 
            
  | 12:29 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Depool db1104', diff saved to https://phabricator.wikimedia.org/P10063 and previous config saved to /var/cache/conftool/dbconfig/20200107-122914-marostegui.json | 
  [production] | 
            
  | 12:17 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:559162|Clean up unused configs in InitialiseSettings.php (T238154)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:15 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:559162|Clean up unused configs in InitialiseSettings.php (T238154)]] (duration: 00m 55s) | 
  [production] | 
            
  | 12:13 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:559161|Clean up unused configs in Wikibase.php (T238154)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:12 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:559161|Clean up unused configs in Wikibase.php (T238154)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:11 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:559161|Clean up unused configs in Wikibase.php (T238154)]] (duration: 00m 56s) | 
  [production] | 
            
  | 11:12 | 
  <aborrero@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 11:12 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 11:12 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 11:11 | 
  <aborrero@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 11:10 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 11:10 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 10:53 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 10:53 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 10:39 | 
  <ladsgroup@deploy1001> | 
  Synchronized php-1.35.0-wmf.11/extensions/Wikibase/lib/includes/Store/Sql/Terms/DatabaseTermIdsAcquirer.php: [[gerrit:562477|Temporary add metrics of the need to reinsert in the new term store]] (duration: 00m 57s) | 
  [production] | 
            
  | 10:19 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 10:19 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 10:07 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Fully repool db1092', diff saved to https://phabricator.wikimedia.org/P10062 and previous config saved to /var/cache/conftool/dbconfig/20200107-100743-marostegui.json | 
  [production] | 
            
  | 10:05 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 10:05 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 10:01 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1092', diff saved to https://phabricator.wikimedia.org/P10061 and previous config saved to /var/cache/conftool/dbconfig/20200107-100157-marostegui.json | 
  [production] | 
            
  | 10:01 | 
  <aborrero@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:01 | 
  <aborrero@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 09:55 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1092', diff saved to https://phabricator.wikimedia.org/P10060 and previous config saved to /var/cache/conftool/dbconfig/20200107-095501-marostegui.json | 
  [production] | 
            
  | 09:52 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 09:52 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 09:49 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1092', diff saved to https://phabricator.wikimedia.org/P10059 and previous config saved to /var/cache/conftool/dbconfig/20200107-094944-marostegui.json | 
  [production] | 
            
  | 09:45 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1092', diff saved to https://phabricator.wikimedia.org/P10058 and previous config saved to /var/cache/conftool/dbconfig/20200107-094506-marostegui.json | 
  [production] |