| 
      
        2021-08-20
      
      §
     | 
  
    
  | 06:07 | 
  <TimStarling> | 
  sending election email to 44k people | 
  [production] | 
            
  | 03:15 | 
  <legoktm@deploy1002> | 
  Synchronized php-1.37.0-wmf.19/extensions/Score/scripts/removeTagline.php: removeTagline: Set explicit pcre.backtrack_limit (T289298) (duration: 00m 58s) | 
  [production] | 
            
  | 03:12 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 03:11 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 00:18 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 00:16 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 00:13 | 
  <tstarling@deploy1002> | 
  Synchronized php-1.37.0-wmf.19/extensions/SecurePoll/cli/wm-scripts/makeMailingList.php: code that uses said hack (duration: 00m 57s) | 
  [production] | 
            
  | 00:12 | 
  <tstarling@deploy1002> | 
  Synchronized php-1.37.0-wmf.19/extensions/SecurePoll/includes/User/LocalAuth.php: hack for mailout (duration: 00m 58s) | 
  [production] | 
            
  | 00:09 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 00:08 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  
    | 
      
        2021-08-19
      
      §
     | 
  
    
  | 23:15 | 
  <brennen> | 
  ended backport & config window early, as no patches were scheduled and no new attendees for this week | 
  [production] | 
            
  | 22:42 | 
  <ejegg> | 
  updated payments-wiki from 0a27dbe9b6 to 564daed816 | 
  [production] | 
            
  | 21:20 | 
  <Amir1> | 
  ladsgroup@mwmaint2002:~$ mwscript extensions/FlaggedRevs/maintenance/pruneRevData.php --wiki=huwiki --prune (T289249) | 
  [production] | 
            
  | 19:13 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 19:12 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 19:07 | 
  <brennen@deploy1002> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.37.0-wmf.19 | 
  [production] | 
            
  | 19:07 | 
  <razzi@deploy1002> | 
  Finished deploy [analytics/aqs/deploy@57c253e]: Deploy aqs 9c062f2 (duration: 03m 30s) | 
  [production] | 
            
  | 19:03 | 
  <razzi@deploy1002> | 
  Started deploy [analytics/aqs/deploy@57c253e]: Deploy aqs 9c062f2 | 
  [production] | 
            
  | 18:27 | 
  <razzi> | 
  Beginning aqs deploy process | 
  [production] | 
            
  | 18:00 | 
  <herron@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts kafkamon2001.codfw.wmnet | 
  [production] | 
            
  | 17:49 | 
  <herron@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts kafkamon2001.codfw.wmnet | 
  [production] | 
            
  | 17:48 | 
  <herron@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts kafkamon1001.eqiad.wmnet | 
  [production] | 
            
  | 17:41 | 
  <herron@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts kafkamon1001.eqiad.wmnet | 
  [production] | 
            
  | 17:11 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts maps1004.eqiad.wmnet | 
  [production] | 
            
  | 17:01 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts maps1004.eqiad.wmnet | 
  [production] | 
            
  | 17:00 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts maps1003.eqiad.wmnet | 
  [production] | 
            
  | 16:54 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 16:52 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 16:49 | 
  <legoktm@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Re-enable Score with Shellbox on most public wikis (T257066) (duration: 01m 08s) | 
  [production] | 
            
  | 16:46 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts maps1003.eqiad.wmnet | 
  [production] | 
            
  | 16:45 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts maps1002.eqiad.wmnet | 
  [production] | 
            
  | 16:31 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts maps1002.eqiad.wmnet | 
  [production] | 
            
  | 16:31 | 
  <hnowlan@cumin1001> | 
  END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts maps1002.eqiad.wmnet | 
  [production] | 
            
  | 16:30 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts maps1002.eqiad.wmnet | 
  [production] | 
            
  | 16:28 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts maps1001.eqiad.wmnet | 
  [production] | 
            
  | 16:14 | 
  <hnowlan@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts maps1001.eqiad.wmnet | 
  [production] | 
            
  | 16:14 | 
  <hnowlan> | 
  starting decommission of old eqiad maps hardware | 
  [production] | 
            
  | 16:10 | 
  <cwhite> | 
  remove rotated logstash-plain-* and logstash-json-* logs on logstash collectors | 
  [production] | 
            
  | 16:00 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . | 
  [production] | 
            
  | 15:53 | 
  <dpifke@deploy1002> | 
  Finished deploy [performance/navtiming@f8bf39f]: Deploy CpuBenchmark processor again T281243 (duration: 00m 06s) | 
  [production] | 
            
  | 15:52 | 
  <dpifke@deploy1002> | 
  Started deploy [performance/navtiming@f8bf39f]: Deploy CpuBenchmark processor again T281243 | 
  [production] | 
            
  | 15:50 | 
  <Amir1> | 
  test2wiki)> delete from flaggedtemplates where ft_rev_id not in (select fp_stable from flaggedpages); (T289249) | 
  [production] | 
            
  | 15:42 | 
  <hnowlan@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=maps2005.codfw.wmnet | 
  [production] | 
            
  | 15:40 | 
  <hnowlan@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=maps2005.codfw.wmnet | 
  [production] | 
            
  | 15:38 | 
  <jiji@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . | 
  [production] | 
            
  | 15:35 | 
  <hnowlan@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=maps2005.codfw.wmnet | 
  [production] | 
            
  | 15:33 | 
  <hnowlan@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=maps2005.codfw.wmnet | 
  [production] | 
            
  | 15:29 | 
  <jiji@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . | 
  [production] | 
            
  | 15:25 | 
  <jiji@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . | 
  [production] | 
            
  | 15:06 | 
  <hnowlan@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on maps[1001-1004].eqiad.wmnet with reason: Awaiting decommissioning | 
  [production] |