| 
      
        2019-07-08
      
      §
     | 
  
    
  | 12:36 | 
  <kartik@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] | 
  [production] | 
            
  | 11:47 | 
  <Urbanecm> | 
  EU SWAT done | 
  [production] | 
            
  | 11:44 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.34.0-wmf.11/includes/Title.php: SWAT: [[:gerrit:521253|Title: ensure getBaseTitle and getRootTitle return valid Titles]] (T225585) (duration: 00m 50s) | 
  [production] | 
            
  | 11:39 | 
  <Urbanecm> | 
  Purged 14 logo urls for T227418 | 
  [production] | 
            
  | 11:36 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-common.php: SWAT: [[:gerrit:521038|Fix array shape for $wgCirrusSearchExtraIndexes]] (T227379) (duration: 00m 51s) | 
  [production] | 
            
  | 11:31 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:521183|Remove HD logos for projects with no entry in wgLogo or add a wgLogo entry]] (2/2, T227418) (duration: 00m 49s) | 
  [production] | 
            
  | 11:30 | 
  <urbanecm@deploy1001> | 
  Synchronized static/images/project-logos/: SWAT: [[:gerrit:521183|Remove HD logos for projects with no entry in wgLogo or add a wgLogo entry]] (1/2, T227418) (duration: 00m 49s) | 
  [production] | 
            
  | 11:26 | 
  <moritzm> | 
  installing poolcounter1004/1005 | 
  [production] | 
            
  | 11:25 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.34.0-wmf.11/extensions/AbuseFilter/: SWAT: [[:gerrit:520991|Fix query in normalizeThrottleParameters]] (T209565) (duration: 00m 51s) | 
  [production] | 
            
  | 11:22 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: [[gerrit:520780|Disable Wikidata for ProofreadPage namespaces (T227201)]] (duration: 00m 50s) | 
  [production] | 
            
  | 11:16 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [[gerrit:521221|Enable jsonld output format for wikibase entities everywhere (T207168)]] (duration: 00m 49s) | 
  [production] | 
            
  | 11:11 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/flaggedrevs.php: SWAT: [[:gerrit:521194|Remove "עמוד" namespace from wgFlaggedRevsNamespaces for hewikisource]] (T227000) (duration: 00m 49s) | 
  [production] | 
            
  | 11:09 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:520997|Add several Ukrainian government websites to wgCopyUploadsDomains]] (T227366) (duration: 00m 49s) | 
  [production] | 
            
  | 11:07 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:520507|Create "autopatrolled" user group on az.wiktionary]] (T227208) (duration: 00m 49s) | 
  [production] | 
            
  | 11:04 | 
  <urbanecm@deploy1001> | 
  Synchronized dblists/commonsuploads.dblist: SWAT: [[:gerrit:520507|Create "autopatrolled" user group on az.wiktionary]] (T227208) (duration: 00m 50s) | 
  [production] | 
            
  | 10:56 | 
  <moritzm> | 
  installing poolcounter2003/2004 | 
  [production] | 
            
  | 10:39 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:521246| Bumping portals to master (T128546)]] (duration: 00m 49s) | 
  [production] | 
            
  | 10:38 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:521246| Bumping portals to master (T128546)]] (duration: 00m 51s) | 
  [production] | 
            
  | 09:51 | 
  <elukey@cumin1001> | 
  END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) | 
  [production] | 
            
  | 09:51 | 
  <elukey@cumin1001> | 
  START - Cookbook sre.ganeti.makevm | 
  [production] | 
            
  | 09:49 | 
  <ema> | 
  removed /srv/prometheus/ops/targets/varnish-upload-ats_mtail_$DC.yaml from prometheus hosts | 
  [production] | 
            
  | 08:27 | 
  <moritzm> | 
  updated buster installer images to final release | 
  [production] | 
            
  | 07:43 | 
  <moritzm> | 
  rebooting hassium to pick up MDS-enabled qemu | 
  [production] | 
            
  | 07:43 | 
  <jmm@cumin2001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 07:43 | 
  <jmm@cumin2001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 07:40 | 
  <moritzm> | 
  rebooting weblog1001 for kernel security update | 
  [production] | 
            
  | 07:38 | 
  <jynus> | 
  deploying sys schema to missing db production hosts | 
  [production] | 
            
  | 07:34 | 
  <jmm@cumin2001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 07:34 | 
  <jmm@cumin2001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 07:00 | 
  <elukey> | 
  add base::firewall to stat1004 - T170826 | 
  [production] | 
            
  | 06:43 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1109 after changing its binlog format (duration: 00m 49s) | 
  [production] | 
            
  | 06:36 | 
  <marostegui> | 
  Run compare for s5 main tables on db2038 vs db2059 - T221533 | 
  [production] | 
            
  | 06:09 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1109 after changing its binlog format (duration: 00m 49s) | 
  [production] | 
            
  | 05:50 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1094 after upgrade, slowly repool db1109 after changing its binlog format (duration: 00m 49s) | 
  [production] | 
            
  | 05:45 | 
  <marostegui> | 
  Restart MySQL on db1109 to pick up STATEMENT as binlog format - T227062 | 
  [production] | 
            
  | 05:44 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1109 for binlog format change (duration: 00m 49s) | 
  [production] | 
            
  | 05:39 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More weight to db1094 after upgrade (duration: 00m 51s) | 
  [production] | 
            
  | 05:31 | 
  <marostegui> | 
  Compress medium wikis on labsdb1009 - T222978 | 
  [production] | 
            
  | 05:24 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1094 after upgrade (duration: 00m 49s) | 
  [production] | 
            
  | 05:22 | 
  <marostegui> | 
  Drop empty table edit_page_tracking from some s3 wikis - T57385 | 
  [production] | 
            
  | 05:11 | 
  <marostegui> | 
  Drop empty table edit_page_tracking from s7 - T57385 | 
  [production] | 
            
  | 05:08 | 
  <marostegui> | 
  Stop MySQL on db1094 for upgrade | 
  [production] | 
            
  | 05:08 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1094 for upgrade (duration: 00m 50s) | 
  [production] | 
            
  | 03:19 | 
  <sbassett@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Temporary make account creation limits more restrictive (duration: 00m 53s) | 
  [production] | 
            
  | 01:16 | 
  <sbassett@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Temporary make account creation limits more restrictive (duration: 00m 50s) | 
  [production] |