| 
      
        2019-10-31
      
      §
     | 
  
    
  | 23:33 | 
  <Urbanecm> | 
  Evening SWAT done | 
  [production] | 
            
  | 23:26 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.35.0-wmf.4/extensions/CentralNotice/extension.json: SWAT: dcd3ec3: Fix error in CentralNoticeImpression schema (T236627) (duration: 00m 51s) | 
  [production] | 
            
  | 23:24 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.35.0-wmf.4/extensions/VisualEditor/: SWAT: 3686b82: Revert "Parse relative hrefs on image nodes like on regular links" (T237040) (duration: 00m 53s) | 
  [production] | 
            
  | 23:21 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: 02bf4b8: Re-enable mobile editor A/B testing (T236337) (duration: 00m 52s) | 
  [production] | 
            
  | 23:13 | 
  <Urbanecm> | 
  Purge https://en.wikipedia.org/static/images/project-logos/bawiki* (T237035) | 
  [production] | 
            
  | 23:11 | 
  <urbanecm@deploy1001> | 
  Synchronized static/images/project-logos/: SWAT: 54ee973: Change bawiki logo to an anniversary one (T237035) (duration: 00m 53s) | 
  [production] | 
            
  | 23:04 | 
  <eileen> | 
  civicrm revision changed from d2045c6b98 to 1183915bde, config revision is 1a709a61aa | 
  [production] | 
            
  | 23:00 | 
  <mutante> | 
  replacing deployment keys for apache2secmod ; re-arming keyholder on deployment server | 
  [production] | 
            
  | 22:51 | 
  <XioNoX> | 
  Homer push to cr1/2-eqiad | 
  [production] | 
            
  | 22:17 | 
  <XioNoX> | 
  Homer push to cr1/2-codfw | 
  [production] | 
            
  | 22:14 | 
  <twentyafterfour@deploy1001> | 
  Finished deploy [design/style-guide@4d8d085]: testing deploy_design (duration: 00m 06s) | 
  [production] | 
            
  | 22:14 | 
  <twentyafterfour@deploy1001> | 
  Started deploy [design/style-guide@4d8d085]: testing deploy_design | 
  [production] | 
            
  | 22:12 | 
  <mutante> | 
  vega sudo find /srv/deployment/design/ -uid 498 -exec chown deploy-design:deploy-design {} \; | 
  [production] | 
            
  | 22:12 | 
  <twentyafterfour@deploy1001> | 
  deploy aborted: testing deploy_design (duration: 05m 07s) | 
  [production] | 
            
  | 22:12 | 
  <mutante> | 
  bromine sudo find /srv/deployment/design/ -uid 498 -exec chown deploy-design:deploy-design {} \; | 
  [production] | 
            
  | 22:07 | 
  <twentyafterfour@deploy1001> | 
  Started deploy [design/style-guide@4d8d085]: testing deploy_design | 
  [production] | 
            
  | 22:05 | 
  <twentyafterfour@deploy1001> | 
  Finished deploy [design/style-guide@4d8d085]: testing deploy_design (duration: 01m 30s) | 
  [production] | 
            
  | 22:04 | 
  <twentyafterfour@deploy1001> | 
  Started deploy [design/style-guide@4d8d085]: testing deploy_design | 
  [production] | 
            
  | 21:59 | 
  <mutante> | 
  deploy1001 - recreating deploy_design deployment key as ED25519 and with the correct comment (the comment matters and must match path to the file for keyholder) (T235677) | 
  [production] | 
            
  | 21:49 | 
  <mutante> | 
  deploy1001 keyholder restart, keyholder arm ... | 
  [production] | 
            
  | 21:46 | 
  <mutante> | 
  deploy1001 - move apach2modsec deployment key out of keyholder dir, keyholder arm to reload all other deployment keys including the new one for design (T235677) | 
  [production] | 
            
  | 21:32 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@9cac9ac]: Bump Parsoid-PHP traffic mirroring to 50% T235902 (duration: 13m 44s) | 
  [production] | 
            
  | 21:25 | 
  <robh> | 
  setting up ps1-b8-eqiad per T227543.  it will reboot twice in the next 15 minutes, and then should start to clear up in icinga | 
  [production] | 
            
  | 21:18 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@9cac9ac]: Bump Parsoid-PHP traffic mirroring to 50% T235902 | 
  [production] | 
            
  | 20:35 | 
  <XioNoX> | 
  Homer push to all cr2-eqdfw - new NTP servers, remove border-in4 term unused-ips, add (unused) BGP_Wikimedia_pops, re-order ospf interfaces | 
  [production] | 
            
  | 20:27 | 
  <shdubsh> | 
  restarting logstash on logstash1008 to test level->severity filter selector | 
  [production] | 
            
  | 20:12 | 
  <XioNoX> | 
  Homer push to all msw* - new NTP servers - T237011 | 
  [production] | 
            
  | 20:07 | 
  <XioNoX> | 
  Homer push to all asw* - new NTP servers - T237011 | 
  [production] | 
            
  | 19:49 | 
  <XioNoX> | 
  Homer push to eqsin | 
  [production] | 
            
  | 19:49 | 
  <mutante> | 
  rsyncing home dirs from previous gerrit server cobalt to gerrit1001 | 
  [production] | 
            
  | 19:36 | 
  <fdans@deploy1001> | 
  Finished deploy [analytics/refinery@af91ce6]: deploying refinery, second attempt (duration: 06m 53s) | 
  [production] | 
            
  | 19:31 | 
  <XioNoX> | 
  Homer push to ulsfo | 
  [production] | 
            
  | 19:29 | 
  <fdans@deploy1001> | 
  Started deploy [analytics/refinery@af91ce6]: deploying refinery, second attempt | 
  [production] | 
            
  | 19:08 | 
  <brennen@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.4 | 
  [production] | 
            
  | 18:22 | 
  <Urbanecm> | 
  Morning SWAT done | 
  [production] | 
            
  | 18:21 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.35.0-wmf.4/extensions/CentralNotice: SWAT: 3e5b33f: Update CentralNoticeImpression scheme for campaign fallback (T236627) (duration: 00m 55s) | 
  [production] | 
            
  | 18:20 | 
  <urbanecm@deploy1001> | 
  Synchronized php-1.35.0-wmf.3/extensions/CentralNotice: SWAT: 963e963: Update CentralNoticeImpression scheme for campaign fallback (T236627) (duration: 01m 01s) | 
  [production] | 
            
  | 18:12 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: fe08fbb: Undeploy reader surveys in English, Polish, and Russian (T232525) (duration: 01m 02s) | 
  [production] | 
            
  | 18:01 | 
  <fdans@deploy1001> | 
  Finished deploy [analytics/refinery@8ca04df]: deploying refinery (duration: 01m 09s) | 
  [production] | 
            
  | 18:00 | 
  <fdans@deploy1001> | 
  Started deploy [analytics/refinery@8ca04df]: deploying refinery | 
  [production] | 
            
  | 16:23 | 
  <bd808> | 
  Our @wikimediatech Twitter account is soft blocked pending phone number verification. bd808 trying to figure out a good way to do that verification for a bot account. | 
  [production] | 
            
  | 16:14 | 
  <jynus> | 
  restart dbprov2002 after upgrade T236924 | 
  [production] |