| 2019-09-09
      
      § | 
    
  | 23:44 | <catrope@deploy1001> | Synchronized php-1.34.0-wmf.21/skins/MinervaNeue/: T232260 (duration: 00m 57s) | [production] | 
            
  | 22:28 | <ejegg> | updated payments-wiki from 51d9ed79b6 to 15baf7f58b | [production] | 
            
  | 20:50 | <urandom> | bootstrapping Cassandra, restbase-dev1004-b -- T224554 | [production] | 
            
  | 19:48 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 (duration: 05m 45s) | [production] | 
            
  | 19:42 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 | [production] | 
            
  | 19:41 | <mdholloway> | mobileapps deployment failed repooling canary (scb2001); retrying | [production] | 
            
  | 19:40 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 (duration: 02m 59s) | [production] | 
            
  | 19:37 | <XioNoX> | fix eqsin CF tunnel missconfig | [production] | 
            
  | 19:37 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 | [production] | 
            
  | 17:56 | <andrewbogott> | disabling puppet on labpuppetmaster1001 as part of T171188 | [production] | 
            
  | 17:55 | <XioNoX> | push cloudflare tunnel config to cr1-eqsin | [production] | 
            
  | 16:50 | <papaul> | replacing Fan kit and power supplies on cr1-codfw | [production] | 
            
  | 14:22 | <urandom> | bootstrapping Cassandra, restbase-dev1004-a -- T224554 | [production] | 
            
  | 13:51 | <vgutierrez> | upgrading ats to 8.0.5-1wm6 on cp5001 - T232298 | [production] | 
            
  | 13:39 | <vgutierrez> | uploaded trafficserver 8.0.5-1wm6 to apt.wikimedia.org (stretch) - T232298 | [production] | 
            
  | 13:31 | <moritzm> | installing facter update from buster 10.1 point release (T222356) | [production] | 
            
  | 13:15 | <moritzm> | upgrading labweb/wikitech to PHP 7.2.22 T230024 | [production] | 
            
  | 13:02 | <Urbanecm> | Patch is deployed, deploy1001 should be clear | [production] | 
            
  | 13:01 | <moritzm> | upgrading remaining mediawiki app servers (mw1266-mw1275) to PHP 7.2.22 T230024 | [production] | 
            
  | 12:55 | <urbanecm@deploy1001> | Synchronized php-1.34.0-wmf.21/extensions/WikibaseMediaInfo/: ubn patch T231276 (duration: 00m 58s) | [production] | 
            
  | 12:51 | <urbanecm@deploy1001> | Synchronized php-1.34.0-wmf.21/extensions/Wikibase: ubn patch T231276 (duration: 01m 03s) | [production] | 
            
  | 12:48 | <moritzm> | upgrading remaining job runners to PHP 7.2.22 T230024 | [production] | 
            
  | 12:44 | <Urbanecm> | EU SWAT wmf patch ongoing, testing with mwdebug1002 | [production] | 
            
  | 12:41 | <ema> | lvs1015 (primary): restart pybal to add service restbase-ssl T210411 | [production] | 
            
  | 12:36 | <ema> | lvs2003 (primary): restart pybal to add service restbase-ssl T210411 | [production] | 
            
  | 12:32 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=restbase-ssl,dc=eqiad | [production] | 
            
  | 12:30 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=restbase-ssl,dc=codfw | [production] | 
            
  | 12:29 | <elukey> | restart archiva again to debug download artifact issue | [production] | 
            
  | 12:24 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=restbase-ssl,name=restbase2009.codfw.wmnet | [production] | 
            
  | 12:24 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=restbase-ssl,name=restbase1022.eqiad.wmnet | [production] | 
            
  | 12:11 | <Urbanecm> | Undeployed patch in wmf branch, will resolve soon | [production] | 
            
  | 12:01 | <moritzm> | installing ldap-corp1001 T231015 | [production] | 
            
  | 11:32 | <Urbanecm> | Dry run for all wikis (T231137) | [production] | 
            
  | 11:26 | <moritzm> | installing ldap-corp2001 T231015 | [production] | 
            
  | 10:39 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:535145| Bumping portals to master (T128546)]] (duration: 00m 53s) | [production] | 
            
  | 10:38 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:535145| Bumping portals to master (T128546)]] (duration: 00m 54s) | [production] | 
            
  | 10:22 | <effie> | jiji@deploy1001:~$ scap sync-file wmf-config/CommonSettings.php "Push PHP7 traffic to 33.3% - T219150" | [production] | 
            
  | 09:48 | <moritzm> | updated stretch netinst image to 9.11 T232308 | [production] | 
            
  | 09:42 | <eileen> | civicrm revision changed from d1d65f37ea to 516eeb54b5, config revision is 5a6a9c6c03 | [production] | 
            
  | 09:40 | <moritzm> | updated buster netinst image to 10.1 T232310 | [production] | 
            
  | 09:28 | <ema> | lvs1016, lvs2006 (secondaries): restart pybal to add service restbase-ssl T210411 | [production] | 
            
  | 09:02 | <elukey> | restart archiva on archiva1001 - stuck and not serving requests (no trace about why in the logs) | [production] | 
            
  | 08:55 | <eileen> | civicrm revision is d1d65f37ea, config revision is 5a6a9c6c03 | [production] | 
            
  | 08:38 | <vgutierrez> | disabling systemd hardening for ats-tls on cp5001 - T232298 | [production] | 
            
  | 07:33 | <moritzm> | installing ghostscript security updates | [production] | 
            
  | 03:53 | <vgutierrez> | reboot analytics-tool1001 | [production] | 
            
  | 02:59 | <bd808> | Testing twitter integration after software update for Stashbot. In theory messages up to 280 characters in length will now be passed through to the @wikimediatech Twitter feed without being truncated. This message should end with a unicorn face if that is correct. 🦄 | [production] |