| 2018-12-11
      
      ยง | 
    
  | 22:50 | <chasemp> | ssh to tar archive data from logstash1006 /mnt (external) to labstore1007 | [production] | 
            
  | 22:06 | <XioNoX> | push loopback filter term return-tcp to all routers - T207962 | [production] | 
            
  | 22:04 | <urandom> | decommissioning cassandra-a, restbase2006 -- T210843 | [production] | 
            
  | 19:57 | <XioNoX> | apply BGP_IXP_RS_in and avoid HE to cr4-ulsfo - T211079 | [production] | 
            
  | 19:28 | <jforrester@deploy1001> | Synchronized php-1.33.0-wmf.8/extensions/Flow/modules/engine/misc/flow-handlebars.js: T211707 Hot-deploy fix for StructuredDiscussions pages (duration: 00m 52s) | [production] | 
            
  | 19:22 | <jforrester@deploy1001> | Synchronized php-1.33.0-wmf.6/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.Target.js: T209619: Hot-deploy Ibcf3c93e (duration: 00m 52s) | [production] | 
            
  | 18:59 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@ecd5fb6]: fix site CSS URL (duration: 03m 58s) | [production] | 
            
  | 18:55 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@ecd5fb6]: fix site CSS URL | [production] | 
            
  | 18:54 | <XioNoX> | push BGP_IXP_RS_in to all routers (but don't apply it to any peers, needs to be done manually) - T211079 | [production] | 
            
  | 18:33 | <cmjohnson1> | swapping disk slot 0 db1063 | [production] | 
            
  | 18:23 | <XioNoX> | push BGP_IXP_RS_in to cr2-eqord - T211079 | [production] | 
            
  | 18:06 | <anomie@deploy1001> | Synchronized php-1.33.0-wmf.6/includes/user/User.php: Backport fix for T210621, for real this time (duration: 00m 53s) | [production] | 
            
  | 18:00 | <jforrester@deploy1001> | Synchronized wmf-config/Wikibase.php: T211237 Hot-deploy disabling Wikibase federation, unused except in Beta Cluster (duration: 00m 52s) | [production] | 
            
  | 17:33 | <_joe_> | restarting pybal on lvs2003 | [production] | 
            
  | 17:23 | <XioNoX> | push changes tested on cr4-ulsfo to all routers - T211079 | [production] | 
            
  | 17:16 | <_joe_> | restarting pybal on lvs2006 | [production] | 
            
  | 17:15 | <oblivian@puppetmaster1001> | conftool action : set/weight=1; selector: service=search-omega-ssl | [production] | 
            
  | 17:15 | <oblivian@puppetmaster1001> | conftool action : set/weight=1; selector: service=search-psi-ssl | [production] | 
            
  | 17:15 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=search-psi-ssl | [production] | 
            
  | 17:14 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=search-omega-ssl | [production] | 
            
  | 17:05 | <XioNoX> | remove redundant term classification from BGP_transit_in on cr4-ulsfo - T211079 | [production] | 
            
  | 16:55 | <banyek> | executing schema change on dbstore1002 - T85757 | [production] | 
            
  | 16:50 | <XioNoX> | replace local-preference/default-action by next policy for BGP_IXP_in and BGP_Private_Peer_in on cr4-ulsfo - T211079 | [production] | 
            
  | 16:49 | <banyek> | executing schema change on db1102 - T85757 | [production] | 
            
  | 16:48 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: repool db1113:3315 (duration: 00m 51s) | [production] | 
            
  | 16:44 | <banyek> | repooling db1113:3315 after schema change - T85757 | [production] | 
            
  | 16:38 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: depool db1113:3315 (duration: 00m 51s) | [production] | 
            
  | 16:35 | <banyek> | depooling db1113:3315 for schema change - T85757 | [production] | 
            
  | 16:33 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: repool db1110 (duration: 00m 51s) | [production] | 
            
  | 16:32 | <banyek> | repooling db1110 after schema change - T85757 | [production] | 
            
  | 16:28 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: depool db1110 (duration: 00m 50s) | [production] | 
            
  | 16:25 | <banyek> | depooling db1110 for schema change - T85757 | [production] | 
            
  | 16:23 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: repool db1100 (duration: 00m 51s) | [production] | 
            
  | 16:22 | <XioNoX> | Remove static routes for NS v6 IPs - T211699 | [production] | 
            
  | 16:20 | <banyek> | repooling db1100 after schema change - T85757 | [production] | 
            
  | 16:15 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: depool db1100 (duration: 00m 52s) | [production] | 
            
  | 16:09 | <banyek> | depooling db1100 for schema change - T85757 | [production] | 
            
  | 15:49 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.8 | [production] | 
            
  | 15:45 | <papaul> | re-installing OS on ms-be2047.codfw.wmnet | [production] | 
            
  | 15:31 | <zfilipin@deploy1001> | Finished scap: testwiki to php-1.33.0-wmf.8 and rebuild l10n cache (duration: 36m 08s) | [production] | 
            
  | 15:06 | <vgutierrez> | Use certcentral managed TLS certificate in mirrors.wikimedia.org - T207050 | [production] | 
            
  | 14:55 | <zfilipin@deploy1001> | Started scap: testwiki to php-1.33.0-wmf.8 and rebuild l10n cache | [production] | 
            
  | 14:50 | <zfilipin@deploy1001> | Pruned MediaWiki: 1.33.0-wmf.3 (duration: 02m 51s) | [production] | 
            
  | 14:49 | <banyek> | depooling labsdb1010 - T210693 | [production] | 
            
  | 14:46 | <zfilipin@deploy1001> | Pruned MediaWiki: 1.33.0-wmf.2 (duration: 03m 12s) | [production] | 
            
  | 14:43 | <zfilipin@deploy1001> | Pruned MediaWiki: 1.33.0-wmf.1 (duration: 11m 40s) | [production] | 
            
  | 14:42 | <volans> | 'sudo systemctl reload icinga' on icinga1001 | [production] | 
            
  | 14:32 | <godog> | decommissioning cassandra-c, restbase2005 -- T210843 | [production] | 
            
  | 14:31 | <bblack> | removed unused public IPv6 IPs from authdnses manually with "ip -6 addr del ..." - https://gerrit.wikimedia.org/r/c/operations/puppet/+/478939 | [production] | 
            
  | 14:23 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=restbase2013.codfw.wmnet | [production] |