| 2018-03-07
      
      § | 
    
  | 08:37 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1079 after alter table (duration: 01m 16s) | [production] | 
            
  | 07:45 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2089,db2079 and db2065 after mariadb and kernel upgrade (duration: 01m 16s) | [production] | 
            
  | 07:30 | <marostegui> | Stop mariadb on db2089,db2079 and db2065 for kernel upgrade | [production] | 
            
  | 07:28 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db2089,db2079 and db2065 (duration: 01m 15s) | [production] | 
            
  | 06:49 | <marostegui> | Deploy schema change on db1079 with replication enabled (this will generate lag on labs) - T187089 T185128 T153182 | [production] | 
            
  | 06:40 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1079 for alter table (duration: 01m 16s) | [production] | 
            
  | 02:27 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.23) (duration: 06m 03s) | [production] | 
            
  | 00:57 | <Amir1> | Evening SWAT is done | [production] | 
            
  | 00:32 | <ladsgroup@tin> | Synchronized wmf-config/InitialiseSettings.php: Re-enable Wikidata descriptions (T188182) (duration: 01m 16s) | [production] | 
            
  
    | 2018-03-06
      
      § | 
    
  | 23:10 | <MaxSem> | cancelled | [production] | 
            
  | 23:05 | <MaxSem> | refreshing spoofuser | [production] | 
            
  | 23:00 | <MaxSem> | dumping centralauth.spoofuser from db1094 | [production] | 
            
  | 21:22 | <mutante> | restbase-dev1006 powercycled via console (T185494) | [production] | 
            
  | 20:49 | <thcipriani@tin> | rebuilt and synchronized wikiversions files: Group0 to 1.31.0-wmf.24 | [production] | 
            
  | 20:44 | <ottomata> | reverted change to point mediawiki monolog kafka producers at kafka jumbo-eqiad until deployment train is done T188136 | [production] | 
            
  | 20:36 | <mutante> | phab1001 (phabricator) - rebooting for maintenance | [production] | 
            
  | 20:35 | <ottomata> | pointing mediawiki monolog kafka producers at kafka jumbo-eqiad cluster: T188136 | [production] | 
            
  | 20:08 | <thcipriani@tin> | Finished scap: testwiki to php-1.31.0-wmf.24 and rebuild l10n cache (duration: 29m 13s) | [production] | 
            
  | 19:39 | <thcipriani@tin> | Started scap: testwiki to php-1.31.0-wmf.24 and rebuild l10n cache | [production] | 
            
  | 18:38 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@5986ab7]: Update mobileapps to afbe9af (duration: 05m 28s) | [production] | 
            
  | 18:32 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@5986ab7]: Update mobileapps to afbe9af | [production] | 
            
  | 18:22 | <godog> | puppet-merge Revert: Use hiera3 role/nuyaml backends on >= stretch | [production] | 
            
  | 17:58 | <marostegui> | Reload haproxy on dbproxy1004 and dbproxy1009 | [production] | 
            
  | 17:53 | <thcipriani> | starting branch cut for 1.31.0-wmf.24 | [production] | 
            
  | 17:53 | <andrewbogott> | disabling puppet and apache on labpuppetmatser1001 and 1002 | [production] | 
            
  | 17:47 | <moritzm> | rebooting dbmonitor1001 for kernel security update | [production] | 
            
  | 17:42 | <moritzm> | rebooting dbmonitor2001 for kernel security update | [production] | 
            
  | 17:38 | <moritzm> | rebooting hassaleh for kernel security update | [production] | 
            
  | 17:34 | <vgutierrez> | update pybal to 1.15.1 on lvs5003 | [production] | 
            
  | 17:32 | <vgutierrez> | update pybal to 1.15.1 on lvs1010 | [production] | 
            
  | 17:28 | <vgutierrez> | uploaded pybal_1.15.1_all.deb to apt.wikimedia.org jessie-wikimedia | [production] | 
            
  | 17:17 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1069 after alter table (duration: 00m 58s) | [production] | 
            
  | 16:58 | <cmjohnson1> | powering off rhenium to reset the idrac | [production] | 
            
  | 16:44 | <sbisson@tin> | Finished deploy [kartotherian/deploy@255401a]: Testing update-deps2 branch (duration: 05m 47s) | [production] | 
            
  | 16:38 | <sbisson@tin> | Started deploy [kartotherian/deploy@255401a]: Testing update-deps2 branch | [production] | 
            
  | 16:11 | <oblivian@tin> | Synchronized wmf-config: Fetch data from etcd on all appservers (duration: 01m 01s) | [production] | 
            
  | 16:01 | <marostegui> | Deploy schema change on db1069 - T187089 T185128 T153182 | [production] | 
            
  | 16:01 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1069 for alter table (duration: 00m 57s) | [production] | 
            
  | 15:54 | <jynus> | deploying new query killer logic to all wikidata (s8) db replicas T188505 | [production] | 
            
  | 15:54 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1094 after alter table (duration: 00m 57s) | [production] | 
            
  | 15:51 | <moritzm> | installing libvpx security updates | [production] | 
            
  | 15:50 | <oblivian@tin> | Synchronized wmf-config: Expose etcd last modified index (duration: 01m 00s) | [production] | 
            
  | 15:45 | <moritzm> | rebooting ununpentium for kernel security update | [production] | 
            
  | 15:39 | <oblivian@tin> | Finished scap: Deploying Expose the latest modified index seen by EtcdConfig (duration: 09m 49s) | [production] | 
            
  | 15:29 | <oblivian@tin> | Started scap: Deploying Expose the latest modified index seen by EtcdConfig | [production] | 
            
  | 15:28 | <moritzm> | rebooting bromine for kernel security update | [production] | 
            
  | 15:19 | <mobrovac@tin> | Synchronized php-1.31.0-wmf.23/includes/jobqueue/JobQueueSecondTestQueue.php: [JobQueueSecondTestQueue] Support read-only mode - T185052 (duration: 00m 58s) | [production] | 
            
  | 15:09 | <vgutierrez> | update to pybal 1.15.0 on lvs5003 | [production] | 
            
  | 15:02 | <hashar@tin> | Synchronized wmf-config/InitialiseSettings.php: Article counts: Change 'comma' method to 'any' - T188472 (duration: 01m 00s) | [production] | 
            
  | 14:50 | <vgutierrez> | update pybal to 1.15.0 on lvs1010 | [production] |