| 2018-11-23
      
      § | 
    
  | 21:15 | <bawolff> | deploy patch for T210192 | [production] | 
            
  | 16:53 | <bblack> | cleaned up remnants of globalsign-2017 unified cert (OCSP cache/config, unmanaged cert files, etc) on all cpNNNN - T206804 | [production] | 
            
  | 14:02 | <gehel> | restor wdqs-updater heap to 2G - T210235 | [production] | 
            
  | 13:32 | <moritzm> | installing confuse security updates | [production] | 
            
  | 12:04 | <gehel> | manually increasing wdqs-updater heap to 4G - T210235 | [production] | 
            
  | 11:37 | <gehel> | restarting updater on all wdqs ndoes | [production] | 
            
  | 08:41 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=.*,service=zotero,cluster=kubernetes,name=.* | [production] | 
            
  | 08:10 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1078 - T86339 (duration: 00m 46s) | [production] | 
            
  | 07:48 | <moritzm> | installing libtirpc security updates | [production] | 
            
  | 07:14 | <marostegui> | Deploy schema change db1078 - T86339 | [production] | 
            
  | 07:14 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1078 - T86339 (duration: 00m 45s) | [production] | 
            
  | 07:00 | <marostegui> | Deploy schema change db1095 - T86339 | [production] | 
            
  | 06:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1123 - T86339 (duration: 00m 49s) | [production] | 
            
  | 06:32 | <marostegui> | Deploy schema change db1123 - T86339 | [production] | 
            
  | 06:31 | <marostegui> | Deploy schema change dbstore1002:s3 - T86339 | [production] | 
            
  | 06:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1123 - T86339 (duration: 00m 48s) | [production] | 
            
  | 06:15 | <marostegui> | Deploy schema change on s3 codfw master (db2043) with replication - T86339 | [production] | 
            
  | 06:13 | <marostegui> | Deploy schema change on db1067 (s1) master - T86339 | [production] | 
            
  
    | 2018-11-22
      
      § | 
    
  | 21:08 | <godog> | disable raid handler for ms-be2021 - T208096 | [production] | 
            
  | 19:01 | <moritzm> | installing uriparser security updates | [production] | 
            
  | 18:46 | <moritzm> | installing openjpeg2 security updates | [production] | 
            
  | 18:45 | <arturo> | enable puppet in all CloudVPS HW servers | [production] | 
            
  | 18:37 | <arturo> | disable puppet in all CloudVPS HW servers to test a patch (T209948) | [production] | 
            
  | 17:46 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool es1016 (duration: 00m 46s) | [production] | 
            
  | 16:49 | <jynus> | upgrading, and restarting es1016 (but not deleting, that was a mistake) | [production] | 
            
  | 16:49 | <jynus> | upgrading, deleting at and restarting es1016 | [production] | 
            
  | 16:35 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool es1016 (duration: 00m 47s) | [production] | 
            
  | 16:06 | <ema> | trafficserver_8.0.0-1wm3 uploaded to stretch-wikimedia | [production] | 
            
  | 15:23 | <akosiaris@deploy1001> | scap-helm zotero finished | [production] | 
            
  | 15:23 | <akosiaris@deploy1001> | scap-helm zotero cluster codfw completed | [production] | 
            
  | 15:23 | <akosiaris@deploy1001> | scap-helm zotero install --name production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: codfw] | [production] | 
            
  | 15:22 | <akosiaris@deploy1001> | scap-helm zotero finished | [production] | 
            
  | 15:22 | <akosiaris@deploy1001> | scap-helm zotero cluster eqiad completed | [production] | 
            
  | 15:22 | <akosiaris@deploy1001> | scap-helm zotero install --name production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] | [production] | 
            
  | 14:50 | <akosiaris@deploy1001> | scap-helm zotero install --name production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] | [production] | 
            
  | 13:53 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1080 - T86339 (duration: 00m 45s) | [production] | 
            
  | 13:52 | <marostegui@deploy1001> | sync-file aborted: Depool db1080 - T86339 (duration: 00m 00s) | [production] | 
            
  | 13:50 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1080 - T86339 (duration: 00m 46s) | [production] | 
            
  | 13:46 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1083 - T86339 (duration: 00m 46s) | [production] | 
            
  | 13:45 | <marostegui> | Deploy schema change on s1 eqiad hosts T86339 | [production] | 
            
  | 13:43 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1083 - T86339 (duration: 00m 46s) | [production] | 
            
  | 13:38 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1089 - T86339 (duration: 00m 45s) | [production] | 
            
  | 13:36 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1089 - T86339 (duration: 00m 46s) | [production] | 
            
  | 13:30 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1114 - T86339 (duration: 00m 45s) | [production] | 
            
  | 13:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1114 - T86339 (duration: 00m 43s) | [production] | 
            
  | 13:21 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1119 - T86339 (duration: 00m 46s) | [production] | 
            
  | 13:17 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1119 - T86339 (duration: 00m 47s) | [production] | 
            
  | 12:19 | <jynus> | upgrading, deleting at and restarting dbstore2002 | [production] | 
            
  | 10:21 | <jynus> | upgrading and restarting dbstore1001 | [production] |