| 2019-12-18
      
      § | 
    
  | 07:58 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9928 and previous config saved to /var/cache/conftool/dbconfig/20191218-075828-marostegui.json | [production] | 
            
  | 07:58 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'sessionstore' for release 'staging' . | [production] | 
            
  | 07:57 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 07:57 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'mathoid' for release 'staging' . | [production] | 
            
  | 07:56 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . | [production] | 
            
  | 07:56 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'main' . | [production] | 
            
  | 07:55 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'logging-external' . | [production] | 
            
  | 07:54 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics' for release 'analytics' . | [production] | 
            
  | 07:54 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'echostore' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris> | run helmfile sync for all staging deployments T239835 | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'citoid' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . | [production] | 
            
  | 07:46 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9927 and previous config saved to /var/cache/conftool/dbconfig/20191218-074642-marostegui.json | [production] | 
            
  | 07:40 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1016', diff saved to https://phabricator.wikimedia.org/P9926 and previous config saved to /var/cache/conftool/dbconfig/20191218-074032-marostegui.json | [production] | 
            
  | 07:30 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool es1016 for upgrade', diff saved to https://phabricator.wikimedia.org/P9925 and previous config saved to /var/cache/conftool/dbconfig/20191218-073002-marostegui.json | [production] | 
            
  | 07:18 | <andrew@deploy1001> | Finished deploy [horizon/deploy@f77e91b]: Fix for T240979 (duration: 03m 24s) | [production] | 
            
  | 07:14 | <andrew@deploy1001> | Started deploy [horizon/deploy@f77e91b]: Fix for T240979 | [production] | 
            
  | 06:53 | <marostegui> | Upgrade db2132, db2133, db2134 | [production] | 
            
  | 06:51 | <marostegui> | Upgrade db2135 | [production] | 
            
  | 06:48 | <volker-e@deploy1001> | Finished deploy [design/style-guide@d13b55d]: Deploy design/style-guide:  (duration: 00m 07s) | [production] | 
            
  | 06:48 | <volker-e@deploy1001> | Started deploy [design/style-guide@d13b55d]: Deploy design/style-guide: | [production] | 
            
  | 06:45 | <onimisionipe> | running replicate-osm on maps1004 after failed osm sync - T239728 | [production] | 
            
  | 06:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9924 and previous config saved to /var/cache/conftool/dbconfig/20191218-064510-marostegui.json | [production] | 
            
  | 06:38 | <moritzm> | upgrading debmonitor-client to 0.2.0 fleet-wide | [production] | 
            
  | 06:37 | <moritzm> | upgrading debdeploy-client to 0.2.0 fleet-wide | [production] | 
            
  | 06:36 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9923 and previous config saved to /var/cache/conftool/dbconfig/20191218-063652-marostegui.json | [production] | 
            
  | 06:30 | <marostegui> | Upgrade db1105 | [production] | 
            
  | 06:28 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9922 and previous config saved to /var/cache/conftool/dbconfig/20191218-062759-marostegui.json | [production] | 
            
  | 06:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool pc1007 after upgrade (duration: 01m 00s) | [production] | 
            
  | 06:17 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool pc1007 for upgrade (duration: 01m 11s) | [production] | 
            
  | 06:03 | <marostegui> | Upgrade db2112 db2116 db2130 | [production] | 
            
  | 05:59 | <marostegui> | Upgrade db2088, db2092 | [production] | 
            
  | 05:55 | <marostegui> | Upgrade db2071 and db2072 | [production] | 
            
  | 05:31 | <marostegui> | Deploy schema change on commonswiki.image on s4 primary master (db1138) - T233135 | [production] | 
            
  | 04:59 | <XioNoX> | advertise 185.15.57.0/24 from [co|eq]dfw - T239347 | [production] | 
            
  | 04:54 | <XioNoX> | add static routes for cloud's 185.15.57.0/29 on cr1/2-codfw - T239347 | [production] | 
            
  | 02:14 | <eileen> | civicrm revision changed from b2d0b5d66d to 93037d6e35, config revision is 2e9bf6308b | [production] | 
            
  | 00:22 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Glent M0 for dewiki, enwiki and frwiki - T237365 (duration: 01m 02s) | [production] | 
            
  | 00:15 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Disable Glent M0 A/B test - T237363 (duration: 01m 02s) | [production] | 
            
  | 00:09 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable  on test wikis - T240736 (duration: 01m 02s) | [production] | 
            
  
    | 2019-12-17
      
      § | 
    
  | 22:55 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@0dd9f6b]: Ship kerberos configuration for oozie jobs (duration: 15m 50s) | [production] | 
            
  | 22:39 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@0dd9f6b]: Ship kerberos configuration for oozie jobs | [production] | 
            
  | 22:19 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . | [production] | 
            
  | 22:18 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 22:10 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@100bf96]: Ship kerberos configuration for oozie jobs (duration: 00m 34s) | [production] | 
            
  | 22:09 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@100bf96]: Ship kerberos configuration for oozie jobs | [production] | 
            
  | 21:52 | <cdanis> | ✔️ cdanis@cp3050.esams.wmnet ~ 🕔🍵 sudo depool | [production] | 
            
  | 21:04 | <mholloway-shell@deploy1001> | Synchronized php-1.35.0-wmf.10/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message, take 2 (duration: 01m 04s) | [production] | 
            
  | 21:02 | <mholloway-shell@deploy1001> | Synchronized php-1.35.0-wmf.11/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message, take 2 (duration: 01m 04s) | [production] |