| 2019-07-12
      
      § | 
    
  | 12:18 | <fsero@> | helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 12:18 | <fsero@> | helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 12:15 | <fsero@> | helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . | [production] | 
            
  | 12:11 | <fsero> | recreating sessionstore,cxserver and mathoid staging namespaces T227775 | [production] | 
            
  | 12:10 | <fsero@> | helmfile [STAGING] Ran 'apply' command on namespace 'citoid' for release 'staging' . | [production] | 
            
  | 12:06 | <fsero> | recreating citoid staging namespace T227775 | [production] | 
            
  | 12:05 | <fsero@> | helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'staging' . | [production] | 
            
  | 12:01 | <fsero> | recreating termbox staging namespace T227775 | [production] | 
            
  | 11:09 | <jynus@deploy1001> | Synchronized wmf-config/db-codfw.php: Switchover db2045 x1 codfw master to db2069 (duration: 00m 51s) | [production] | 
            
  | 10:24 | <jynus> | switchover x1 codfw master from db2045 to db2069 T227862 | [production] | 
            
  | 10:23 | <jynus> | switchover x1 codfw master from db2045 to db2069 | [production] | 
            
  | 09:43 | <moritzm> | shut down ldap-codfw-replica01/ldap-codfw-replica02 (pending reimage) | [production] | 
            
  | 08:18 | <jijiki> | enable puppet on mw1222 | [production] | 
            
  | 06:35 | <vgutierrez> | upgrading acme-chief to version 0.19 in acme-chief test instances - T225945 | [production] | 
            
  | 06:28 | <vgutierrez> | uploaded acme-chief 0.19 to apt.wikimedia.org (buster) - T225945 | [production] | 
            
  | 05:45 | <elukey> | sudo -i /usr/local/sbin/restart-php7.2-fpm on mwdebug* to clear opcache | [production] | 
            
  | 01:01 | <Krinkle> | mw1342 generated some ~ 11,500 additional PHP errors over a 4 hour period (18:00-22:30 UTC), ref T224491 | [production] | 
            
  | 00:59 | <Krinkle> | mw1342 is generating strange PHP erros (php7 only), ref T224491 | [production] | 
            
  | 00:58 | <urandom> | bootstrapping restbase1017-a -- T222960 | [production] | 
            
  | 00:50 | <mutante> | restbase1018 - restart ferm service | [production] | 
            
  | 00:15 | <krinkle@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: e4bd91f71b (duration: 00m 50s) | [production] | 
            
  | 00:13 | <krinkle@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: f309856f0912 (duration: 00m 50s) | [production] | 
            
  | 00:03 | <eevans@deploy1001> | Finished deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) (duration: 00m 03s) | [production] | 
            
  | 00:03 | <eevans@deploy1001> | Started deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) | [production] | 
            
  | 00:01 | <eevans@deploy1001> | Finished deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) (duration: 00m 25s) | [production] | 
            
  | 00:01 | <eevans@deploy1001> | Started deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) | [production] | 
            
  
    | 2019-07-11
      
      § | 
    
  | 23:58 | <thcipriani@deploy1001> | Synchronized php-1.34.0-wmf.13/includes/watcheditem/WatchedItemStore.php: SWAT: [[gerrit:522155|WatchedItemStore: Fix fatal when revision is deleted]] T226741 (duration: 00m 51s) | [production] | 
            
  | 23:49 | <eevans@deploy1001> | Finished deploy [cassandra/logstash-logback-encoder@d085ffa]: deploy logback to restbase1017 (T222960) (duration: 00m 47s) | [production] | 
            
  | 23:48 | <eevans@deploy1001> | Started deploy [cassandra/logstash-logback-encoder@d085ffa]: deploy logback to restbase1017 (T222960) | [production] | 
            
  | 23:47 | <eevans@deploy1001> | Finished deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) (duration: 01m 56s) | [production] | 
            
  | 23:45 | <eevans@deploy1001> | Started deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) | [production] | 
            
  | 23:38 | <eevans@deploy1001> | deploy aborted: (no justification provided) (duration: 02m 00s) | [production] | 
            
  | 23:36 | <eevans@deploy1001> | Started deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) | [production] | 
            
  | 23:15 | <thcipriani@deploy1001> | Synchronized wmf-config: SWAT: [[gerrit:521338|Oversample all EditAttemptStep events on VE-as-mobile-default wikis]] T227317 (duration: 00m 50s) | [production] | 
            
  | 22:59 | <mutante> | netmon1003 - removing servermon - servermon.wikimedia.org is being decom'ed  (T198939) | [production] | 
            
  | 22:37 | <RoanKattouw> | Deployed fix for T224240, accidentally rode along with Tyler's no-op scap | [production] | 
            
  | 22:34 | <thcipriani@deploy1001> | rebuilt and synchronized wikiversions files: wikidatawiki back to 1.34.0-wmf.13 | [production] | 
            
  | 22:26 | <thcipriani@deploy1001> | Finished scap: no op scap sync to rebuild l10n-cache (T227814) (duration: 19m 34s) | [production] | 
            
  | 22:07 | <thcipriani@deploy1001> | Started scap: no op scap sync to rebuild l10n-cache (T227814) | [production] | 
            
  | 21:23 | <otto@deploy1001> | Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 02m 02s) | [production] | 
            
  | 21:21 | <otto@deploy1001> | Started deploy [analytics/refinery@3296aab]: (no justification provided) | [production] | 
            
  | 20:22 | <otto@deploy1001> | Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 20:22 | <otto@deploy1001> | Started deploy [analytics/refinery@3296aab]: (no justification provided) | [production] | 
            
  | 20:20 | <otto@deploy1001> | Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 00m 03s) | [production] | 
            
  | 20:20 | <otto@deploy1001> | Started deploy [analytics/refinery@3296aab]: (no justification provided) | [production] | 
            
  | 20:19 | <otto@deploy1001> | Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 20:19 | <otto@deploy1001> | Started deploy [analytics/refinery@3296aab]: (no justification provided) | [production] | 
            
  | 20:18 | <otto@deploy1001> | Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 20:18 | <otto@deploy1001> | Started deploy [analytics/refinery@3296aab]: (no justification provided) | [production] | 
            
  | 20:11 | <milimetric@deploy1001> | deploy aborted: Fix to reimport cu_changes (duration: 27m 34s) | [production] |