| 
      
        2019-02-06
      
      §
     | 
  
    
  | 02:40 | 
  <twentyafterfour@deploy1001> | 
  Finished scap: sync and update localization for 1.33.0-wmf.16 (duration: 15m 50s) | 
  [production] | 
            
  | 02:32 | 
  <XioNoX> | 
  push firewall rule to pfw3-eqiad - T215364 | 
  [production] | 
            
  | 02:27 | 
  <mutante> | 
  actinium - apt-get clean for 8% more disk space after icinga alert | 
  [production] | 
            
  | 02:25 | 
  <twentyafterfour@deploy1001> | 
  Started scap: sync and update localization for 1.33.0-wmf.16 | 
  [production] | 
            
  | 02:16 | 
  <twentyafterfour@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.14  refs T206670 | 
  [production] | 
            
  | 02:12 | 
  <eileen> | 
  civicrm revision changed from 6042acb363 to 613b388916, config revision is 306b4de48f | 
  [production] | 
            
  | 02:02 | 
  <twentyafterfour@deploy1001> | 
  scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) | 
  [production] | 
            
  | 01:22 | 
  <XioNoX> | 
  remove peering4/6 prefix-list from routers | 
  [production] | 
            
  | 01:07 | 
  <XioNoX> | 
  add maintenance and rollback to junos operations class | 
  [production] | 
            
  | 00:47 | 
  <twentyafterfour@deploy1001> | 
  Started scap: testwikis wikis to 1.33.0-wmf.16  refs T206670 | 
  [production] | 
            
  | 00:33 | 
  <niharika29@deploy1001> | 
  Synchronized php-1.33.0-wmf.14/extensions/MobileFrontend/: EditorOverlay: captcha/abusefilter weren't being shown correctly T215101, T202374 (duration: 00m 50s) | 
  [production] | 
            
  | 00:24 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Demystify  Logstash debug level behavior (duration: 00m 51s) | 
  [production] | 
            
  | 00:23 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/logging.php: Demystify  Logstash debug level behavior (duration: 00m 46s) | 
  [production] | 
            
  | 00:18 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/logging.php: Add PHP version to MW logs T215350 (duration: 00m 46s) | 
  [production] | 
            
  | 00:16 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: Preserve Composer's include paths - T215126, T215224 (duration: 01m 40s) | 
  [production] | 
            
  
    | 
      
        2019-02-05
      
      §
     | 
  
    
  | 18:56 | 
  <arlolra@deploy1001> | 
  Finished deploy [parsoid/deploy@a4acfa6]: (no justification provided) (duration: 02m 06s) | 
  [production] | 
            
  | 18:53 | 
  <arlolra@deploy1001> | 
  Started deploy [parsoid/deploy@a4acfa6]: (no justification provided) | 
  [production] | 
            
  | 18:39 | 
  <arlolra@deploy1001> | 
  Finished deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 (duration: 09m 54s) | 
  [production] | 
            
  | 18:29 | 
  <arlolra@deploy1001> | 
  Started deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 | 
  [production] | 
            
  | 18:26 | 
  <bsitzmann@deploy1001> | 
  Finished deploy [mobileapps/deploy@2959e12]: Update mobileapps to 107c1b1 (T214714) (duration: 04m 43s) | 
  [production] | 
            
  | 18:21 | 
  <bsitzmann@deploy1001> | 
  Started deploy [mobileapps/deploy@2959e12]: Update mobileapps to 107c1b1 (T214714) | 
  [production] | 
            
  | 18:17 | 
  <mutante> | 
  contint1001/contint2001 -manually deleting crontab lines unpuppetized in gerrit:488019 (T209361) | 
  [production] | 
            
  | 18:13 | 
  <Jeff_Green> | 
  authdns-update to deploy 7fee817fd3 | 
  [production] | 
            
  | 17:22 | 
  <mutante> | 
  scandium - restart parsoid-vd service | 
  [production] | 
            
  | 17:21 | 
  <mutante> | 
  scandium -- copy /srv/visualdiff/testrecude/testrun.ids from ruthenium to the same locatio | 
  [production] | 
            
  | 15:15 | 
  <godog> | 
  force curator action 'replicas' to set older logstash indices to 1 replica - T213078 | 
  [production] | 
            
  | 14:30 | 
  <marostegui> | 
  Deploy schema change on s4 codfw master with replication, lag will be generated on s4 codfw - T210713 | 
  [production] | 
            
  | 14:26 | 
  <Jeff_Green> | 
  authdns-update for payments dev/testing hostname | 
  [production] | 
            
  | 14:12 | 
  <marostegui> | 
  Deploy schema change on db1066 (s2 master) - T210713 | 
  [production] | 
            
  | 14:05 | 
  <marostegui> | 
  Delete non used grants from dbstore1002: log, warehouse,project_illustration, cognate\_wiktionary, datasets - T212487 T210478 | 
  [production] | 
            
  | 13:55 | 
  <godog> | 
  swift codfw-prod: add ms-be2047 - T209395 T209921 | 
  [production] | 
            
  | 12:18 | 
  <addshore> | 
  swat done | 
  [production] | 
            
  | 12:18 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Disable confirmation prompt on rollback by default T215019 (duration: 00m 47s) | 
  [production] | 
            
  | 11:35 | 
  <moritzm> | 
  added firmware-enriched buster netboot image (T213546) | 
  [production] | 
            
  | 11:04 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1074 (duration: 00m 46s) | 
  [production] | 
            
  | 10:43 | 
  <marostegui> | 
  Deploy schema change on db1074 with replication, lag will be generated on s2 - T210713 | 
  [production] | 
            
  | 10:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1074 (duration: 00m 47s) | 
  [production] | 
            
  | 10:12 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 (duration: 00m 46s) | 
  [production] | 
            
  | 09:42 | 
  <hashar> | 
  contint1001: docker image prune -f | 
  [production] | 
            
  | 09:34 | 
  <marostegui> | 
  Deploy schema change on db1090:3312 - T210713 | 
  [production] | 
            
  | 09:34 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 45s) | 
  [production] | 
            
  | 09:26 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1076 (duration: 00m 46s) | 
  [production] | 
            
  | 09:11 | 
  <marostegui> | 
  Start all slaves on dbstore1002 - T213670 | 
  [production] | 
            
  | 08:56 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 (duration: 00m 45s) | 
  [production] | 
            
  | 08:33 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase traffic for db1076 (duration: 00m 46s) | 
  [production] | 
            
  | 08:16 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 (duration: 00m 45s) | 
  [production] | 
            
  | 07:56 | 
  <marostegui> | 
  Upgrade MySQL and kernel on db1076 | 
  [production] | 
            
  | 07:44 | 
  <marostegui> | 
  Deploy schema change on db1076 - T210713 | 
  [production] | 
            
  | 07:44 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1076 T210713 (duration: 00m 47s) | 
  [production] | 
            
  | 07:13 | 
  <marostegui> | 
  Taking mysqldump from dbstore1002.staging - T210478 | 
  [production] |