| 2018-07-19
      
      ยง | 
    
  | 15:11 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 after alter table (duration: 00m 54s) | [production] | 
            
  | 15:00 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1099 (duration: 00m 54s) | [production] | 
            
  | 14:59 | <moritzm> | rebooting multatuli for kernel test | [production] | 
            
  | 14:30 | <marostegui> | Deploy schema change on db1105:3312 T144010 T51190 T199368 | [production] | 
            
  | 14:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 for alter table (duration: 00m 54s) | [production] | 
            
  | 14:22 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 after alter table (duration: 00m 54s) | [production] | 
            
  | 14:17 | <elukey> | roll restart kafka on kafka-jumbo* and kafka main-codfw (kafka2*) to pick up new Xmx/Xms settings (1g -> 2g) | [production] | 
            
  | 14:15 | <volans> | upgrading cumin/debdeploy/reimage and other tools on neodymium - T187773 | [production] | 
            
  | 13:57 | <elukey> | restart kafka on kafka-jumbo1001 to raise Xmx/Xms jvm settings (1g -> 2g) | [production] | 
            
  | 13:43 | <marostegui> | Deploy schema change on db1103:3312 T144010 T51190 T199368 | [production] | 
            
  | 13:43 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for alter table (duration: 00m 54s) | [production] | 
            
  | 13:38 | <volans> | reimaging mw2225 to test py3 reimage with new cumin, conftool and apache test - T187773 | [production] | 
            
  | 13:34 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3314 (duration: 00m 53s) | [production] | 
            
  | 13:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 13:22 | <moritzm> | installing python-pysaml2 security updates | [production] | 
            
  | 13:05 | <moritzm> | installing ffmpeg security updates | [production] | 
            
  | 12:48 | <moritzm> | installing xerces-c security updates | [production] | 
            
  | 12:38 | <moritzm> | uploaded debdeploy 0.0.99.5 to apt.wikimedia.org | [production] | 
            
  | 11:49 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 11:46 | <zfilipin@deploy1001> | Synchronized dblists/categories-rdf.dblist: SWAT: [[gerrit:445720|Remove labs wikis from the categories-rdf list, dont need them (T198356)]] (duration: 00m 55s) | [production] | 
            
  | 11:44 | <moritzm> | installing reportbug update from stretch point release to test py3-based debdeploy | [production] | 
            
  | 11:40 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:446613|Enable Special:Block Feedback Request (T199919)]] (duration: 00m 55s) | [production] | 
            
  | 11:33 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Structured Discussions beta feature on orwiki (T199971) (duration: 00m 55s) | [production] | 
            
  | 11:22 | <volans> | testing reimage of californium (spare host) with the upgraded cumin | [production] | 
            
  | 11:20 | <chasemp> | maintain-views --all-databases --replace-all --table ores_classification --debug (labsdb) | [production] | 
            
  | 11:19 | <chasemp> | maintain-views --all-databases --replace-all --table ores_model --debug (labsdb) | [production] | 
            
  | 11:18 | <tgr@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: enable TemplateStyles on enwiki, frwiki, zhwiki T197603 T191452 T189022 (duration: 00m 55s) | [production] | 
            
  | 10:59 | <volans> | upgrading cumin on sarin - T187773 | [production] | 
            
  | 10:52 | <legoktm> | made myself a crat on test2wiki | [production] | 
            
  | 10:06 | <moritzm> | installing file/libmagic security updates | [production] | 
            
  | 09:55 | <moritzm> | installing check-postgres update from stretch 9.5 point release | [production] | 
            
  | 09:49 | <aaron@deploy1001> | Synchronized php-1.32.0-wmf.13/includes/libs/objectcache/MultiWriteBagOStuff.php: 2cee0ab7085a74d35bc192ec8bc9cf461b286695 (duration: 00m 55s) | [production] | 
            
  | 09:35 | <volans> | cumin upgrade on labpuppetmaster* hosts completed - T187773 | [production] | 
            
  | 09:33 | <moritzm> | installing openssl security updates | [production] | 
            
  | 09:33 | <volans> | removed leftover cumin installation from labtestpuppetmaster2001 - T187773 | [production] | 
            
  | 09:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 09:27 | <godog> | run xfs_repair on filesystems reporting negative space available on ms-be1040 - T199198 | [production] | 
            
  | 09:24 | <moritzm> | installing tomcat7 security updates | [production] | 
            
  | 09:23 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool es1019 with low load (duration: 00m 54s) | [production] | 
            
  | 09:21 | <moritzm> | installing ant security updates | [production] | 
            
  | 09:14 | <moritzm> | uploaded jenkins 2.121.2 to apt.wikimedia.org (T199448) | [production] | 
            
  | 08:46 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 08:39 | <volans> | start upgrade of cumin to 3.0.1-1 on labpuppetmaster* - T187773 | [production] | 
            
  | 08:32 | <marostegui> | Deploy schema change on dbstore1002:s2 T144010 T51190 T199368 | [production] | 
            
  | 08:31 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 08:08 | <elukey> | restart eventstreams on scb2* hosts to pick up new Kafka settings (pointing it to main-codfw) - T199813 | [production] | 
            
  | 08:04 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) (duration: 03m 58s) | [production] | 
            
  | 08:00 | <kartik@deploy1001> | Started deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) | [production] | 
            
  | 07:58 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 07:54 | <marostegui> | Deploy schema change on s2 codfw masters (db2035) this will generate lag on s2 codfw T144010 T51190 T199368 | [production] |