| 
      
        2018-07-19
      
      ยง
     | 
  
    
  | 16:28 | 
  <jynus> | 
  stop, clone away and upgrade db1099 two mysql instances | 
  [production] | 
            
  | 16:16 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully depool db1099, including from s8 (duration: 00m 55s) | 
  [production] | 
            
  | 15:59 | 
  <hoo> | 
  Updated the Wikidata property suggester with data from Monday's JSON dump and applied the T132839 workarounds | 
  [production] | 
            
  | 15:53 | 
  <hashar> | 
  CI: npmjs is slow. Bumping Quibble jobs timeout from 30 to 45 minutes | https://gerrit.wikimedia.org/r/#/c/446863 | T198348 | 
  [production] | 
            
  | 15:50 | 
  <jynus> | 
  droping undocumented grants on labsdb1005 using replication T199186 | 
  [production] | 
            
  | 15:21 | 
  <volans> | 
  reimaging mw2226 to test py3 reimage with new cumin, conftool and apache test from neodymium - T187773 | 
  [production] | 
            
  | 15:12 | 
  <volans@sarin> | 
  conftool action : set/pooled=yes; selector: name=mw2225.codfw.wmnet | 
  [production] | 
            
  | 15:11 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 after alter table (duration: 00m 54s) | 
  [production] | 
            
  | 15:00 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1099 (duration: 00m 54s) | 
  [production] | 
            
  | 14:59 | 
  <moritzm> | 
  rebooting multatuli for kernel test | 
  [production] | 
            
  | 14:30 | 
  <marostegui> | 
  Deploy schema change on db1105:3312 T144010 T51190 T199368 | 
  [production] | 
            
  | 14:29 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 for alter table (duration: 00m 54s) | 
  [production] | 
            
  | 14:22 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 after alter table (duration: 00m 54s) | 
  [production] | 
            
  | 14:17 | 
  <elukey> | 
  roll restart kafka on kafka-jumbo* and kafka main-codfw (kafka2*) to pick up new Xmx/Xms settings (1g -> 2g) | 
  [production] | 
            
  | 14:15 | 
  <volans> | 
  upgrading cumin/debdeploy/reimage and other tools on neodymium - T187773 | 
  [production] | 
            
  | 13:57 | 
  <elukey> | 
  restart kafka on kafka-jumbo1001 to raise Xmx/Xms jvm settings (1g -> 2g) | 
  [production] | 
            
  | 13:43 | 
  <marostegui> | 
  Deploy schema change on db1103:3312 T144010 T51190 T199368 | 
  [production] | 
            
  | 13:43 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for alter table (duration: 00m 54s) | 
  [production] | 
            
  | 13:38 | 
  <volans> | 
  reimaging mw2225 to test py3 reimage with new cumin, conftool and apache test - T187773 | 
  [production] | 
            
  | 13:34 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3314 (duration: 00m 53s) | 
  [production] | 
            
  | 13:25 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | 
  [production] | 
            
  | 13:22 | 
  <moritzm> | 
  installing python-pysaml2 security updates | 
  [production] | 
            
  | 13:05 | 
  <moritzm> | 
  installing ffmpeg security updates | 
  [production] | 
            
  | 12:48 | 
  <moritzm> | 
  installing xerces-c security updates | 
  [production] | 
            
  | 12:38 | 
  <moritzm> | 
  uploaded debdeploy 0.0.99.5 to apt.wikimedia.org | 
  [production] | 
            
  | 11:49 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 11:46 | 
  <zfilipin@deploy1001> | 
  Synchronized dblists/categories-rdf.dblist: SWAT: [[gerrit:445720|Remove labs wikis from the categories-rdf list, dont need them (T198356)]] (duration: 00m 55s) | 
  [production] | 
            
  | 11:44 | 
  <moritzm> | 
  installing reportbug update from stretch point release to test py3-based debdeploy | 
  [production] | 
            
  | 11:40 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:446613|Enable Special:Block Feedback Request (T199919)]] (duration: 00m 55s) | 
  [production] | 
            
  | 11:33 | 
  <catrope@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable Structured Discussions beta feature on orwiki (T199971) (duration: 00m 55s) | 
  [production] | 
            
  | 11:22 | 
  <volans> | 
  testing reimage of californium (spare host) with the upgraded cumin | 
  [production] | 
            
  | 11:20 | 
  <chasemp> | 
  maintain-views --all-databases --replace-all --table ores_classification --debug (labsdb) | 
  [production] | 
            
  | 11:19 | 
  <chasemp> | 
  maintain-views --all-databases --replace-all --table ores_model --debug (labsdb) | 
  [production] | 
            
  | 11:18 | 
  <tgr@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: enable TemplateStyles on enwiki, frwiki, zhwiki T197603 T191452 T189022 (duration: 00m 55s) | 
  [production] | 
            
  | 10:59 | 
  <volans> | 
  upgrading cumin on sarin - T187773 | 
  [production] | 
            
  | 10:52 | 
  <legoktm> | 
  made myself a crat on test2wiki | 
  [production] | 
            
  | 10:06 | 
  <moritzm> | 
  installing file/libmagic security updates | 
  [production] | 
            
  | 09:55 | 
  <moritzm> | 
  installing check-postgres update from stretch 9.5 point release | 
  [production] | 
            
  | 09:49 | 
  <aaron@deploy1001> | 
  Synchronized php-1.32.0-wmf.13/includes/libs/objectcache/MultiWriteBagOStuff.php: 2cee0ab7085a74d35bc192ec8bc9cf461b286695 (duration: 00m 55s) | 
  [production] | 
            
  | 09:35 | 
  <volans> | 
  cumin upgrade on labpuppetmaster* hosts completed - T187773 | 
  [production] | 
            
  | 09:33 | 
  <moritzm> | 
  installing openssl security updates | 
  [production] | 
            
  | 09:33 | 
  <volans> | 
  removed leftover cumin installation from labtestpuppetmaster2001 - T187773 | 
  [production] | 
            
  | 09:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | 
  [production] | 
            
  | 09:27 | 
  <godog> | 
  run xfs_repair on filesystems reporting negative space available on ms-be1040 - T199198 | 
  [production] | 
            
  | 09:24 | 
  <moritzm> | 
  installing tomcat7 security updates | 
  [production] | 
            
  | 09:23 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool es1019 with low load (duration: 00m 54s) | 
  [production] | 
            
  | 09:21 | 
  <moritzm> | 
  installing ant security updates | 
  [production] | 
            
  | 09:14 | 
  <moritzm> | 
  uploaded jenkins 2.121.2 to apt.wikimedia.org (T199448) | 
  [production] | 
            
  | 08:46 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | 
  [production] | 
            
  | 08:39 | 
  <volans> | 
  start upgrade of cumin to 3.0.1-1 on labpuppetmaster* - T187773 | 
  [production] |