| 
      
        2018-12-14
      
      §
     | 
  
    
  | 09:28 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2049, db2059, db2070 after mysql and kernel upgrade (duration: 00m 45s) | 
  [production] | 
            
  | 09:21 | 
  <banyek> | 
  global user rename is in progress - T209488 | 
  [production] | 
            
  | 08:58 | 
  <marostegui> | 
  Stop MySQL on db2049, db2059 and db2070 for mysql and kernel upgrade | 
  [production] | 
            
  | 08:56 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2049, db2059, db2070 for mysql and kernel upgrade (duration: 00m 43s) | 
  [production] | 
            
  | 08:50 | 
  <elukey> | 
  swap oxygen with weblog1001 | 
  [production] | 
            
  | 08:48 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2084 and db2088 after mysql and kernel upgrade (duration: 00m 44s) | 
  [production] | 
            
  | 08:47 | 
  <elukey> | 
  disabled kafkatee-webrequest logstash output on oxygen (prep step before weblog1001) | 
  [production] | 
            
  | 07:58 | 
  <marostegui> | 
  Deploy schema change on dbstore1002:s3 T86338 T202167 | 
  [production] | 
            
  | 07:49 | 
  <marostegui> | 
  Upgrade mysql and kernel on db2084 and db2088 | 
  [production] | 
            
  | 07:49 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2084 and db2088 for mysql and kernel upgrade (duration: 00m 45s) | 
  [production] | 
            
  | 06:54 | 
  <marostegui> | 
  Deploy schema change on db2043 (s3 codfw master) - this will generate lag on s3 codfw T86338 T202167 | 
  [production] | 
            
  | 06:53 | 
  <marostegui> | 
  Deploy schema change on db2043 (s3 codfw master) - this will generate lag on s3 codfw T86338 T20216 | 
  [production] | 
            
  | 06:14 | 
  <marostegui> | 
  Deploy schema change on db1062 (s7 primary master) T86338 T202167 | 
  [production] | 
            
  | 06:14 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1094 T86338 T202167 (duration: 00m 44s) | 
  [production] | 
            
  | 06:10 | 
  <marostegui> | 
  Deployed schema change on db1094 T86338 T202167 | 
  [production] | 
            
  | 05:55 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1094 T86338 T202167 (duration: 00m 47s) | 
  [production] | 
            
  | 01:39 | 
  <mutante> | 
  install2002 deleted /srv/ contents,then mounted /mnt/vdb on /srv  so same content but now / is used only 7% and /srv 57% (T211850) | 
  [production] | 
            
  | 00:43 | 
  <mutante> | 
  install2002 (T211850) restarted instance, created ext4 filesystem on new /dev/vdb, mounted on /mnt/vdb, rsyncing /srv/ to /mnt/vdb/ | 
  [production] | 
            
  | 00:33 | 
  <mutante> | 
  rebooting install2002 via ganeti2003, to add new virtual disk | 
  [production] | 
            
  | 00:31 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: Enforce a 10-byte password for +staff users, I4ecac70e (duration: 00m 44s) | 
  [production] | 
            
  | 00:27 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT I7867277d Make wmgBabelMainCategory consistent for sr* wikis (duration: 00m 45s) | 
  [production] | 
            
  
    | 
      
        2018-12-13
      
      §
     | 
  
    
  | 23:57 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: T208246: Increase default minimum new password length to 10 for privileged groups (duration: 00m 44s) | 
  [production] | 
            
  | 23:17 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@18c4ca6]: Rolling out fix for T131367 (duration: 03m 25s) | 
  [production] | 
            
  | 23:13 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@18c4ca6]: Rolling out fix for T131367 | 
  [production] | 
            
  | 22:31 | 
  <reedy@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/includes/http/HttpRequestFactory.php: T211886 (duration: 00m 44s) | 
  [production] | 
            
  | 22:29 | 
  <reedy@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/extensions/MobileFrontend: T211903 (duration: 00m 48s) | 
  [production] | 
            
  | 21:55 | 
  <mutante> | 
  Ganeti - creating new 120G virtual disk on install2002 (T211850) | 
  [production] | 
            
  | 21:00 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/superset/deploy@UNKNOWN]: revert to version 0.26.3 (duration: 00m 32s) | 
  [production] | 
            
  | 20:59 | 
  <otto@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: revert to version 0.26.3 | 
  [production] | 
            
  | 20:33 | 
  <dcausse> | 
  creating 300+ wikis indices in elastic-psi @eqiad and @codfw | 
  [production] | 
            
  | 20:21 | 
  <volans> | 
  imported elasticsearch-curator_5.2.0-1~deb9u1 into apt.w.o stretch-wikimedia component/spicerack - T205884 | 
  [production] | 
            
  | 20:10 | 
  <mutante> | 
  LDAP - added mneisler to wmf (T211742) - existing shell user, so no gerrit change needed | 
  [production] | 
            
  | 19:53 | 
  <hoo> | 
  Ran scap pull on snapshot1005 to undo live changes done for dump performance testing | 
  [production] | 
            
  | 19:49 | 
  <dcausse> | 
  creating 300 wiki indices in elastic-omega@eqiad | 
  [production] | 
            
  | 19:46 | 
  <dcausse> | 
  SF Morning SWAT done | 
  [production] | 
            
  | 19:44 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] fix cluster settings for temp clusters psi&omega (duration: 00m 44s) | 
  [production] | 
            
  | 19:40 | 
  <moritzm> | 
  removed labvirt1014 from debmonitor DB, has been renamed to cloudvirt1014 | 
  [production] | 
            
  | 19:39 | 
  <volans> | 
  imported python-elasticsearch_5.4.0-1~deb9u1 into apt.w.o stretch-wikimedia component/spicerack - T205884 | 
  [production] | 
            
  | 19:35 | 
  <dcausse@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/extensions/TwoColConflict/: T210501: Add missing code to not loose edits on the other side (duration: 00m 45s) | 
  [production] | 
            
  | 19:29 | 
  <bblack> | 
  authdns2001: upgrading gdnsd to 2.99.9944-beta | 
  [production] | 
            
  | 19:27 | 
  <bblack> | 
  multatuli: upgrading gdnsd to 2.99.9944-beta | 
  [production] | 
            
  | 19:22 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T211234: Enable Block notice stats on top blocking wikis (duration: 00m 45s) | 
  [production] | 
            
  | 19:19 | 
  <bblack> | 
  authdns1001: upgrading gdnsd to 2.99.9944-beta | 
  [production] | 
            
  | 18:52 | 
  <arlolra> | 
  Updated Parsoid to 4242ad0 (T204622, T211738) | 
  [production] | 
            
  | 18:40 | 
  <arlolra@deploy1001> | 
  Finished deploy [parsoid/deploy@e27574c]: Updating Parsoid to 4242ad0 (duration: 09m 17s) | 
  [production] | 
            
  | 18:31 | 
  <arlolra@deploy1001> | 
  Started deploy [parsoid/deploy@e27574c]: Updating Parsoid to 4242ad0 | 
  [production] | 
            
  | 18:30 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@93443fe]: Refine MW API queries (duration: 03m 41s) | 
  [production] | 
            
  | 18:26 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@93443fe]: Refine MW API queries | 
  [production] | 
            
  | 18:24 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: T204748 [Beta only] Use newly-fixed config for Wikibase->Commons federation (duration: 00m 44s) | 
  [production] | 
            
  | 18:22 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T204748 Rename repo-only Wikibase config for clarity [no-op] (duration: 00m 45s) | 
  [production] |