| 
      
        2018-08-23
      
      ยง
     | 
  
    
  | 15:14 | 
  <jynus> | 
  upgrading db2089 | 
  [production] | 
            
  | 15:08 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 (duration: 00m 55s) | 
  [production] | 
            
  | 15:02 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1113 (duration: 00m 54s) | 
  [production] | 
            
  | 14:47 | 
  <jynus> | 
  upgrading db1113 | 
  [production] | 
            
  | 14:37 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/turnilo/deploy@50a8845]: Deploying 1.7.2 to analytics-tool1002 with dep fixes (duration: 00m 08s) | 
  [production] | 
            
  | 14:37 | 
  <otto@deploy1001> | 
  Started deploy [analytics/turnilo/deploy@50a8845]: Deploying 1.7.2 to analytics-tool1002 with dep fixes | 
  [production] | 
            
  | 14:36 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1113 (duration: 00m 57s) | 
  [production] | 
            
  | 14:26 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/turnilo/deploy@240b357]: Deploying 1.7.2 to analytics-tool1002 (duration: 05m 07s) | 
  [production] | 
            
  | 14:21 | 
  <otto@deploy1001> | 
  Started deploy [analytics/turnilo/deploy@240b357]: Deploying 1.7.2 to analytics-tool1002 | 
  [production] | 
            
  | 13:39 | 
  <jynus> | 
  upgrading dbstore1001 | 
  [production] | 
            
  | 13:38 | 
  <marostegui> | 
  Deploy schema change on db1103:3312 | 
  [production] | 
            
  | 13:37 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 (duration: 00m 54s) | 
  [production] | 
            
  | 13:33 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 (duration: 00m 54s) | 
  [production] | 
            
  | 13:29 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T198396 Revert "Limit page creation and edit rate on Wikidata" [[gerrit:454785]] (duration: 00m 56s) | 
  [production] | 
            
  | 13:06 | 
  <jynus> | 
  upgrading dbstore200[12], will take a while due to ongoing alter tables | 
  [production] | 
            
  | 12:34 | 
  <moritzm> | 
  install Java updates on Hadoop nodes | 
  [production] | 
            
  | 12:06 | 
  <moritzm> | 
  created new archiva-deployers LDAP group (T200454) | 
  [production] | 
            
  | 12:00 | 
  <marostegui> | 
  Deploy schema change on db1105:3312 | 
  [production] | 
            
  | 12:00 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 (duration: 00m 55s) | 
  [production] | 
            
  | 11:56 | 
  <addshore> | 
  SWAT done | 
  [production] | 
            
  | 11:50 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config: T199800 [[gerrit:Cleanup wikdiff2 mobile moved paragraph config]] (duration: 00m 55s) | 
  [production] | 
            
  | 11:40 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202555 [[gerrit:454590|Require autoconfirmed status to edit the 828 namespace at es.wikibooks]] (duration: 00m 56s) | 
  [production] | 
            
  | 11:35 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T202065 [[gerrit:454330|Switch 'wikidata-staff' add/remove 'interface-admin' for own account]] (duration: 00m 55s) | 
  [production] | 
            
  | 11:19 | 
  <moritzm> | 
  installing shared-mime-info updates from stretch 9.5 point release | 
  [production] | 
            
  | 11:18 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: T199800 [[gerrit:454026|Enable moved paragrah detection everywhere]] (duration: 00m 55s) | 
  [production] | 
            
  | 11:01 | 
  <marostegui> | 
  Deploy schema change on dbstore1002:s2 | 
  [production] | 
            
  | 11:00 | 
  <gehel> | 
  new SSL certs / tlsproxy deployed on elastic nodes - T198351 | 
  [production] | 
            
  | 10:56 | 
  <marostegui> | 
  Deploy schema change on s2 codfw masters (db2035) with replication - this will generate lag on s2 codfw | 
  [production] | 
            
  | 10:35 | 
  <moritzm> | 
  installing openldap updates from stretch 9.5 point release | 
  [production] | 
            
  | 10:27 | 
  <akosiaris> | 
  reboot analytics-tool* hosts for the IP renumbering change T202559 | 
  [production] | 
            
  | 10:27 | 
  <akosiaris> | 
  purge rec dns caches for analytics-tool* hosts T202559 | 
  [production] | 
            
  | 10:15 | 
  <elukey> | 
  restart druid-broker on druid100[4-5] due to unresponsiveness (still unclear why) | 
  [production] | 
            
  | 10:00 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1088 (duration: 00m 54s) | 
  [production] | 
            
  | 09:59 | 
  <marostegui> | 
  Deploy schema change on s6 primary master (db1061) | 
  [production] | 
            
  | 09:50 | 
  <moritzm> | 
  installing debdeploy update | 
  [production] | 
            
  | 09:40 | 
  <moritzm> | 
  restarting etherpad-lite for nodejs security update | 
  [production] | 
            
  | 09:29 | 
  <moritzm> | 
  installing nodejs security updates on wtp* (Parsoid servers) | 
  [production] | 
            
  | 09:28 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 00m 55s) | 
  [production] | 
            
  | 09:23 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1093 (duration: 00m 56s) | 
  [production] | 
            
  | 09:17 | 
  <gehel> | 
  starting to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/444610 as part of T198351, including regeneration of SSL certs. Disabling puppet on elastic* during the operation | 
  [production] | 
            
  | 08:51 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 55s) | 
  [production] | 
            
  | 08:45 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1085 (duration: 00m 55s) | 
  [production] | 
            
  | 08:42 | 
  <addshore> | 
  done with deploy window | 
  [production] | 
            
  | 08:41 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: T201832 Stuff for new link formatter on testwikidata [[gerrit:454510]] (duration: 00m 55s) | 
  [production] | 
            
  | 08:39 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T201832 Stuff for new link formatter on testwikidata [[gerrit:454510]] [[gerrit:452365]] [[gerrit:454764]] (duration: 00m 56s) | 
  [production] | 
            
  | 07:44 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1085 (duration: 00m 55s) | 
  [production] | 
            
  | 07:39 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 (duration: 00m 56s) | 
  [production] | 
            
  | 07:30 | 
  <moritzm> | 
  installing openssl updates | 
  [production] | 
            
  | 07:23 | 
  <marostegui> | 
  Drop blob_orphans and blob_tracking from s3 on codfw (lag will be generated on codfw) T59186 | 
  [production] | 
            
  | 07:12 | 
  <marostegui> | 
  Drop blob_orphans and blob_tracking from s1 T59186 | 
  [production] |