| 
      
        2018-09-28
      
      §
     | 
  
    
  | 15:51 | 
  <Amir1> | 
  ladsgroup@mwmaint2001:~$ mwscript extensions/CentralAuth/maintenance/deleteLocalPasswords.php --delete on mediawiki.org and testwiki | 
  [production] | 
            
  | 15:10 | 
  <XioNoX> | 
  activate Equinix peering sessions on cr4-ulsfo | 
  [production] | 
            
  | 14:29 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1086, db1104 (duration: 00m 55s) | 
  [production] | 
            
  | 14:22 | 
  <banyek> | 
  converting dewiki.flaggedimages to TokuDB on host dbstrore1002 (T205544) | 
  [production] | 
            
  | 13:27 | 
  <moritzm> | 
  rebooting tungsten for kernel security update | 
  [production] | 
            
  | 13:15 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #4 (duration: 06m 36s) | 
  [production] | 
            
  | 13:09 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #4 | 
  [production] | 
            
  | 13:08 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #3 (duration: 03m 39s) | 
  [production] | 
            
  | 13:05 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #3 | 
  [production] | 
            
  | 13:05 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #2 (duration: 04m 57s) | 
  [production] | 
            
  | 13:00 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #2 | 
  [production] | 
            
  | 13:00 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints (duration: 10m 55s) | 
  [production] | 
            
  | 12:49 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints | 
  [production] | 
            
  | 12:42 | 
  <arturo> | 
  downtime cloudcontrol1003.wikimedia.org for 2H (tests related to T203177) | 
  [production] | 
            
  | 12:39 | 
  <banyek> | 
  converting wikidatawiki.text to TokuDB on host dbstrore1002 (T205544) | 
  [production] | 
            
  | 12:28 | 
  <arturo> | 
  downtime cloudcontrol1004.wikimedia.org for 2H (tests related to T203177) | 
  [production] | 
            
  | 12:01 | 
  <moritzm> | 
  installint php security updates on einsteinium (icinga.wikimedia.org) | 
  [production] | 
            
  | 11:38 | 
  <arturo> | 
  add prometheus-openstack-exporter 0.0.8-2 to reprepro (T203177) | 
  [production] | 
            
  | 11:21 | 
  <moritzm> | 
  installing php5 security updates | 
  [production] | 
            
  | 11:01 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@961aa5a]: Update mobileapps to 38271fa (duration: 03m 05s) | 
  [production] | 
            
  | 10:58 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@961aa5a]: Update mobileapps to 38271fa | 
  [production] | 
            
  | 10:55 | 
  <banyek> | 
  converting dewiki.flaggedtemplates to TokuDB on host dbstrore1002 (T205544) | 
  [production] | 
            
  | 10:09 | 
  <moritzm> | 
  reimaging mw2150 to test router ACLs on cumin1001 | 
  [production] | 
            
  | 09:45 | 
  <jynus> | 
  stop db1086 and db1104 for cloning to db1116 | 
  [production] | 
            
  | 09:41 | 
  <moritzm> | 
  installing ca-certificates updates on trusty/stretch | 
  [production] | 
            
  | 09:34 | 
  <banyek> | 
  converting whikishared.cx_coprora to TokuDB on host dbstrore1002 (T205544) | 
  [production] | 
            
  | 09:30 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1086, db1104 (duration: 00m 57s) | 
  [production] | 
            
  | 08:12 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1078 (duration: 00m 54s) | 
  [production] | 
            
  | 08:11 | 
  <marostegui> | 
  Deploy schema change on s3 eqiad, this will generate lag - T203709 | 
  [production] | 
            
  | 07:40 | 
  <marostegui> | 
  Stop replication in sync on dbstore1002 and db1078 | 
  [production] | 
            
  | 07:40 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1078 (duration: 00m 55s) | 
  [production] | 
            
  | 07:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2055 (duration: 00m 56s) | 
  [production] | 
            
  | 07:23 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc (duration: 02m 43s) | 
  [production] | 
            
  | 07:20 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc | 
  [production] | 
            
  | 07:03 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc | 
  [production] | 
            
  | 06:30 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc (duration: 01m 57s) | 
  [production] | 
            
  | 06:28 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc | 
  [production] | 
            
  | 06:27 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc (duration: 06m 40s) | 
  [production] | 
            
  | 06:20 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc | 
  [production] | 
            
  | 06:20 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc (duration: 00m 44s) | 
  [production] | 
            
  | 06:19 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@bf09080]: Update mobileapps to 7878ffc | 
  [production] | 
            
  | 06:07 | 
  <marostegui> | 
  Deploy schema change on db2055 - T203709 | 
  [production] | 
            
  | 06:07 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2055 (duration: 00m 55s) | 
  [production] | 
            
  | 05:54 | 
  <marostegui> | 
  Deploy schema change on s7 eqiad, this will generate lag - T203709 | 
  [production] | 
            
  | 05:47 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1094 (duration: 00m 55s) | 
  [production] | 
            
  | 05:29 | 
  <marostegui> | 
  Stop replication in sync on db1094 and dbstore1002:s7 | 
  [production] | 
            
  | 05:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1094 (duration: 00m 59s) | 
  [production] |