| 2016-02-03
      
      § | 
    
  | 17:32 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1060 after maintenance (duration: 01m 20s) | [production] | 
            
  | 17:22 | <mobrovac> | restbase restarting rb1001 | [production] | 
            
  | 17:03 | <mdholloway> | mobileapps deployed 68e38ec | [production] | 
            
  | 17:02 | <bblack> | restarting pybal on lvs1004 (not 1003!) T125397 | [production] | 
            
  | 17:02 | <bblack> | restarting pybal on lvs1003 T125397 | [production] | 
            
  | 16:57 | <hashar> | mira: updating /srv/mediawiki-staging/php-1.27.0-wmf.12  (prep deployment train) | [production] | 
            
  | 16:55 | <thcipriani@mira> | Synchronized wmf-config/CirrusSearch-production.php: SWAT: Return more like search queries to codfw [[gerrit:268097]] (duration: 01m 17s) | [production] | 
            
  | 16:45 | <thcipriani@mira> | Synchronized wmf-config/CommonSettings.php: SWAT: Remove unused/no longer existing item-create oauth grant [[gerrit:265447]] (duration: 01m 18s) | [production] | 
            
  | 16:39 | <thcipriani@mira> | Synchronized wmf-config: SWAT: Enable math data type on test wikidata + test wikipedias [[gerrit:268086]] (duration: 01m 18s) | [production] | 
            
  | 16:32 | <thcipriani@mira> | Synchronized wmf-config/mobile.php: SWAT: Remove section collapsing config [[gerrit:267776]] (duration: 01m 18s) | [production] | 
            
  | 16:28 | <akosiaris> | OTRS migration to 4.0 completed, starting upgrade to 5.0 | [production] | 
            
  | 16:24 | <thcipriani@mira> | Synchronized wmf-config/CommonSettings.php: SWAT: MW parsoid URLs: s/parsoidcache/parsoid/ [[gerrit:267234]] (duration: 01m 18s) | [production] | 
            
  | 16:18 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Add 2 sites to $wgCopyUploadsDomains [[gerrit:262893]] (duration: 01m 18s) | [production] | 
            
  | 16:13 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Just use the default MobileFrontend specified page actions. Part II [[gerrit:267807]] (duration: 01m 18s) | [production] | 
            
  | 16:11 | <thcipriani@mira> | Synchronized wmf-config/mobile.php: SWAT: Just use the default MobileFrontend specified page actions. Part I [[gerrit:267807]] (duration: 02m 14s) | [production] | 
            
  | 15:41 | <hashar> | mira symlink pointing to current version got changed to wmf.11 by the checkoutMediaWiki script.   Manually changed to proper wmf.10 https://phabricator.wikimedia.org/T125475#1994078 | [production] | 
            
  | 15:32 | <jynus> | restart and reconfigure mysql in db1060 | [production] | 
            
  | 15:30 | <hashar> | MediaWiki 1.27.0-wmf.12, from 1.27.0-wmf.12, successfully checked out. | [production] | 
            
  | 15:23 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Depool db1060 (duration: 00m 43s) | [production] | 
            
  | 15:21 | <hashar> | mira: cloning 1.27.0-wmf.12  (no link updates) | [production] | 
            
  | 15:15 | <bblack> | rebooting cp1060 (depooled/downtimed) | [production] | 
            
  | 15:11 | <bblack> | depooling cp1060 temporarily from cache_mobile varnish backends | [production] | 
            
  | 14:55 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1054 with low weight, repool db1067 with original weight (duration: 01m 22s) | [production] | 
            
  | 14:50 | <bblack> | rebooting cp1008 for kernel | [production] | 
            
  | 14:28 | <godog> | investigating uwsgi processes for graphite-web not coming up after reboot | [production] | 
            
  | 14:10 | <moritzm> | rebooting graphite1001 for kernel update | [production] | 
            
  | 13:41 | <godog> | powercycle ms-be2015 | [production] | 
            
  | 13:39 | <jynus> | restarting and reconfiguring mysql at db1054 | [production] | 
            
  | 13:27 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1067 at low weight; depool db1054 (duration: 01m 16s) | [production] | 
            
  | 11:45 | <jynus> | restarting and reconfiguring mysql at db1067 | [production] | 
            
  | 11:11 | <moritzm> | repooling restbase1001 | [production] | 
            
  | 11:04 | <akosiaris> | OTRS database upgraded to 3.3, moving on with 4.0 | [production] | 
            
  | 11:00 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1063 at 100% load; depool db1067 for maintenance (duration: 01m 16s) | [production] | 
            
  | 10:48 | <moritzm> | depooling restbase1001 for kernel/Java update | [production] | 
            
  | 10:37 | <_joe_> | ending the load test on the eqiad apaches | [production] | 
            
  | 10:11 | <moritzm> | reboot francium for kernel update | [production] | 
            
  | 09:53 | <jynus> | m2 backup finished on /srv/backups/2016-02-03_08-51-06, filename 'db1020-bin.000842', position 220103947 | [production] | 
            
  | 09:50 | <moritzm> | restarting neodymium for kernel update | [production] | 
            
  | 09:49 | <_joe_> | doing some basic load test on appservers in eqiad | [production] | 
            
  | 08:52 | <akosiaris> | stop otrs-daemon on mendelevium | [production] | 
            
  | 08:51 | <jynus> | starting mysql backup on db1020 (/srv/backups) | [production] | 
            
  | 08:44 | <akosiaris> | stop slave on db2011, db1020's (m2-master) slave, for OTRS migration. DO NOT ENABLE | [production] | 
            
  | 08:40 | <akosiaris> | stop exim4, cron, apache2 on iodine, mendelevium | [production] | 
            
  | 08:39 | <akosiaris> | disabling puppet on iodine, mendelevium, OTRS migration | [production] | 
            
  | 08:24 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1063 with low weight (duration: 01m 20s) | [production] |