| 
      
        2017-03-13
      
      §
     | 
  
    
  | 12:05 | 
  <moritzm> | 
  install libevent security updates | 
  [production] | 
            
  | 11:56 | 
  <elukey> | 
  reimage analytics1042 (Hadoop worker node) to Debian Jessie | 
  [production] | 
            
  | 11:15 | 
  <godog> | 
  bounce pybal on lvs1006 to try picking up swift https changes | 
  [production] | 
            
  | 11:06 | 
  <zeljkof> | 
  purge bswiki logo - T158815 | 
  [production] | 
            
  | 10:44 | 
  <Dereckson> | 
  Update site statistics on gu.wikipedia (T160328) | 
  [production] | 
            
  | 09:23 | 
  <gehel> | 
  downgrading elasticsearch to v5.1.2 on relforge, a full reindex will be needed - T156150 | 
  [production] | 
            
  | 08:40 | 
  <marostegui> | 
  Compress dewiki - db1070 - T153743 | 
  [production] | 
            
  | 08:31 | 
  <marostegui> | 
  Stop replication on labsdb1009,10 and 11 - T153743 | 
  [production] | 
            
  | 08:30 | 
  <marostegui> | 
  Stop MySQL on db1095 (sanitarium2) to take a backup - T153743 | 
  [production] | 
            
  | 08:27 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1070 - T153743 (duration: 00m 41s) | 
  [production] | 
            
  | 08:08 | 
  <marostegui> | 
  Deploy alter table s6 - db1050 (master) - T159414 | 
  [production] | 
            
  | 08:03 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1030 - T159414 (duration: 00m 41s) | 
  [production] | 
            
  | 07:46 | 
  <moritzm> | 
  upgrading apache on remaining mediawiki servers in eqiad | 
  [production] | 
            
  | 07:24 | 
  <marostegui> | 
  Deploy alter table enwiki.revision db1089 - T132416 | 
  [production] | 
            
  | 07:24 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1089 - T132416 (duration: 00m 41s) | 
  [production] | 
            
  | 07:13 | 
  <marostegui> | 
  Deploy alter table s6 revision table on db1030 - T159414 | 
  [production] | 
            
  | 07:12 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1030 - T159414 (duration: 00m 52s) | 
  [production] | 
            
  | 06:52 | 
  <elukey> | 
  powercycle mw2256, stuck in boot (looked in the console) | 
  [production] | 
            
  | 02:28 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Mon Mar 13 02:28:18 UTC 2017 (duration 5m 21s) | 
  [production] | 
            
  | 02:22 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.29.0-wmf.15) (duration: 08m 57s) | 
  [production] | 
            
  
    | 
      
        2017-03-11
      
      §
     | 
  
    
  | 08:39 | 
  <jynus> | 
  powercycle es2015 - unresponsive | 
  [production] | 
            
  | 02:22 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.29.0-wmf.15) (duration: 07m 41s) | 
  [production] | 
            
  | 00:19 | 
  <smalyshev@tin> | 
  Finished deploy [wdqs/wdqs@UNKNOWN]: Deploy new updater on 1003 for potential connection drop fix (duration: 02m 15s) | 
  [production] | 
            
  | 00:16 | 
  <smalyshev@tin> | 
  Started deploy [wdqs/wdqs@UNKNOWN]: Deploy new updater on 1003 for potential connection drop fix | 
  [production] | 
            
  | 00:08 | 
  <smalyshev@tin> | 
  Finished deploy [wdqs/wdqs@UNKNOWN]: Deploy new updater on 1003 for potential connection drop fix (duration: 00m 16s) | 
  [production] | 
            
  | 00:08 | 
  <smalyshev@tin> | 
  Started deploy [wdqs/wdqs@UNKNOWN]: Deploy new updater on 1003 for potential connection drop fix | 
  [production] | 
            
  | 00:07 | 
  <SMalyshev> | 
  going to deploy updater patch on wdq1003. The host is in maintenance, not a production deployment. | 
  [production] | 
            
  
    | 
      
        2017-03-10
      
      §
     | 
  
    
  | 21:42 | 
  <hashar> | 
  restarted Zuul | 
  [production] | 
            
  | 20:06 | 
  <gehel> | 
  restart kartotherian / tilerator(ui) on maps-test* | 
  [production] | 
            
  | 20:06 | 
  <gehel@tin> | 
  Finished deploy [kartotherian/deploy@76adf21]: (no justification provided) (duration: 00m 54s) | 
  [production] | 
            
  | 20:05 | 
  <gehel@tin> | 
  Started deploy [kartotherian/deploy@76adf21]: (no justification provided) | 
  [production] | 
            
  | 20:03 | 
  <gehel@tin> | 
  Finished deploy [tilerator/deploy@b501046]: (no justification provided) (duration: 00m 16s) | 
  [production] | 
            
  | 20:03 | 
  <gehel@tin> | 
  Started deploy [tilerator/deploy@b501046]: (no justification provided) | 
  [production] | 
            
  | 19:57 | 
  <gehel> | 
  restarting tilerator(ui) on maps-test2004 | 
  [production] | 
            
  | 19:57 | 
  <gehel@tin> | 
  Finished deploy [tilerator/deploy@b501046]: (no justification provided) (duration: 00m 04s) | 
  [production] | 
            
  | 19:57 | 
  <gehel@tin> | 
  Started deploy [tilerator/deploy@b501046]: (no justification provided) | 
  [production] | 
            
  | 19:47 | 
  <gehel> | 
  restarting tilerator(ui) on maps-test2004 | 
  [production] | 
            
  | 19:47 | 
  <gehel@tin> | 
  Finished deploy [tilerator/deploy@b501046]: (no justification provided) (duration: 00m 03s) | 
  [production] | 
            
  | 19:47 | 
  <gehel@tin> | 
  Started deploy [tilerator/deploy@b501046]: (no justification provided) | 
  [production] | 
            
  | 19:45 | 
  <gehel> | 
  failed tilerator deploy on maps-test2004 | 
  [production] | 
            
  | 19:45 | 
  <gehel@tin> | 
  Finished deploy [tilerator/deploy@b501046]: (no justification provided) (duration: 01m 20s) | 
  [production] | 
            
  | 19:44 | 
  <gehel@tin> | 
  Started deploy [tilerator/deploy@b501046]: (no justification provided) | 
  [production] | 
            
  | 19:36 | 
  <ejegg> | 
  ran wmf_civicrm db updates through 7500 -   Add benevity as a financial type for benevity imports. | 
  [production] | 
            
  | 19:34 | 
  <gehel> | 
  restart kartotherian on maps-test2004 | 
  [production] | 
            
  | 19:28 | 
  <gehel@tin> | 
  Finished deploy [kartotherian/deploy@76adf21]: (no justification provided) (duration: 00m 23s) | 
  [production] | 
            
  | 19:27 | 
  <gehel@tin> | 
  Started deploy [kartotherian/deploy@76adf21]: (no justification provided) | 
  [production] | 
            
  | 19:19 | 
  <gehel> | 
  upgrading kartotherian on maps-test2004 - T150354 | 
  [production] | 
            
  | 19:07 | 
  <MaxSem> | 
  Unmasked kartotherian on maps-test2004 | 
  [production] |