| 
      
        2017-07-10
      
      ยง
     | 
  
    
  | 22:13 | 
  <MaxSem> | 
  Re-ran cleanupTitles.php on Meta with live fix applied, works now (ref T61837) | 
  [production] | 
            
  | 22:08 | 
  <reedy@tin> | 
  Synchronized php-1.30.0-wmf.7/includes/: (no justification provided) (duration: 01m 33s) | 
  [production] | 
            
  | 22:00 | 
  <bblack> | 
  restart varnish backend on cp1099 (mailbox lag) | 
  [production] | 
            
  | 21:06 | 
  <volans> | 
  running IPMI auditing to update status of T150160 | 
  [production] | 
            
  | 19:48 | 
  <MaxSem> | 
  Running cleanupTitles.php on Meta | 
  [production] | 
            
  | 19:14 | 
  <niharika29@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/CirrusSearch/: Ignore archive records with null page_id (T169977) (duration: 00m 52s) | 
  [production] | 
            
  | 19:09 | 
  <niharika29@tin> | 
  Synchronized wmf-config/: Stop disabling MFTidyMobileViewSections (T168671) and Logo changes for various wiki projects (T165896) (duration: 00m 21s) | 
  [production] | 
            
  | 19:07 | 
  <niharika29@tin> | 
  Synchronized static/images/mobile/: Logo changes for various wiki projects [mediawiki-config] - https://gerrit.wikimedia.org/r/364241 (https://phabricator.wikimedia.org/T165896) (duration: 00m 20s) | 
  [production] | 
            
  | 19:07 | 
  <niharika29@tin> | 
  scap failed: average error rate on 2/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:58 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Logo and favicon changes for arbcom_dewiki (T166947) (duration: 00m 20s) | 
  [production] | 
            
  | 18:57 | 
  <niharika29@tin> | 
  Synchronized static/: Logo and favicon changes for arbcom_dewiki (T166947) (duration: 00m 20s) | 
  [production] | 
            
  | 18:56 | 
  <niharika29@tin> | 
  scap failed: average error rate on 2/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:47 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add wgMetaNamespace / wgMetaNamespaceTalk for lv.wiktionary [mediawiki-config] - https://gerrit.wikimedia.org/r/364197 (T170065) (duration: 00m 20s) | 
  [production] | 
            
  | 18:45 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:43 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:41 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:40 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:36 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Logo updates for sr.wikiquote (T168444) (duration: 00m 40s) | 
  [production] | 
            
  | 18:35 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 18:34 | 
  <niharika29@tin> | 
  Synchronized static/images/project-logos: Logo updates for sr.wikiquote (T168444) (duration: 00m 40s) | 
  [production] | 
            
  | 18:32 | 
  <niharika29@tin> | 
  Synchronized static/images/project-logos/srwikiquote-1.5x.png: Logo updates for sr.wikiquote (T168444) (duration: 00m 41s) | 
  [production] | 
            
  | 18:23 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) (duration: 00m 42s) | 
  [production] | 
            
  | 18:22 | 
  <niharika29@tin> | 
  scap aborted: wmf-config/InitialiseSettings.php Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) (duration: 06m 19s) | 
  [production] | 
            
  | 18:15 | 
  <niharika29@tin> | 
  Started scap: wmf-config/InitialiseSettings.php Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) | 
  [production] | 
            
  | 17:55 | 
  <otto@tin> | 
  Finished deploy [eventstreams/deploy@3d37f5d]: Redirect routes for RCStream deprecation (duration: 02m 41s) | 
  [production] | 
            
  | 17:55 | 
  <ottomata> | 
  disabling RCStream varnish routing: T170157 | 
  [production] | 
            
  | 17:52 | 
  <otto@tin> | 
  Started deploy [eventstreams/deploy@3d37f5d]: Redirect routes for RCStream deprecation | 
  [production] | 
            
  | 17:35 | 
  <ejegg> | 
  updated payments-wiki from 8bdd7061a3ceb46969050c15e723b4638e762a59 to f935c06b566aa7c54c74a1e41c31c9e669eb0c9b | 
  [production] | 
            
  | 17:07 | 
  <gehel@tin> | 
  Finished deploy [wdqs/wdqs@1b3b73e]: (no justification provided) (duration: 01m 42s) | 
  [production] | 
            
  | 17:06 | 
  <gehel@tin> | 
  Started deploy [wdqs/wdqs@1b3b73e]: (no justification provided) | 
  [production] | 
            
  | 17:00 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1080 - T166204 (duration: 00m 42s) | 
  [production] | 
            
  | 16:14 | 
  <nuria@tin> | 
  Finished deploy [eventlogging/analytics@5e16da1]: (no justification provided) (duration: 00m 04s) | 
  [production] | 
            
  | 16:14 | 
  <nuria@tin> | 
  Started deploy [eventlogging/analytics@5e16da1]: (no justification provided) | 
  [production] | 
            
  | 15:56 | 
  <elukey@tin> | 
  Finished deploy [analytics/refinery@6da2774]: Update stat1002 with the last refinery deployment (duration: 00m 04s) | 
  [production] | 
            
  | 15:55 | 
  <elukey@tin> | 
  Started deploy [analytics/refinery@6da2774]: Update stat1002 with the last refinery deployment | 
  [production] | 
            
  | 15:47 | 
  <milimetric@tin> | 
  Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 00m 07s) | 
  [production] | 
            
  | 15:47 | 
  <milimetric@tin> | 
  Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | 
  [production] | 
            
  | 15:43 | 
  <milimetric@tin> | 
  Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 01m 36s) | 
  [production] | 
            
  | 15:42 | 
  <milimetric@tin> | 
  Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | 
  [production] | 
            
  | 15:37 | 
  <milimetric@tin> | 
  Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 02m 06s) | 
  [production] | 
            
  | 15:35 | 
  <milimetric@tin> | 
  Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | 
  [production] | 
            
  | 15:24 | 
  <andrewbogott> | 
  adding two new hosts (labvirt1014 and labvirt1015) to the nova-compute scheduling pool.  Possible nodepool side-effects, maybe good ones? | 
  [production] | 
            
  | 15:14 | 
  <marostegui> | 
  Drop ukwikimedia_p views from labsdb hosts - T169488 | 
  [production] | 
            
  | 15:00 | 
  <moritzm> | 
  installing apache security updates on app server canaries | 
  [production] | 
            
  | 14:40 | 
  <andrewbogott> | 
  rebooting labvirt1015-1018 for kernel updates | 
  [production] | 
            
  | 14:23 | 
  <marostegui> | 
  Deploy alter table on db1059 - T168661 | 
  [production] | 
            
  | 14:22 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1059 - T168661 (duration: 00m 41s) | 
  [production] | 
            
  | 14:20 | 
  <marostegui@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 14:14 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1091 - T168661 (duration: 00m 42s) | 
  [production] | 
            
  | 14:13 | 
  <moritzm> | 
  reimaging mw2118 (video scaler) to jessie | 
  [production] |