| 2017-07-10
      
      ยง | 
    
  | 18:56 | <niharika29@tin> | scap failed: average error rate on 2/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:47 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Add wgMetaNamespace / wgMetaNamespaceTalk for lv.wiktionary [mediawiki-config] - https://gerrit.wikimedia.org/r/364197 (T170065) (duration: 00m 20s) | [production] | 
            
  | 18:45 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:43 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:41 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:40 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:36 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Logo updates for sr.wikiquote (T168444) (duration: 00m 40s) | [production] | 
            
  | 18:35 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 18:34 | <niharika29@tin> | Synchronized static/images/project-logos: Logo updates for sr.wikiquote (T168444) (duration: 00m 40s) | [production] | 
            
  | 18:32 | <niharika29@tin> | Synchronized static/images/project-logos/srwikiquote-1.5x.png: Logo updates for sr.wikiquote (T168444) (duration: 00m 41s) | [production] | 
            
  | 18:23 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) (duration: 00m 42s) | [production] | 
            
  | 18:22 | <niharika29@tin> | scap aborted: wmf-config/InitialiseSettings.php Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) (duration: 06m 19s) | [production] | 
            
  | 18:15 | <niharika29@tin> | Started scap: wmf-config/InitialiseSettings.php Remove Programs and Participation namespaces from meta.wikimedia [mediawiki-config] - https://gerrit.wikimedia.org/r/363745 (T61837) | [production] | 
            
  | 17:55 | <otto@tin> | Finished deploy [eventstreams/deploy@3d37f5d]: Redirect routes for RCStream deprecation (duration: 02m 41s) | [production] | 
            
  | 17:55 | <ottomata> | disabling RCStream varnish routing: T170157 | [production] | 
            
  | 17:52 | <otto@tin> | Started deploy [eventstreams/deploy@3d37f5d]: Redirect routes for RCStream deprecation | [production] | 
            
  | 17:35 | <ejegg> | updated payments-wiki from 8bdd7061a3ceb46969050c15e723b4638e762a59 to f935c06b566aa7c54c74a1e41c31c9e669eb0c9b | [production] | 
            
  | 17:07 | <gehel@tin> | Finished deploy [wdqs/wdqs@1b3b73e]: (no justification provided) (duration: 01m 42s) | [production] | 
            
  | 17:06 | <gehel@tin> | Started deploy [wdqs/wdqs@1b3b73e]: (no justification provided) | [production] | 
            
  | 17:00 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1080 - T166204 (duration: 00m 42s) | [production] | 
            
  | 16:14 | <nuria@tin> | Finished deploy [eventlogging/analytics@5e16da1]: (no justification provided) (duration: 00m 04s) | [production] | 
            
  | 16:14 | <nuria@tin> | Started deploy [eventlogging/analytics@5e16da1]: (no justification provided) | [production] | 
            
  | 15:56 | <elukey@tin> | Finished deploy [analytics/refinery@6da2774]: Update stat1002 with the last refinery deployment (duration: 00m 04s) | [production] | 
            
  | 15:55 | <elukey@tin> | Started deploy [analytics/refinery@6da2774]: Update stat1002 with the last refinery deployment | [production] | 
            
  | 15:47 | <milimetric@tin> | Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 00m 07s) | [production] | 
            
  | 15:47 | <milimetric@tin> | Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | [production] | 
            
  | 15:43 | <milimetric@tin> | Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 01m 36s) | [production] | 
            
  | 15:42 | <milimetric@tin> | Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | [production] | 
            
  | 15:37 | <milimetric@tin> | Finished deploy [analytics/refinery@6da2774]: Update Sqoop fix python error (duration: 02m 06s) | [production] | 
            
  | 15:35 | <milimetric@tin> | Started deploy [analytics/refinery@6da2774]: Update Sqoop fix python error | [production] | 
            
  | 15:24 | <andrewbogott> | adding two new hosts (labvirt1014 and labvirt1015) to the nova-compute scheduling pool.  Possible nodepool side-effects, maybe good ones? | [production] | 
            
  | 15:14 | <marostegui> | Drop ukwikimedia_p views from labsdb hosts - T169488 | [production] | 
            
  | 15:00 | <moritzm> | installing apache security updates on app server canaries | [production] | 
            
  | 14:40 | <andrewbogott> | rebooting labvirt1015-1018 for kernel updates | [production] | 
            
  | 14:23 | <marostegui> | Deploy alter table on db1059 - T168661 | [production] | 
            
  | 14:22 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1059 - T168661 (duration: 00m 41s) | [production] | 
            
  | 14:20 | <marostegui@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 14:14 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1091 - T168661 (duration: 00m 42s) | [production] | 
            
  | 14:13 | <moritzm> | reimaging mw2118 (video scaler) to jessie | [production] | 
            
  | 14:12 | <TabbyCat> | mwscript updateCollation.php --wiki=frwiktionary --previous-collation=uppercase is being running by zfilipin to finish T169810 | [production] | 
            
  | 14:11 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 14:01 | <dcausse> | elastic@eqiad unbanning elastic1018 & elastic1021 | [production] | 
            
  | 13:49 | <chasemp> | labstore2003:~# umount -fl /srv/backup/tools (for T169774 recovery) | [production] | 
            
  | 13:44 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:363740|Set $wgCategoryCollation to uca-default for fr.wiktionary (T169810)]] (duration: 00m 42s) | [production] | 
            
  | 13:43 | <dcausse> | elastic@eqiad banning elastic1018 & elastic1021 to rebalance heavy shards | [production] | 
            
  | 13:32 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:364131|Add import sources for specieswiki (T170094)]] (duration: 00m 43s) | [production] | 
            
  | 13:29 | <moritzm> | installing graphite2 security updates (image lib) | [production] | 
            
  | 13:28 | <marostegui> | Disable puppet on db1102 to run check_private_data - T153743 | [production] | 
            
  | 13:20 | <zfilipin@tin> | Synchronized wmf-config/CirrusSearch-common.php: SWAT: [[gerrit:364183|[cirrus] Enable the token_count_router only for chinese (T169498)]] (duration: 00m 43s) | [production] | 
            
  | 13:06 | <milimetric@tin> | Finished deploy [analytics/refinery@c22eb93]: Update Sqoop with better parallelism (duration: 02m 54s) | [production] |