| 2016-10-25
      
      § | 
    
  | 19:03 | <ebernhardson@mira> | Synchronized php-1.28.0-wmf.22/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: (no message) (duration: 00m 47s) | [production] | 
            
  | 16:08 | <gehel> | restarting ferm on elastic2020 | [production] | 
            
  | 16:04 | <gehel> | delete dangling indices on elasticsearch codfw: jawiki_general_first, jawiki_content_first, zhwiki_general_first and zhwiki_content_first | [production] | 
            
  | 15:21 | <ori> | Synchronized wmf-config/throttle.php: I049bd463: Use correct IP for Vanderbilt 2016-10-25 edit-a-thon throttle exception (T149063) (duration: 01m 20s) | [production] | 
            
  | 14:32 | <gehel> | reboot of wdqs cluster eqiad for kernel upgrade | [production] | 
            
  | 14:24 | <moritzm> | rebooting maerlant for kernel update | [production] | 
            
  | 14:20 | <gehel> | reboot of wdqs cluster codfw for kernel upgrade | [production] | 
            
  | 14:14 | <elukey> | removed logstash filter for Apache (https://logstash.wikimedia.org/app/kibana#/dashboard/apache2log) - T144005 | [production] | 
            
  | 14:01 | <_joe_> | refreshing puppet facts | [production] | 
            
  | 13:34 | <moritzm> | rebooting rcstream servers for kernel update | [production] | 
            
  | 13:11 | <moritzm> | rebooting etcd1006 for kernel update | [production] | 
            
  | 13:07 | <hashar> | European SWAT complete | [production] | 
            
  | 13:06 | <hashar@mira> | Synchronized wmf-config/throttle.php: Nashville Architecture edit-a-thon (Vanderbilt library) throttle rule - T149063 (duration: 02m 07s) | [production] | 
            
  | 13:03 | <moritzm> | rebooting etcd1005 for kernel update | [production] | 
            
  | 12:57 | <moritzm> | rebooting etcd1004 for kernel update | [production] | 
            
  | 12:54 | <moritzm> | repooled maerlant (was depooled for some reason, possibly forgotten to repool after maintenance) | [production] | 
            
  | 12:50 | <moritzm> | rebooting etcd1003 for kernel update | [production] | 
            
  | 12:42 | <moritzm> | rebooting etcd1002 for kernel update | [production] | 
            
  | 12:30 | <moritzm> | rebooting etcd1001 for kernel update | [production] | 
            
  | 12:24 | <elukey> | rebooting druid100[123] for kernel upgrades | [production] | 
            
  | 11:56 | <moritzm> | rebooting hydrogen for kernel update | [production] | 
            
  | 11:53 | <dcausse> | elastic@eqiad reindexing top10 wikis with BM25 from terbium T147508 (logs in ~dcausse/bm25_reindex/cirrus_log) | [production] | 
            
  | 11:53 | <moritzm> | rolling reboot of mc2* for kernel update | [production] | 
            
  | 11:31 | <moritzm> | rebooting copper for kernel update | [production] | 
            
  | 11:16 | <moritzm> | bounced ntp on hassium (stuck in XFAC state) | [production] | 
            
  | 11:14 | <marostegui@mira> | Synchronized wmf-config/db-eqiad.php: Repool db1059 - T146261 (duration: 01m 22s) | [production] | 
            
  | 10:37 | <moritzm> | rebooting acamar for kernel update | [production] | 
            
  | 10:11 | <elukey> | reimaging mc103[1-6] to Jessie | [production] | 
            
  | 10:09 | <marostegui@mira> | Synchronized wmf-config/db-eqiad.php: Depool db1059 to clone another host from it - T146261 (duration: 01m 36s) | [production] | 
            
  | 09:58 | <moritzm> | rearmed keyholder on tin | [production] | 
            
  | 09:50 | <moritzm> | rebooting tin for kernel update | [production] | 
            
  | 09:45 | <moritzm> | rebooting achernar for kernel update | [production] | 
            
  | 09:43 | <marostegui> | Deploying ALTER table s4 commonswiki.templatelinks - T149079 (db2058 only) | [production] | 
            
  | 09:22 | <moritzm> | rebooting hassium for kernel update | [production] | 
            
  | 09:09 | <moritzm> | rebooting hassaleh for kernel update | [production] | 
            
  | 08:48 | <marostegui> | Stopping replication db2058 s4 - using it to clone another host -  T146261 | [production] | 
            
  | 08:13 | <akosiaris> | reimaging tegmen | [production] | 
            
  | 08:05 | <dcausse> | elastic@codfw reindexing jawiki, thwiki and zhwiki T147498 (logs in terbium:~dcausse/bm25_reindex/cirrus_log) | [production] | 
            
  | 08:05 | <moritzm> | rebooting chromium for kernel update | [production] | 
            
  | 07:40 | <moritzm> | rebooting netmon1001 for kernel update | [production] | 
            
  | 07:06 | <moritzm> | rebooting tungsten for kernel update | [production] | 
            
  | 07:05 | <gehel> | rebooting elasticsearch relforge cluster for kernel update | [production] | 
            
  | 06:56 | <moritzm> | rebooting wezen for kernel update | [production] | 
            
  | 06:52 | <gehel> | rebooting elastic1035 for kernel update | [production] | 
            
  | 06:51 | <moritzm> | rebooting osmium for kernel update | [production] | 
            
  | 02:39 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Oct 25 02:39:53 UTC 2016 (duration 5m 12s) | [production] | 
            
  | 02:34 | <l10nupdate@tin> | scap sync-l10n completed (1.28.0-wmf.22) (duration: 10m 46s) | [production] | 
            
  | 02:33 | <ori@mira> | Synchronized php-1.28.0-wmf.22/resources/src/mediawiki/mediawiki.js: I1d61f4dcf: mw.loader: Fix off-by-one error in splitModuleKey() (duration: 02m 15s) | [production] |