| 
      
        2017-06-20
      
      §
     | 
  
    
  | 11:36 | 
  <moritzm> | 
  installing libgcrypt security updates | 
  [production] | 
            
  | 11:29 | 
  <moritzm> | 
  rebooting mediawiki app servers in codfw for kernel update | 
  [production] | 
            
  | 11:13 | 
  <akosiaris> | 
  renumber sca1004, mwdebug1002. Downtime should be a few minutes | 
  [production] | 
            
  | 11:08 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=mwdebug1002.eqiad.wmnet | 
  [production] | 
            
  | 10:56 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=sca1004.eqiad.wmnet | 
  [production] | 
            
  | 10:07 | 
  <moritzm> | 
  rebooting mwdebug servers for kernel update | 
  [production] | 
            
  | 10:03 | 
  <elukey> | 
  reboot kafka1012, analytics1028, aqs1004 for kernel upgrades (canary hosts) | 
  [production] | 
            
  | 10:00 | 
  <godog> | 
  reimage ms-be1016 with stretch | 
  [production] | 
            
  | 09:53 | 
  <godog> | 
  reset ms-be1014 idrac via ipmitool | 
  [production] | 
            
  | 09:46 | 
  <moritzm> | 
  rebooting app server canaries for kernel update | 
  [production] | 
            
  | 09:40 | 
  <godog> | 
  roll-restart thumbor to increase swift timeout | 
  [production] | 
            
  | 09:29 | 
  <marostegui> | 
  Rename table on db1089 enwiki.wikilove_image_log - T127219 | 
  [production] | 
            
  | 08:46 | 
  <marostegui> | 
  Drop table titlekey from s1 - T164949 | 
  [production] | 
            
  | 08:35 | 
  <godog> | 
  roll restart swift-proxy on ms-fe* to pick up thumbor changes | 
  [production] | 
            
  | 08:30 | 
  <_joe_> | 
  restarting gerrit T168360 | 
  [production] | 
            
  | 08:25 | 
  <_joe_> | 
  manually patching gerrit's systemd unit file to allow more open files | 
  [production] | 
            
  | 08:22 | 
  <marostegui> | 
  Drop table titlekey from s3 - T164949 | 
  [production] | 
            
  | 08:15 | 
  <marostegui> | 
  Drop table titlekey from s4 - T164949 | 
  [production] | 
            
  | 08:06 | 
  <marostegui> | 
  Drop table titlekey from s7 - https://phabricator.wikimedia.org/T164949 | 
  [production] | 
            
  | 07:45 | 
  <marostegui> | 
  Drop table titlekey from s5 - T164949 | 
  [production] | 
            
  | 07:35 | 
  <gehel> | 
  restarting elastic1017 to validate upgrades | 
  [production] | 
            
  | 07:27 | 
  <marostegui> | 
  kill alter table on enwiki.revision db1047 after running for 13 days - T166452 | 
  [production] | 
            
  | 07:23 | 
  <moritzm> | 
  installing glibc security updates | 
  [production] | 
            
  | 07:22 | 
  <marostegui> | 
  Stop MySQL dbstore2001 for maintenance - T168354 | 
  [production] | 
            
  | 07:20 | 
  <marostegui> | 
  Deploy alter table s5 - db1071 - T166207 | 
  [production] | 
            
  | 07:10 | 
  <marostegui> | 
  Deploy alter table s5 - db1095 - T166207 | 
  [production] | 
            
  | 06:57 | 
  <moritzm> | 
  install remaining exim security updates | 
  [production] | 
            
  
    | 
      
        2017-06-19
      
      §
     | 
  
    
  | 23:38 | 
  <andrewbogott> | 
  are we logging? | 
  [production] | 
            
  | 23:35 | 
  <legoktm> | 
  legoktm@tin: Synchronized static/images/project-logos/: Upload logos for the Dinka Wikipedia (duration: 00m 42s) | 
  [production] | 
            
  | 22:45 | 
  <andrewbogott> | 
  removed some big dirs from /home/ori on install1002 | 
  [production] | 
            
  | 22:30 | 
  <andrewbogott> | 
  find /srv/carbon/whisper/archived_metrics -mtime +730 -type f -delete on labmon1001 | 
  [production] | 
            
  | 22:14 | 
  <thcipriani|afk> | 
  Added non-voting operations-puppet-tests-docker job for operations/puppet repo, should (hopefully) be fast, and will timeout after 1 minute if it's not. More info https://gerrit.wikimedia.org/r/#/c/360091/ + T166888 | 
  [production] | 
            
  | 21:42 | 
  <ejegg|afk> | 
  updated payments-wiki from 7a5054238169834da0336e805946c7ed73f4795b to 8bdd7061a3ceb46969050c15e723b4638e762a59 | 
  [production] | 
            
  | 19:39 | 
  <mepps> | 
  correction: updated civicrm from dfc26f058327bb6248af44ad39a9864b6c3a6581 to d558df2ca2a0218a5e4bb6e03105a14cec3f0b6d | 
  [production] | 
            
  | 19:28 | 
  <mepps> | 
  updated   from dfc26f058327bb6248af44ad39a9864b6c3a6581 to d558df2ca2a0218a5e4bb6e03105a14cec3f0b6d | 
  [production] | 
            
  | 18:35 | 
  <reedy@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:34 | 
  <reedy@tin> | 
  Synchronized wmf-config/CommonSettings.php: (no justification provided) (duration: 00m 42s) | 
  [production] | 
            
  | 18:29 | 
  <reedy@tin> | 
  Synchronized wmf-config/abusefilter.php: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:21 | 
  <reedy@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: logos (duration: 00m 41s) | 
  [production] | 
            
  | 18:20 | 
  <reedy@tin> | 
  Synchronized static/favicon/wmf.ico: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:19 | 
  <reedy@tin> | 
  Synchronized wmf-config/flaggedrevs.php: Remove old setting that does nothing (duration: 00m 41s) | 
  [production] | 
            
  | 18:18 | 
  <reedy@tin> | 
  Synchronized static/images: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:10 | 
  <reedy@tin> | 
  Synchronized dblists/securepollglobal.dblist: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:02 | 
  <reedy@tin> | 
  Synchronized wmf-config/InterwikiSortOrders.php: Add atjwiki (duration: 00m 41s) | 
  [production] | 
            
  | 17:42 | 
  <ejegg> | 
  updated fundraising tools from 585f546aa0c092ccd938a9a01b4bc3eb7662804d to 457bddb843f69867f24cd072ede1f6733d59c853 | 
  [production] | 
            
  | 17:21 | 
  <moritzm> | 
  installing exim4 security updates | 
  [production] | 
            
  | 15:48 | 
  <moritzm> | 
  uploaded linux-meta_1.13 to apt.wikimedia.org (with this update the linux-meta package now also defaults to 4.9 (previously 4.4)) | 
  [production] | 
            
  | 15:47 | 
  <moritzm> | 
  uploaded linux_4.9.25-1~bpo8+3 to apt.wikimedia.org | 
  [production] | 
            
  | 15:25 | 
  <volans> | 
  installed python-setuptools-scm on copper | 
  [production] | 
            
  | 15:16 | 
  <marostegui> | 
  Deploy alter table labsdb1009 - T166207 | 
  [production] |