| 
      
        2017-06-19
      
      §
     | 
  
    
  | 22:30 | 
  <andrewbogott> | 
  find /srv/carbon/whisper/archived_metrics -mtime +730 -type f -delete on labmon1001 | 
  [production] | 
            
  | 22:14 | 
  <thcipriani|afk> | 
  Added non-voting operations-puppet-tests-docker job for operations/puppet repo, should (hopefully) be fast, and will timeout after 1 minute if it's not. More info https://gerrit.wikimedia.org/r/#/c/360091/ + T166888 | 
  [production] | 
            
  | 21:42 | 
  <ejegg|afk> | 
  updated payments-wiki from 7a5054238169834da0336e805946c7ed73f4795b to 8bdd7061a3ceb46969050c15e723b4638e762a59 | 
  [production] | 
            
  | 19:39 | 
  <mepps> | 
  correction: updated civicrm from dfc26f058327bb6248af44ad39a9864b6c3a6581 to d558df2ca2a0218a5e4bb6e03105a14cec3f0b6d | 
  [production] | 
            
  | 19:28 | 
  <mepps> | 
  updated   from dfc26f058327bb6248af44ad39a9864b6c3a6581 to d558df2ca2a0218a5e4bb6e03105a14cec3f0b6d | 
  [production] | 
            
  | 18:35 | 
  <reedy@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:34 | 
  <reedy@tin> | 
  Synchronized wmf-config/CommonSettings.php: (no justification provided) (duration: 00m 42s) | 
  [production] | 
            
  | 18:29 | 
  <reedy@tin> | 
  Synchronized wmf-config/abusefilter.php: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:21 | 
  <reedy@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: logos (duration: 00m 41s) | 
  [production] | 
            
  | 18:20 | 
  <reedy@tin> | 
  Synchronized static/favicon/wmf.ico: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:19 | 
  <reedy@tin> | 
  Synchronized wmf-config/flaggedrevs.php: Remove old setting that does nothing (duration: 00m 41s) | 
  [production] | 
            
  | 18:18 | 
  <reedy@tin> | 
  Synchronized static/images: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:10 | 
  <reedy@tin> | 
  Synchronized dblists/securepollglobal.dblist: (no justification provided) (duration: 00m 41s) | 
  [production] | 
            
  | 18:02 | 
  <reedy@tin> | 
  Synchronized wmf-config/InterwikiSortOrders.php: Add atjwiki (duration: 00m 41s) | 
  [production] | 
            
  | 17:42 | 
  <ejegg> | 
  updated fundraising tools from 585f546aa0c092ccd938a9a01b4bc3eb7662804d to 457bddb843f69867f24cd072ede1f6733d59c853 | 
  [production] | 
            
  | 17:21 | 
  <moritzm> | 
  installing exim4 security updates | 
  [production] | 
            
  | 15:48 | 
  <moritzm> | 
  uploaded linux-meta_1.13 to apt.wikimedia.org (with this update the linux-meta package now also defaults to 4.9 (previously 4.4)) | 
  [production] | 
            
  | 15:47 | 
  <moritzm> | 
  uploaded linux_4.9.25-1~bpo8+3 to apt.wikimedia.org | 
  [production] | 
            
  | 15:25 | 
  <volans> | 
  installed python-setuptools-scm on copper | 
  [production] | 
            
  | 15:16 | 
  <marostegui> | 
  Deploy alter table labsdb1009 - T166207 | 
  [production] | 
            
  | 15:12 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=chlorine.eqiad.wmnet | 
  [production] | 
            
  | 15:03 | 
  <mobrovac> | 
  restbase restbase2001 is out of rotation, performing experiments with the new cassandra driver v3.2.2 which seems to be causing problems only in production | 
  [production] | 
            
  | 14:59 | 
  <godog> | 
  cold reset ms-be1013 drac | 
  [production] | 
            
  | 14:53 | 
  <gehel> | 
  pausing cluster restart of elasticsearch eqiad | 
  [production] | 
            
  | 14:24 | 
  <godog> | 
  roll-upgrade swift to 2.10 on ms-be10[22-30] - T162609 | 
  [production] | 
            
  | 14:08 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1070 - T153743 (duration: 00m 41s) | 
  [production] | 
            
  | 14:06 | 
  <gehel> | 
  starting cluster restart on elasticsearch / cirrus / eqiad for ltr plugin deployment | 
  [production] | 
            
  | 14:01 | 
  <gehel> | 
  restarting elasticsearch / relforge for ltr plugin deployment | 
  [production] | 
            
  | 13:58 | 
  <gehel> | 
  remove decommissioned nodes from redis / trebuchet for elasticsearch/plugins | 
  [production] | 
            
  | 13:48 | 
  <gehel> | 
  deploying latest elasticsearch plugin (ltr plugin) | 
  [production] | 
            
  | 13:48 | 
  <moritzm> | 
  fixing salt minion setup on wtp1047 | 
  [production] | 
            
  | 13:44 | 
  <hashar> | 
  European SWAT completed | 
  [production] | 
            
  | 13:44 | 
  <aude@tin> | 
  Synchronized wmf-config/Wikibase.php: Remove old constraints section config (duration: 00m 41s) | 
  [production] | 
            
  | 13:42 | 
  <aude@tin> | 
  Synchronized wmf-config/Wikibase-production.php: Add constraints section to property pages on test.wikidata (duration: 00m 41s) | 
  [production] | 
            
  | 13:29 | 
  <dcausse@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: [cleanup] remove old interwiki search config (duration: 00m 41s) | 
  [production] | 
            
  | 13:28 | 
  <dcausse@tin> | 
  Synchronized wmf-config/CirrusSearch-labs.php: [cleanup] remove old interwiki search config (duration: 00m 41s) | 
  [production] | 
            
  | 13:21 | 
  <hashar@tin> | 
  Synchronized wmf-config/InitialiseSettings.php:  Enable OOjs UI buttons on EditPage for plwiki - T162849 (duration: 00m 42s) | 
  [production] | 
            
  | 13:08 | 
  <hashar@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add sandbox link for dtywiki - T168038 (duration: 00m 42s) | 
  [production] | 
            
  | 12:54 | 
  <dcausse> | 
  restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin | 
  [production] | 
            
  | 12:36 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=chlorine.eqiad.wmnet | 
  [production] | 
            
  | 12:04 | 
  <elukey> | 
  run 'echo "autoLearnMode=1" > /tmp/disable_learn && megacli -AdpBbuCmd -SetBbuProperties -f /tmp/disable_learn -a0' on all the analytics workers to disable BBU Auto learn - T167809 | 
  [production] | 
            
  | 11:33 | 
  <marostegui> | 
  Rename user Smuconlaw → Sgconlaw - T168109 | 
  [production] | 
            
  | 11:31 | 
  <jynus> | 
  restarting replication on dbstore1002:s3 and db1015 | 
  [production] | 
            
  | 11:19 | 
  <moritzm> | 
  rebooting cp3007 for kernel update | 
  [production] | 
            
  | 11:01 | 
  <_joe_> | 
  depooling mw1170-mw1179 for decommissioning, T168271 | 
  [production] | 
            
  | 10:15 | 
  <godog> | 
  roll-upgrade swift to 2.10 on to ms-fe1* - T162609 | 
  [production] | 
            
  | 09:56 | 
  <akosiaris> | 
  migrate neon.eqiad.wmnet to ganeti01.svc.eqiad.wmnet's row_A  nodegroup | 
  [production] | 
            
  | 09:55 | 
  <dcausse> | 
  restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin | 
  [production] | 
            
  | 09:33 | 
  <jynus> | 
  temporarily stop dbstore1002:s3 and db1015 to fix srwiki | 
  [production] | 
            
  | 09:30 | 
  <marostegui> | 
  Deploy alter table on s2 - dbstore1001 - T166205 | 
  [production] |