| 
      
        2016-10-04
      
      §
     | 
  
    
  | 16:30 | 
  <moritzm> | 
  upgrading labvirt1014 to Linux 4.4 | 
  [production] | 
            
  | 16:30 | 
  <mutante> | 
  authdns commands from T97051#1994679 to add olo.wp for T146612 | 
  [production] | 
            
  | 16:29 | 
  <mutante> | 
  authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones | 
  [production] | 
            
  | 15:18 | 
  <elukey> | 
  adding mw120[45] back to the api live pool after reimage  | 
  [production] | 
            
  | 15:00 | 
  <volans> | 
  created marostegui account into Racktables | 
  [production] | 
            
  | 14:50 | 
  <godog> | 
  eqiad-prod: ms-be1022 to weight 1000 T136631 | 
  [production] | 
            
  | 14:11 | 
  <cmjohnson1> | 
  ms-be1002 replacing failed disk slot 11 | 
  [production] | 
            
  | 14:07 | 
  <cmjohnson1> | 
  db1055 swapped disk 0 | 
  [production] | 
            
  | 13:40 | 
  <hoo> | 
  Updated Wikidata's property suggester with data from Monday's json dump and applied the T132839 workarounds | 
  [production] | 
            
  | 13:33 | 
  <marostegui> | 
  Remove db1019 from prometheus also adding it to spare as it is going to be decommissioned | 
  [production] | 
            
  | 13:33 | 
  <godog> | 
  upgrade grafana to 3.1.1 on labmon1001 - T146354 | 
  [production] | 
            
  | 13:16 | 
  <hashar@tin> | 
  Synchronized rpc/RunJobs.php: trick mw into generating a raw exception report (duration: 00m 47s) | 
  [production] | 
            
  | 13:08 | 
  <elukey> | 
  reimage mw120[45] to Jessie | 
  [production] | 
            
  | 13:04 | 
  <hashar> | 
  Purged namespace 0 pages for arbcom_nlwiki (T147186) via:  mwscript purgeList.php --wiki=arbcom_nlwiki --namespace=0 --verbose | 
  [production] | 
            
  | 13:03 | 
  <hashar@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable subpages for main namespace in arbcom_nlwiki T147186 (duration: 00m 49s) | 
  [production] | 
            
  | 12:56 | 
  <hashar@tin> | 
  Synchronized wmf-config/throttle.php: [throttle] Increase account creation limits for an event in Perpignan on 201  T147293 (duration: 00m 50s) | 
  [production] | 
            
  | 11:14 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Removing db1019 entry as it is going to be decommissioned - T146265 (duration: 00m 51s) | 
  [production] | 
            
  | 11:14 | 
  <elukey> | 
  adding mw120[23] back to the live api servers pool | 
  [production] | 
            
  | 10:23 | 
  <elukey> | 
  installed memcached 1.4.28-1.1+wmf1 on mc2009 as part of a performance test - T129963 | 
  [production] | 
            
  | 10:07 | 
  <elukey> | 
  reimaging mw120[23] to Jessie | 
  [production] | 
            
  | 09:56 | 
  <elukey> | 
  adding mw119[89] to the live api server pool (volans provides magic) | 
  [production] | 
            
  | 09:03 | 
  <hashar> | 
  Regenerating configuration of all Jenkins job due to https://gerrit.wikimedia.org/r/#/c/313306/ | 
  [production] | 
            
  | 08:43 | 
  <elukey> | 
  reimaging mw119[89] to jessie | 
  [production] | 
            
  | 07:09 | 
  <elukey> | 
  rebooting eventlog1001 for kernel upgrades | 
  [production] | 
            
  | 07:04 | 
  <elukey> | 
  executed salt -C 'G@cluster:jobrunner and G@site:eqiad' cmd.run 'find /var/log/hhvm/ -type f -user root -exec chown www-data:www-data {} \;' (also in codfw) to reduce cronspam | 
  [production] | 
            
  | 02:41 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Oct  4 02:41:38 UTC 2016 (duration 4m 55s) | 
  [production] | 
            
  | 02:36 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.20) (duration: 18m 19s) | 
  [production] | 
            
  | 01:09 | 
  <Dereckson> | 
  echo 'https://noc.wikimedia.org/' | mwscript purgeList.php | 
  [production] | 
            
  | 00:26 | 
  <dereckson@tin> | 
  Synchronized docroot/noc/index.html: Remove dead pybal link on noc. ([[Gerrit:313162]]) (duration: 00m 48s) | 
  [production] | 
            
  | 00:08 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.20/extensions/Flow/includes/BoardMover.php: SWAT: [[gerrit:313930|BoardMover: do not try to save a null edit (T138310)]] (duration: 00m 49s) | 
  [production] | 
            
  | 00:04 | 
  <gwicke> | 
  Started run of exportRestrictions script on terbium (T135278); this is running in screen as user gwicke. It is not expected to generate noticeable load. | 
  [production] | 
            
  
    | 
      
        2016-10-03
      
      §
     | 
  
    
  | 23:45 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313869|Enable Wikidata descriptions on Japanese and Spanish Wikipedias (T145786)]] (duration: 00m 49s) | 
  [production] | 
            
  | 23:36 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.20/resources/lib/oojs-ui: SWAT: [[gerrit:313873|Update OOjs UI to v0.17.10]] (duration: 00m 48s) | 
  [production] | 
            
  | 23:34 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.20/vendor: SWAT: [[gerrit:313871|Update OOjs UI to v0.17.10]] (duration: 01m 33s) | 
  [production] | 
            
  | 23:24 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313872|Disable wmgEchoFooterNotice]] (duration: 00m 49s) | 
  [production] | 
            
  | 23:15 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313800|Reduce number of replicas for titlesuggest indices (T147192)]] (duration: 00m 51s) | 
  [production] | 
            
  | 22:26 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1091 with regular weight (duration: 00m 51s) | 
  [production] | 
            
  | 22:08 | 
  <jynus> | 
  running schema change (innodb conversion) on phabricator db hosts T146673 | 
  [production] | 
            
  | 21:54 | 
  <cscott> | 
  OCG deploy temporarily disabled PDF render on en.wiktionary.org to combat DoS. | 
  [production] | 
            
  | 21:50 | 
  <cscott> | 
  updated OCG to version 0bf27e3452dfdc770317f15793e93e6e89c7865a (T147211, T144120) | 
  [production] | 
            
  | 21:50 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1091 with low weight after maintenance (duration: 00m 50s) | 
  [production] | 
            
  | 21:47 | 
  <cscott> | 
  starting OCG deploy | 
  [production] | 
            
  | 21:01 | 
  <jynus> | 
  disabling puppet on labsdb1002 and shutting it down for decommission | 
  [production] | 
            
  | 20:57 | 
  <bearND> | 
  deployed mobileapps 17bc059 | 
  [production] | 
            
  | 20:53 | 
  <bearND> | 
  starting mobileapps deploy | 
  [production] | 
            
  | 20:32 | 
  <yurik> | 
  deployed graphoid update - https://gerrit.wikimedia.org/r/#/c/313887/ | 
  [production] | 
            
  | 20:28 | 
  <yurik> | 
  about to deploy graphoid update - https://gerrit.wikimedia.org/r/#/c/313887/ | 
  [production] | 
            
  | 20:11 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 48s) | 
  [production] | 
            
  | 19:48 | 
  <cscott> | 
  cleared OCG queue again, while I work on a blacklist patch for the OCG frontend | 
  [production] | 
            
  | 19:33 | 
  <ejegg> | 
  updated payments-wiki settings | 
  [production] |