| 2016-10-04
      
      § | 
    
  | 16:30 | <mutante> | authdns commands from T97051#1994679 to add olo.wp for T146612 | [production] | 
            
  | 16:29 | <mutante> | authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones | [production] | 
            
  | 15:18 | <elukey> | adding mw120[45] back to the api live pool after reimage | [production] | 
            
  | 15:00 | <volans> | created marostegui account into Racktables | [production] | 
            
  | 14:50 | <godog> | eqiad-prod: ms-be1022 to weight 1000 T136631 | [production] | 
            
  | 14:11 | <cmjohnson1> | ms-be1002 replacing failed disk slot 11 | [production] | 
            
  | 14:07 | <cmjohnson1> | db1055 swapped disk 0 | [production] | 
            
  | 13:40 | <hoo> | Updated Wikidata's property suggester with data from Monday's json dump and applied the T132839 workarounds | [production] | 
            
  | 13:33 | <marostegui> | Remove db1019 from prometheus also adding it to spare as it is going to be decommissioned | [production] | 
            
  | 13:33 | <godog> | upgrade grafana to 3.1.1 on labmon1001 - T146354 | [production] | 
            
  | 13:16 | <hashar@tin> | Synchronized rpc/RunJobs.php: trick mw into generating a raw exception report (duration: 00m 47s) | [production] | 
            
  | 13:08 | <elukey> | reimage mw120[45] to Jessie | [production] | 
            
  | 13:04 | <hashar> | Purged namespace 0 pages for arbcom_nlwiki (T147186) via:  mwscript purgeList.php --wiki=arbcom_nlwiki --namespace=0 --verbose | [production] | 
            
  | 13:03 | <hashar@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable subpages for main namespace in arbcom_nlwiki T147186 (duration: 00m 49s) | [production] | 
            
  | 12:56 | <hashar@tin> | Synchronized wmf-config/throttle.php: [throttle] Increase account creation limits for an event in Perpignan on 201  T147293 (duration: 00m 50s) | [production] | 
            
  | 11:14 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Removing db1019 entry as it is going to be decommissioned - T146265 (duration: 00m 51s) | [production] | 
            
  | 11:14 | <elukey> | adding mw120[23] back to the live api servers pool | [production] | 
            
  | 10:23 | <elukey> | installed memcached 1.4.28-1.1+wmf1 on mc2009 as part of a performance test - T129963 | [production] | 
            
  | 10:07 | <elukey> | reimaging mw120[23] to Jessie | [production] | 
            
  | 09:56 | <elukey> | adding mw119[89] to the live api server pool (volans provides magic) | [production] | 
            
  | 09:03 | <hashar> | Regenerating configuration of all Jenkins job due to https://gerrit.wikimedia.org/r/#/c/313306/ | [production] | 
            
  | 08:43 | <elukey> | reimaging mw119[89] to jessie | [production] | 
            
  | 07:09 | <elukey> | rebooting eventlog1001 for kernel upgrades | [production] | 
            
  | 07:04 | <elukey> | executed salt -C 'G@cluster:jobrunner and G@site:eqiad' cmd.run 'find /var/log/hhvm/ -type f -user root -exec chown www-data:www-data {} \;' (also in codfw) to reduce cronspam | [production] | 
            
  | 02:41 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Oct  4 02:41:38 UTC 2016 (duration 4m 55s) | [production] | 
            
  | 02:36 | <mwdeploy@tin> | scap sync-l10n completed (1.28.0-wmf.20) (duration: 18m 19s) | [production] | 
            
  | 01:09 | <Dereckson> | echo 'https://noc.wikimedia.org/' | mwscript purgeList.php | [production] | 
            
  | 00:26 | <dereckson@tin> | Synchronized docroot/noc/index.html: Remove dead pybal link on noc. ([[Gerrit:313162]]) (duration: 00m 48s) | [production] | 
            
  | 00:08 | <thcipriani@tin> | Synchronized php-1.28.0-wmf.20/extensions/Flow/includes/BoardMover.php: SWAT: [[gerrit:313930|BoardMover: do not try to save a null edit (T138310)]] (duration: 00m 49s) | [production] | 
            
  | 00:04 | <gwicke> | Started run of exportRestrictions script on terbium (T135278); this is running in screen as user gwicke. It is not expected to generate noticeable load. | [production] | 
            
  
    | 2016-10-03
      
      § | 
    
  | 23:45 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313869|Enable Wikidata descriptions on Japanese and Spanish Wikipedias (T145786)]] (duration: 00m 49s) | [production] | 
            
  | 23:36 | <thcipriani@tin> | Synchronized php-1.28.0-wmf.20/resources/lib/oojs-ui: SWAT: [[gerrit:313873|Update OOjs UI to v0.17.10]] (duration: 00m 48s) | [production] | 
            
  | 23:34 | <thcipriani@tin> | Synchronized php-1.28.0-wmf.20/vendor: SWAT: [[gerrit:313871|Update OOjs UI to v0.17.10]] (duration: 01m 33s) | [production] | 
            
  | 23:24 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313872|Disable wmgEchoFooterNotice]] (duration: 00m 49s) | [production] | 
            
  | 23:15 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:313800|Reduce number of replicas for titlesuggest indices (T147192)]] (duration: 00m 51s) | [production] | 
            
  | 22:26 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1091 with regular weight (duration: 00m 51s) | [production] | 
            
  | 22:08 | <jynus> | running schema change (innodb conversion) on phabricator db hosts T146673 | [production] | 
            
  | 21:54 | <cscott> | OCG deploy temporarily disabled PDF render on en.wiktionary.org to combat DoS. | [production] | 
            
  | 21:50 | <cscott> | updated OCG to version 0bf27e3452dfdc770317f15793e93e6e89c7865a (T147211, T144120) | [production] | 
            
  | 21:50 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1091 with low weight after maintenance (duration: 00m 50s) | [production] | 
            
  | 21:47 | <cscott> | starting OCG deploy | [production] | 
            
  | 21:01 | <jynus> | disabling puppet on labsdb1002 and shutting it down for decommission | [production] | 
            
  | 20:57 | <bearND> | deployed mobileapps 17bc059 | [production] | 
            
  | 20:53 | <bearND> | starting mobileapps deploy | [production] | 
            
  | 20:32 | <yurik> | deployed graphoid update - https://gerrit.wikimedia.org/r/#/c/313887/ | [production] | 
            
  | 20:28 | <yurik> | about to deploy graphoid update - https://gerrit.wikimedia.org/r/#/c/313887/ | [production] | 
            
  | 20:11 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 48s) | [production] | 
            
  | 19:48 | <cscott> | cleared OCG queue again, while I work on a blacklist patch for the OCG frontend | [production] | 
            
  | 19:33 | <ejegg> | updated payments-wiki settings | [production] | 
            
  | 19:28 | <XenoRyet> | updated payments-wiki from cc27f83f31ecc609d4400050e73905b7364f1d42 to e6027d57b021509d4dd3668aa3b67c10b3a4e246 | [production] |