| 2017-08-21
      
      § | 
    
  | 09:40 | <jynus> | restart dbstore2001 mariadb@x1 | [production] | 
            
  | 09:29 | <moritzm> | upgrading hhvm-luasandbox on mw1262-1265 | [production] | 
            
  | 09:17 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Remove db1015 - T173570 (duration: 00m 44s) | [production] | 
            
  | 09:15 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Remove db1015 - T173570 (duration: 00m 44s) | [production] | 
            
  | 09:01 | <moritzm> | upgrading hhvm-luasandbox on mw1261 | [production] | 
            
  | 08:08 | <marostegui> | Rename tables article_assessment, article_assessment_pages, article_assessment_ratings tables from testwiki on db1078 - T173590 | [production] | 
            
  | 07:42 | <marostegui> | Drop cx_drafts table from x1 - T172364 | [production] | 
            
  | 07:13 | <marostegui> | Stop s4 replication thread on db1095 - T172996 | [production] | 
            
  | 07:09 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2047 (duration: 00m 45s) | [production] | 
            
  | 02:36 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Mon Aug 21 02:36:58 UTC 2017 (duration 7m 3s) | [production] | 
            
  | 02:29 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.14) (duration: 08m 57s) | [production] | 
            
  
    | 2017-08-18
      
      § | 
    
  | 21:05 | <mutante> | gerrit2001 - restarted gerrit again after reverting gerrit:372426, using systemctl commands, not 'service' or init.d | [production] | 
            
  | 20:55 | <mutante> | restarting gerrit on gerrit2001 | [production] | 
            
  | 20:48 | <demon@tin> | Synchronized scap/plugins/clean.py: Completeness (duration: 00m 44s) | [production] | 
            
  | 20:43 | <RainbowSprinkles> | prior thing was a no-op, testing | [production] | 
            
  | 20:42 | <demon@tin> | Pruned MediaWiki: 1.30.0-wmf.9 [keeping static files] (duration: 01m 43s) | [production] | 
            
  | 19:03 | <bblack> | cp1074 - varnish backend restart (mailbox lag) | [production] | 
            
  | 19:01 | <bblack> | reboot cp4021-8 | [production] | 
            
  | 18:21 | <bblack> | puppeting cp4021-8 - expect possibility of ipsec alerts, etc... | [production] | 
            
  | 13:32 | <Amir1> | another run of /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=item --from-id $(tail -100 /tmp/rebuildTermSqlIndex.log | grep -E "Processed up to page (\d+?)" | sed -E "s/Processed up to page //; s/ \(Q.+?//" | tail -1) >>/tmp/rebuildTermSqlIndex.log 2>&1 | [production] | 
            
  | 13:26 | <Amir1> | ladsgroup@terbium:~$ mwscript namespaceDupes.php --wiki=hiwikiversity (T172977) | [production] | 
            
  | 12:44 | <Amir1> | start of ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=item | [production] | 
            
  | 11:36 | <jynus> | change topology of dbstore2001:x1 and dbstore2002:x1 | [production] | 
            
  | 11:00 | <elukey> | reboot dbstore1002 for kernel updates | [production] | 
            
  | 10:34 | <elukey> | restart mysql on dbstore1002 - attempt to reclaim space after big table drop (stop slaves and el_sync, check running queries, stop mysql, check process, start mysql) | [production] | 
            
  | 09:55 | <Amir1> | one small pass of ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=entity (T171460) | [production] | 
            
  | 09:46 | <Amir1> | ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=property (T171460) | [production] | 
            
  | 09:42 | <moritzm> | installing libmspack security updates | [production] | 
            
  | 09:16 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2077 - T168409 (duration: 00m 44s) | [production] | 
            
  | 07:28 | <marostegui> | Stop MySQL on db2077 to copy it to dbstore2001 - T168409 | [production] | 
            
  | 07:26 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Deoool db2077 - T168409 (duration: 00m 44s) | [production] | 
            
  | 07:20 | <moritzm> | installing openjdk-7 security updates on trusty | [production] | 
            
  | 06:58 | <jynus> | and nginx | [production] | 
            
  | 06:55 | <jynus> | systemctl restart squid3.service on install2002, apt seem stuck on some servers | [production] | 
            
  | 06:24 | <jynus> | stopping and upgrading db2033 | [production] | 
            
  | 05:43 | <jynus> | upgrading and restarting all mariadb instances on dbstore2002 | [production] | 
            
  | 01:27 | <ejegg|afk> | updated fundraising dash from 696a3fffdd2595331132da9b999c6dc382d0ed69 to 7dfc9691492561b63ff91888b827ad496431d150 | [production] | 
            
  | 00:48 | <ebernhardson@tin> | Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171213: Increase sampling rate of cirrus satisfaction schema (again) to 1k per bucket per day (duration: 00m 44s) | [production] | 
            
  | 00:18 | <ebernhardson@tin> | Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171213: Increase sampling rate of cirrus satisfaction schema (duration: 00m 44s) | [production] | 
            
  
    | 2017-08-17
      
      § | 
    
  | 23:31 | <thcipriani@tin> | Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:372476|Revert "Disable cirrus MLR ab test"]] (duration: 00m 44s) | [production] | 
            
  | 23:21 | <thcipriani@tin> | Synchronized php-1.30.0-wmf.14/resources/src/mediawiki.rcfilters/dm/mw.rcfilters.dm.FilterGroup.js: SWAT: [[gerrit:372449|RCFilters: Fix validation for single_option groups]] T173303 (duration: 00m 44s) | [production] | 
            
  | 23:14 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:372446|Reapply "Remove temporary wgStructuredChangeFiltersEnableExperimentalViews setting"]] (duration: 00m 45s) | [production] | 
            
  | 22:10 | <ppchelko@tin> | Finished deploy [changeprop/deploy@2c553a6]: Lower the concurrecy for transcludes to decrease cassandra load during cluster reshaping (duration: 01m 14s) | [production] | 
            
  | 22:09 | <thcipriani@tin> | Synchronized php-1.30.0-wmf.14/includes/specials/SpecialNewpages.php: [[gerrit:372465|Restore the newFromId() approach in SpecialNewpages::feedItemDesc]] T173541 (duration: 00m 46s) | [production] | 
            
  | 22:09 | <ppchelko@tin> | Started deploy [changeprop/deploy@2c553a6]: Lower the concurrecy for transcludes to decrease cassandra load during cluster reshaping | [production] | 
            
  | 22:07 | <gwicke> | restarting pdfrender on scb100* nodes | [production] |