| 
      
        2017-05-22
      
      §
     | 
  
    
  | 07:07 | 
  <marostegui> | 
  Run CleanDuplicateScores script to clean up possible duplicates on wikidatawiki before starting to create the UNIQUE keys - T164530 | 
  [production] | 
            
  | 06:56 | 
  <marostegui> | 
  Deploy alter table s7.frwiktionary on dbstore1001 - https://phabricator.wikimedia.org/T165743 | 
  [production] | 
            
  | 06:53 | 
  <marostegui> | 
  Deploy alter table s7.frwiktionary on db2029 (codfw master) - https://phabricator.wikimedia.org/T165743 | 
  [production] | 
            
  | 06:47 | 
  <marostegui> | 
  Deploy alter table on db2035 and db1036 for s2. bgwiktionary,eowiki, idwiki - T162611 | 
  [production] | 
            
  | 06:47 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2035 - T162611 (duration: 00m 38s) | 
  [production] | 
            
  | 06:37 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1036 - T162611 (duration: 00m 39s) | 
  [production] | 
            
  | 06:02 | 
  <smalyshev@tin> | 
  Finished deploy [wdqs/wdqs@e4301da]: Redeploy GUI due to breakage in T165228 (duration: 01m 50s) | 
  [production] | 
            
  | 06:00 | 
  <smalyshev@tin> | 
  Started deploy [wdqs/wdqs@e4301da]: Redeploy GUI due to breakage in T165228 | 
  [production] | 
            
  | 02:26 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Mon May 22 02:26:59 UTC 2017 (duration 6m 0s) | 
  [production] | 
            
  | 02:20 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.1) (duration: 07m 18s) | 
  [production] | 
            
  
    | 
      
        2017-05-20
      
      §
     | 
  
    
  | 21:54 | 
  <Dereckson> | 
  Run namespaceDupe on fr.wikisource and en.wikisource | 
  [production] | 
            
  | 17:29 | 
  <addshore> | 
  addshore@terbium:/srv/mediawiki/php-1.30.0-wmf.1$ mwscriptwikiset extensions/Cognate/maintenance/purgeDeletedCognatePages.php wiktionary.dblist --batch-size=1000 >> ~/purge.201705161230.log T164407 | 
  [production] | 
            
  | 17:29 | 
  <addshore> | 
  addshore@terbium:/srv/mediawiki/php-1.30.0-wmf.1$ mwscriptwikiset extensions/Cognate/maintenance/purgeDeletedCognatePages.php wiktionary.dblist --batch-size=1000 >> ~/purge.201705161230.log | 
  [production] | 
            
  | 09:08 | 
  <thcipriani> | 
  restarting jenkins on contint1001 | 
  [production] | 
            
  | 08:24 | 
  <smalyshev@tin> | 
  Finished deploy [wdqs/wdqs@227ab25]: Whitelist update (duration: 02m 32s) | 
  [production] | 
            
  | 08:22 | 
  <smalyshev@tin> | 
  Started deploy [wdqs/wdqs@227ab25]: Whitelist update | 
  [production] | 
            
  | 07:52 | 
  <gehel> | 
  restart wdqs-updater on all wdqs clusters (stuck on too large update) | 
  [production] | 
            
  | 02:29 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Sat May 20 02:29:14 UTC 2017 (duration 6m 13s) | 
  [production] | 
            
  | 02:23 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.1) (duration: 07m 17s) | 
  [production] | 
            
  
    | 
      
        2017-05-19
      
      §
     | 
  
    
  | 16:44 | 
  <reedy@tin> | 
  Synchronized wmf-config/throttle.php: Wikimedia Vienna Hackathon (duration: 00m 39s) | 
  [production] | 
            
  | 15:40 | 
  <mutante> | 
  planet10001 - manually deleting cron job for deleted sr.planet (should puppetize the "absence" too) | 
  [production] | 
            
  | 13:58 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2047 - T165743 (duration: 00m 38s) | 
  [production] | 
            
  | 13:47 | 
  <marostegui> | 
  Deploy alter table s7.frwiktionary db1033 - T165743 | 
  [production] | 
            
  | 13:31 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2047 - T165743 (duration: 00m 39s) | 
  [production] | 
            
  | 13:09 | 
  <moritzm> | 
  downgraded mw1161 to HHVM 3.12 (crashes often compared to app servers, downgrade over the weekend) | 
  [production] | 
            
  | 12:58 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2068 - T165743 (duration: 00m 39s) | 
  [production] | 
            
  | 12:40 | 
  <marostegui> | 
  Deploy alter table s7.frwiktionary on db2068 - T165743 | 
  [production] | 
            
  | 12:40 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2068 - T165743 (duration: 00m 40s) | 
  [production] | 
            
  | 11:39 | 
  <marostegui> | 
  Deploy alter table s2.revision table on labsdb1003 - T162611 | 
  [production] | 
            
  | 11:05 | 
  <moritzm> | 
  uploaded nutcracker 0.4.1-1+wm3~jessie1 to apt.wikimedia.org (T163795) | 
  [production] | 
            
  | 10:31 | 
  <ebernhardson> | 
  restarting elsaticsearch on relforge1001 to pull in remote reindex | 
  [production] | 
            
  | 10:19 | 
  <moritzm> | 
  powercycling mw2221, stuck in reboot and serial console unresponsive | 
  [production] | 
            
  | 10:08 | 
  <_joe_> | 
  moved stale repos to /srv/deployment/STALE on tin, T129290 | 
  [production] | 
            
  | 10:07 | 
  <moritzm> | 
  rebooting mw2220/mw2221 for update to Linux 4.9 / HHVM 3.18 / nutcracker tests | 
  [production] | 
            
  | 09:15 | 
  <reedy@tin> | 
  Synchronized dblists/: Update size dblists (duration: 00m 39s) | 
  [production] | 
            
  | 09:01 | 
  <reedy@tin> | 
  Synchronized php-1.30.0-wmf.1/extensions/WikimediaMaintenance/makeSizeDBLists.php: Catch a silly error (duration: 00m 39s) | 
  [production] | 
            
  | 08:14 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2048 for reimage (duration: 00m 39s) | 
  [production] | 
            
  | 07:36 | 
  <akosiaris> | 
  reboot kubernetes2001 for tests | 
  [production] | 
            
  | 06:51 | 
  <moritzm> | 
  installing openjdk-7/trusty regression update | 
  [production] | 
            
  | 06:34 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1051 - T159753 T164530 (duration: 00m 38s) | 
  [production] | 
            
  | 06:23 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1051 - T159753 T164530 (duration: 00m 39s) | 
  [production] | 
            
  | 06:09 | 
  <marostegui> | 
  Deploy alter table s2.revision table - db1018 - https://phabricator.wikimedia.org/T162611 | 
  [production] | 
            
  | 06:07 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1060 - T162611 (duration: 00m 40s) | 
  [production] | 
            
  | 05:56 | 
  <jynus> | 
  shutting down db2049 and preparing it for reimage | 
  [production] | 
            
  | 02:28 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Fri May 19 02:28:08 UTC 2017 (duration 6m 0s) | 
  [production] |