| 2016-02-02
      
      § | 
    
  | 11:24 | <hashar_> | Restarting Zuul. Stuck in a dependency loop :( | [production] | 
            
  | 11:12 | <jynus> | restarting and reconfiguring mysql at db1063 | [production] | 
            
  | 10:51 | <_joe_> | stopped jobrunner on mw1161 after failed sync-common | [production] | 
            
  | 10:44 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Depool db1063, repool db1036 (duration: 00m 21s) | [production] | 
            
  | 10:00 | <jynus> | reconfigure and upgrade db1036 | [production] | 
            
  | 09:51 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Testing scap-reduce db1018 weight (duration: 00m 21s) | [production] | 
            
  | 09:42 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Depool db1036, repool db1021 (duration: 00m 22s) | [production] | 
            
  | 09:37 | <hashar> | Jenkins is fully up and operational | [production] | 
            
  | 09:36 | <jynus> | armed keyholder on tin | [production] | 
            
  | 09:33 | <dcausse> | elastic (codfw and eqiad): unfreezing indices | [production] | 
            
  | 09:33 | <moritzm> | restarting gerrit on ytterbium for java security update | [production] | 
            
  | 09:33 | <_joe_> | re-syncing tin homes | [production] | 
            
  | 09:32 | <hashar> | gallium: apt-get upgrade   | Restarting Jenkins | [production] | 
            
  | 09:12 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Depool db1036, repool db1021 (duration: 00m 21s) | [production] | 
            
  | 09:08 | <dcausse> | elastic (codfw and eqiad): freezing indices to stop titlesuggest maint scripts | [production] | 
            
  | 09:03 | <godog> | repool restbase1007 via confctl | [production] | 
            
  | 08:13 | <jynus> | restarting and upgrading db1021 | [production] | 
            
  | 08:02 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Pool db1018; Depool db1021 (duration: 00m 20s) | [production] | 
            
  | 07:46 | <jynus> | https://phabricator.wikimedia.org/rOMWC2ea9167221d11eb1880e4d26eae64a85cb9b2697 and https://phabricator.wikimedia.org/rOMWCa55d2bf8cd3a2853fac35d5b8239b8e8c2fe6a0f merged but not deployed | [production] | 
            
  | 06:58 | <_joe_> | reimaging tin.eqiad.wmnet | [production] | 
            
  | 01:30 | <ebernhardson@mira> | Finished scap: Add Cookie statement link to footer of all WMF wikis per legal (duration: 19m 42s) | [production] | 
            
  | 01:10 | <ebernhardson@mira> | Started scap: Add Cookie statement link to footer of all WMF wikis per legal | [production] | 
            
  | 01:07 | <ebernhardson@mira> | scap failed: CalledProcessError Command '/srv/deployment/scap/scap/bin/refreshCdbJsonFiles --directory="/srv/mediawiki-staging/php-1.27.0-wmf.10/cache/l10n" --threads=10 ' returned non-zero exit status 255 (duration: 03m 31s) | [production] | 
            
  | 01:03 | <ebernhardson@mira> | Started scap: Add Cookie statement link to footer of all WMF wikis per legal | [production] | 
            
  | 00:31 | <ebernhardson@mira> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki="cawikibooks" --outdir="/tmp/scap_l10n_1684485672" --threads=10   --quiet' returned non-zero exit status 255 (duration: 02m 35s) | [production] | 
            
  | 00:30 | <mobrovac> | restbase deploy end of c3bd864 | [production] | 
            
  | 00:29 | <ebernhardson@mira> | Started scap: Add Cookie statement link to footer of all WMF wikis per legal | [production] | 
            
  | 00:26 | <ebernhardson@mira> | Synchronized wmf-config/logging.php: Revert "monolog: Ensure that context data added by WebProcessor is utf-8 safe" (duration: 01m 27s) | [production] | 
            
  | 00:23 | <ebernhardson@mira> | Synchronized wmf-config/CirrusSearch-production.php: Move morelike query load back to eqiad to allow load testing on codfw (duration: 01m 38s) | [production] | 
            
  
    | 2016-02-01
      
      § | 
    
  | 23:51 | <mobrovac> | restbase deploy start of c3bd864 on canary rb1001 | [production] | 
            
  | 19:28 | <ori@mira> | Synchronized docroot/wikipedia.org/speed-tests: I5b48a491390: Speed trials: add preconnect (duration: 01m 27s) | [production] | 
            
  | 18:54 | <bblack> | banned obj.http.Content-Length == 13817 on all cache_text | [production] | 
            
  | 18:54 | <mutante> | LDAP - added elukey to "ops" group | [production] | 
            
  | 18:11 | <mutante> | planet1001 - rebooting for upgrade | [production] | 
            
  | 17:54 | <hoo> | restarted hhvm on mw1253 | [production] | 
            
  | 17:06 | <thcipriani@mira> | Synchronized wmf-config: SWAT: Use extension registration for Graph [[gerrit:266433]] (duration: 01m 29s) | [production] | 
            
  | 16:59 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable SandboxLink on or.wikipedia.org [[gerrit:267194]] (duration: 01m 31s) | [production] | 
            
  | 16:54 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable WikidataPageBanner on es.wikivoyage [[gerrit:267195]] (duration: 01m 29s) | [production] | 
            
  | 16:52 | <_joe_> | restarted pybal on lvs1001 | [production] | 
            
  | 16:47 | <_joe_> | installing the new HHVM package to the api appserver cluster in eqiad | [production] | 
            
  | 16:38 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Set WikidataPageBanner namespaces on fr.wikivoyage [[gerrit:266541]] (duration: 01m 26s) | [production] | 
            
  | 16:32 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration on cu.wikipedia [[gerrit:265885]] (duration: 01m 26s) | [production] | 
            
  | 16:26 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Centralise all VisualEditor feedback pages except for a few wikis [[gerrit:258206]] (duration: 01m 30s) | [production] | 
            
  | 16:22 | <thcipriani@mira> | Synchronized dblists/visualeditor-default.dblist: SWAT: Enable VisualEditor by default for some other wikis [[gerrit:264765]] (duration: 01m 58s) | [production] | 
            
  | 16:05 | <ema> | hhvm restarted on mw1072 | [production] | 
            
  | 15:54 | <krenair@mira> | Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 01m 52s) | [production] | 
            
  | 15:48 | <bblack> | restarted pybal on lvs1004 (lvs1003 above was a bad log message!) | [production] | 
            
  | 15:42 | <bblack> | restarted pybal on lvs1003 | [production] | 
            
  | 15:13 | <bblack> | cp3042 repooled | [production] | 
            
  | 15:10 | <ema> | restarting hhvm on mw1057 | [production] |