| 2016-01-26
      
      ยง | 
    
  | 19:28 | <akosiaris> | issuing a varnish ban on all esams backend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:28 | <akosiaris> | issuing a varnish ban on all ulsfo backend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:28 | <akosiaris> | issuing a varnish ban on all ulsfo frontend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:28 | <akosiaris> | issuing a varnish ban on all ulsfo backend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:27 | <akosiaris> | issuing a varnish ban on all codfw frontend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:27 | <akosiaris> | issuing a varnish ban on all codfw backend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:27 | <akosiaris> | issuing a varnish ban on all eqiad frontend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:14 | <akosiaris> | issuing a varnish ban on all eqiad backend varnish for req.http.host .*wikimedia.org | [production] | 
            
  | 19:02 | <marxarelli> | backports to wmf.11 ready on mira but delaying train due to wikimedia.org outage | [production] | 
            
  | 18:44 | <_joe_> | running salt --batch-size=20 -C 'G@luster:appserver and G@site:eqiad' cmd.run 'puppet agent -t --tags mw-apache-config' | [production] | 
            
  | 18:27 | <robh> | i broke icinga, but then i fixed it, icinga back to normal. | [production] | 
            
  | 18:21 | <robh> | icinga is broken, it seems it was from a change before mine, but my forced reload broke it | [production] | 
            
  | 18:18 | <legoktm> | running mwscript updateArticleCount.php --wiki=jawiki --update=1 | [production] | 
            
  | 18:14 | <cmjohnson1> | starting puppet on mw cluster | [production] | 
            
  | 18:14 | <robh> | i broke icinga, fixing | [production] | 
            
  | 18:08 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Pool new parsercache pc1005 after cloning it from pc1002 (duration: 01m 28s) | [production] | 
            
  | 17:43 | <thcipriani> | ltwiki collation updated 503623 rows processed | [production] | 
            
  | 17:35 | <mutante> | mw1258 - restart hhvm | [production] | 
            
  | 17:20 | <cmjohnson> | disabling puppet on mw cluster | [production] | 
            
  | 17:02 | <thcipriani> | running updateCollation on ltwiki | [production] | 
            
  | 17:01 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Set category collation to uca-lt on lt.wikipedia [[gerrit:266427]] (duration: 01m 33s) | [production] | 
            
  | 16:55 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration on ur.wikipedia [[gerrit:265888]] (duration: 07m 10s) | [production] | 
            
  | 16:36 | <thcipriani@mira> | Synchronized w/static/images/project-logos/etwikiquote.png: SWAT: Update et.wikiquote logo [[gerrit:265623]] (duration: 01m 27s) | [production] | 
            
  | 16:31 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable SandboxLink on nl.wikiquote [[gerrit:265666]] (duration: 01m 26s) | [production] | 
            
  | 16:26 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespaces configuration on sk.wikipedia [[gerrit:265896]] (duration: 01m 27s) | [production] | 
            
  | 16:19 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove Tranwiki namespace on wuu.wikipedia [[gerrit:265892]] and Add Portal namespace on wuu.wikipedia [[gerrit:265893]] (duration: 01m 27s) | [production] | 
            
  | 16:12 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration for wuu.wikipedia [[gerrit:265891]] (duration: 01m 29s) | [production] | 
            
  | 14:57 | <ema> | Finished migration of mobile traffic to text cluster in esams https://phabricator.wikimedia.org/T109286 | [production] | 
            
  | 14:48 | <chasemp> | RPS on eth0 on labstores | [production] | 
            
  | 14:39 | <bblack> | upgrading packages (incl kernel) on all ulsfo caches (cp4xxx) | [production] | 
            
  | 14:21 | <akosiaris> | migrating alsafi,mx2001 back to 2004 for testing | [production] | 
            
  | 14:14 | <akosiaris> | migrate alsafi,mx2001 back from ganeti2004 to fix a network misconfiguration | [production] | 
            
  | 13:32 | <moritzm> | rebooted nescio/maerlant for kernel update | [production] | 
            
  | 13:14 | <jynus@mira> | Synchronized wmf-config/db-eqiad.php: Depool pc1002 for maintenance (clone to pc1005) (duration: 01m 39s) | [production] | 
            
  | 12:39 | <akosiaris> | rolling reboot of ganeti200{1,2,3,4,5,6}.codfw.wmnet for kernel upgrade | [production] | 
            
  | 12:10 | <moritzm> | rebooting mx2001/mx1001 (with a delay in between) for kernel update | [production] | 
            
  | 11:50 | <moritzm> | rebooting etherpad1001 for kernel update | [production] | 
            
  | 11:46 | <moritzm> | rebooting bromine for kernel update | [production] | 
            
  | 10:50 | <ema> | Starting migration of mobile traffic to text cluster in esams https://phabricator.wikimedia.org/T109286 | [production] | 
            
  | 09:30 | <hashar> | restarting Jenkins to upgrade the gearman plugin with https://review.openstack.org/#/c/271543/ | [production] | 
            
  | 09:28 | <_joe_> | finishing reboots of appservers in eqiad | [production] | 
            
  | 04:27 | <legoktm> | restarted resetGlobalUserTokens.php after it lost mysql connection again | [production] | 
            
  | 02:30 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Jan 26 02:30:58 UTC 2016 (duration 7m 0s) | [production] | 
            
  | 02:23 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.10) (duration: 09m 36s) | [production] | 
            
  | 01:45 | <krenair@mira> | Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/266453/ (duration: 01m 27s) | [production] | 
            
  | 00:45 | <mobrovac> | mobileapps deploying c2318b6 | [production] | 
            
  | 00:40 | <ebernhardson@mira> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 01m 25s) | [production] | 
            
  | 00:37 | <ebernhardson@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT bd808 (duration: 01m 34s) | [production] | 
            
  | 00:32 | <ebernhardson@mira> | Synchronized portals/: SWAT jgirault (duration: 01m 28s) | [production] | 
            
  | 00:29 | <ebernhardson@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT ebernhardson (duration: 01m 26s) | [production] |