| 2015-04-01
      
      ยง | 
    
  | 23:23 | <krenair> | Synchronized php-1.25wmf23/extensions/OpenStackManager/nova/OpenStackNovaHost.php: https://gerrit.wikimedia.org/r/#/c/201367/ (duration: 00m 15s) | [production] | 
            
  | 23:02 | <krenair> | Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/201197/ (duration: 00m 11s) | [production] | 
            
  | 22:59 | <awight> | update payments from f617326761887ed9a9100b472ea3b5736e2c10e6 to d37687239fa79842c0d6ea65e9230a3f14cda867 | [production] | 
            
  | 22:57 | <twentyafterfour> | Purged l10n cache for 1.25wmf22 | [production] | 
            
  | 22:57 | <kaldari> | Synchronized wmf-config/InitialiseSettings.php: enabling Gather on enwiki (duration: 00m 13s) | [production] | 
            
  | 22:48 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf24 | [production] | 
            
  | 22:31 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf23 | [production] | 
            
  | 22:14 | <twentyafterfour> | Finished scap: once again: testwiki to 1.25wmf24 and rebuild l10n cache (duration: 54m 14s) | [production] | 
            
  | 21:56 | <bblack> | repooled cp107[1234] in pybal (eqiad upload, row D) | [production] | 
            
  | 21:20 | <twentyafterfour> | Started scap: once again: testwiki to 1.25wmf24 and rebuild l10n cache | [production] | 
            
  | 21:18 | <twentyafterfour> | Started scap: testwiki to 1.25wmf24 and rebuild l10n cache | [production] | 
            
  | 20:32 | <gwicke> | finished RESTBase 0.5.0 deployment | [production] | 
            
  | 20:28 | <gwicke> | deploying RESTBase 0.5.0 | [production] | 
            
  | 20:19 | <twentyafterfour> | Started scap: retrying: testwiki to php-1.25wmf24 and rebuild l10n cache | [production] | 
            
  | 20:08 | <YuviPanda> | run chmod -R g+w . on tin with CWD /srv/deployment/scap/scap/.git | [production] | 
            
  | 19:48 | <twentyafterfour> | scap failed: CalledProcessError Command 'cp '/srv/mediawiki-staging/php-1.25wmf24/cache/l10n/'*.cdb '/tmp/scap_l10n_1816369030'' returned non-zero exit status 1 (duration: 14m 20s) | [production] | 
            
  | 19:33 | <twentyafterfour> | Started scap: testwiki to php-1.25wmf24 and rebuild l10n cache | [production] | 
            
  | 19:18 | <paravoid> | upgrading cr1/2-eqiad<->asw-d-eqiad capacity (T92914) | [production] | 
            
  | 17:55 | <mutante> | added jmm to ops and wmf LDAP groups | [production] | 
            
  | 17:20 | <_joe_> | restarted hhvm on mw1194, stuck in HPHP::StatCache::refresh | [production] | 
            
  | 17:12 | <ottomata> | initiated kafka replica election | [production] | 
            
  | 17:04 | <paravoid> | repooling esams | [production] | 
            
  | 16:48 | <bd808> | Updated Wikimania Scholarships to bde1a27 (Improve performance of phase2 report query) | [production] | 
            
  | 16:09 | <godog> | bounce cassandra on test cluster | [production] | 
            
  | 16:03 | <thcipriani> | Synchronized php-1.25wmf23/extensions/UniversalLanguageSelector: swat [[gerrit:201122]] (duration: 01m 07s) | [production] | 
            
  | 15:58 | <paravoid> | upgrading junos on cr1-esams (esams is depooled, ignore alerts) | [production] | 
            
  | 15:48 | <phuedx> | Synchronized php-1.25wmf22/extensions/Gather/: Updating the Gather extension for 1.25wmf22 (duration: 01m 06s) | [production] | 
            
  | 15:47 | <bd808> | ssh: connect to host mw2213.codfw.wmnet port 22: Connection timed out during sync-dir initiated from tin | [production] | 
            
  | 15:45 | <phuedx> | Synchronized php-1.25wmf23/extensions/Gather: Updating the Gather extension for 1.25wmf23 (duration: 01m 07s) | [production] | 
            
  | 15:33 | <godog> | disable puppet on xenon, praseodymium, cerium, restbase* to test  https://gerrit.wikimedia.org/r/197840 | [production] | 
            
  | 15:31 | <^d> | ran sync-common on mw1017 for testwiki fun | [production] | 
            
  | 14:35 | <paravoid> | upgrading junos on cr2-knams (esams is depooled, ignore alerts) | [production] | 
            
  | 14:32 | <mark> | mark@csw2-esams> request system power-off member 1 | [production] | 
            
  | 14:28 | <mark> | asw-esams: mark@asw-esams> request system power-off member 3 | [production] | 
            
  | 14:20 | <mark> | Shutting down lvs3003 and lvs3004 | [production] | 
            
  | 12:08 | <paravoid> | draining esams | [production] | 
            
  | 07:28 | <godog> | bounce apertium-apy on sca1001/sca1002 | [production] | 
            
  | 06:43 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Apr  1 06:42:24 UTC 2015 (duration 42m 23s) | [production] | 
            
  | 06:10 | <_joe_> | manually rotated and compressed syslog and apache logs on uranium, still being spammed by kafka brokers | [production] | 
            
  | 03:05 | <LocalisationUpdate> | completed (1.25wmf23) at 2015-04-01 03:04:00+00:00 | [production] | 
            
  | 02:58 | <l10nupdate> | Synchronized php-1.25wmf23/cache/l10n: (no message) (duration: 08m 41s) | [production] | 
            
  | 02:35 | <LocalisationUpdate> | completed (1.25wmf22) at 2015-04-01 02:34:41+00:00 | [production] | 
            
  | 02:29 | <l10nupdate> | Synchronized php-1.25wmf22/cache/l10n: (no message) (duration: 08m 46s) | [production] | 
            
  | 01:35 | <legoktm> | started zuul on gallium | [production] | 
            
  | 00:40 | <urandom> | restarting cassandra on restbase1006 | [production] | 
            
  | 00:40 | <urandom> | restarting cassandra on restbase1005 | [production] | 
            
  | 00:35 | <urandom> | restarting cassandra on restbase1004 | [production] | 
            
  | 00:33 | <urandom> | restarting cassandra on restbase1003 | [production] | 
            
  | 00:30 | <urandom> | restarting cassandra on restbase1002 | [production] | 
            
  | 00:12 | <catrope> | Synchronized php-1.25wmf23/extensions/Gather: SWAT (duration: 01m 07s) | [production] |