| 2019-03-19
      
      § | 
    
  | 13:12 | <akosiaris> | unfirewall gerrit, put service back in action | [production] | 
            
  | 11:31 | <moritzm> | installing php5 security updates | [production] | 
            
  | 09:08 | <akosiaris> | start nagios-nrpe-server on proton1002, failed due to fork() failed with error 12, bailing out... | [production] | 
            
  | 07:25 | <kart_> | Finished manual run of unpublished ContentTranslation draft purge script (T218279) | [production] | 
            
  | 07:20 | <twentyafterfour@deploy1001> | Synchronized wmf-config/CommonSettings.php: Temporarily disable account creation on wikitech (duration: 00m 51s) | [production] | 
            
  | 06:47 | <akosiaris> | stop zuul and zuul-merger on contint1001 | [production] | 
            
  | 03:45 | <kart_> | Started manual run of unpublished ContentTranslation draft purge script (T218279) | [production] | 
            
  | 02:12 | <krinkle@deploy1001> | Synchronized php-1.33.0-wmf.21/extensions/EventLogging/includes/ApiJsonSchema.php: If280a4056a (duration: 00m 48s) | [production] | 
            
  | 02:11 | <krinkle@deploy1001> | Synchronized php-1.33.0-wmf.21/extensions/EventLogging/includes/RemoteSchema.php: If280a4056a (duration: 00m 51s) | [production] | 
            
  | 00:14 | <reedy@deploy1001> | Synchronized php-1.33.0-wmf.21/tests/phpunit/includes/: Replace wgUser with RequestContext::getUser in User::getBlockedStatus (duration: 01m 00s) | [production] | 
            
  | 00:12 | <reedy@deploy1001> | Synchronized php-1.33.0-wmf.21/includes/user/User.php: Replace wgUser with RequestContext::getUser in User::getBlockedStatus (duration: 00m 49s) | [production] | 
            
  
    | 2019-03-18
      
      § | 
    
  | 23:54 | <maxsem@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/494551/ (duration: 00m 49s) | [production] | 
            
  | 23:45 | <maxsem@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/494551/ (duration: 00m 48s) | [production] | 
            
  | 23:33 | <maxsem@deploy1001> | Synchronized php-1.33.0-wmf.21/includes/EditPage.php: https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/497347/ (duration: 00m 49s) | [production] | 
            
  | 23:25 | <twentyafterfour> | running puppet on phab1001 to get out of degraded state | [production] | 
            
  | 23:23 | <XioNoX> | renumber Telia transit in eqsin | [production] | 
            
  | 23:14 | <maxsem@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/497317/ (duration: 00m 49s) | [production] | 
            
  | 23:07 | <maxsem@deploy1001> | Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/496515/ (duration: 00m 48s) | [production] | 
            
  | 22:18 | <greg-g> | gjg@phab1001:~$ sudo /srv/phab/phabricator/bin/auth strip --all-types --user Barras # per request/verification from foks | [production] | 
            
  | 21:00 | <bd808> | Testing stashbot's ability to log events to wikitech | [production] | 
            
  | 19:57 | <bawolff@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable block disables login on wikitech (duration: 00m 48s) | [production] | 
            
  | 19:56 | <bawolff@deploy1001> | Synchronized wmf-config/wikitech.php: Adjust ldap config (duration: 00m 48s) | [production] | 
            
  | 16:17 | <volans> | restarting pdfrender on scb1003 | [production] | 
            
  | 16:15 | <volans> | restarting pdfrender on scb1004 | [production] | 
            
  | 15:48 | <jiji@cumin1001> | conftool action : set/pooled=no; selector: dc=eqiad,service=cxserver,cluster=scb,name=scb.* | [production] | 
            
  | 15:45 | <jijiki> | Depool sbc* from serving cxserver on eqiad - T213195 | [production] | 
            
  | 15:06 | <papaul> | shutting down mw2206 for memtest | [production] | 
            
  | 14:47 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] | 
            
  | 14:46 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 14:13 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=prometheus2003.codfw.wmnet | [production] | 
            
  | 13:41 | <ema> | cp-ats rolling restart to apply proxy.config.cache.ram_cache.size config change T213263 | [production] | 
            
  | 13:23 | <mvolz@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 13:22 | <mvolz@deploy1001> | scap-helm citoid cluster codfw completed | [production] | 
            
  | 13:22 | <mvolz@deploy1001> | scap-helm citoid upgrade production -f citoid-codfw-values.yaml stable/citoid [namespace: citoid, clusters: codfw] | [production] | 
            
  | 13:18 | <mvolz@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 13:18 | <mvolz@deploy1001> | scap-helm citoid cluster eqiad completed | [production] | 
            
  | 13:17 | <mvolz@deploy1001> | scap-helm citoid upgrade production -f citoid-eqiad-values.yaml stable/citoid [namespace: citoid, clusters: eqiad] | [production] | 
            
  | 13:03 | <arturo> | T218022 disable icinga checks for labtestservices2001.wikimedia.org | [production] | 
            
  | 12:54 | <arturo> | T218025 disable icinga checks for cloudnet2001-dev.codfw.wmnet | [production] | 
            
  | 12:49 | <mvolz@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 12:49 | <mvolz@deploy1001> | scap-helm citoid cluster staging completed | [production] | 
            
  | 12:49 | <mvolz@deploy1001> | scap-helm citoid upgrade staging -f citoid-staging-values.yaml stable/citoid [namespace: citoid, clusters: staging] | [production] | 
            
  | 12:48 | <mvolz@deploy1001> | scap-helm citoid upgrade staging -f citoid-values-staging.yaml stable/citoid [namespace: citoid, clusters: staging] | [production] | 
            
  | 11:45 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 11:45 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:496696|Enable mobile section editing on bnwiki, hewiki, zh_yuewiki (T218375)]] (duration: 00m 50s) | [production] | 
            
  | 10:51 | <_joe_> | testing safety checks for php-fpm on mwdebug2001 | [production] | 
            
  | 10:35 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:497261| Bumping portals to master (T128546)]] (duration: 00m 48s) | [production] | 
            
  | 10:34 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:497261| Bumping portals to master (T128546)]] (duration: 00m 49s) | [production] | 
            
  | 10:12 | <vgutierrez> | uploaded acme-chief 0.12 to apt.wikimedia.org (buster) - T218543 | [production] | 
            
  | 10:12 | <volans> | restarted irc echo on icinga2001 | [production] |