| 2020-03-04
      
      § | 
    
  | 23:30 | <krinkle@deploy1001> | Synchronized src/: Ic344b48a1f8 - creates StaticSiteConfiguration.php (build-only) (duration: 01m 03s) | [production] | 
            
  | 23:26 | <reedy@deploy1001> | Synchronized php-1.35.0-wmf.22/extensions/CirrusSearch/includes/: T245303 (duration: 01m 02s) | [production] | 
            
  | 23:01 | <eileen> | process-control config revision is 734a7bfadd | [production] | 
            
  | 22:59 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:56 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:55 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:54 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:53 | <dzahn@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) | [production] | 
            
  | 22:53 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:51 | <dzahn@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) | [production] | 
            
  | 22:51 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:17 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 22:13 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 22:12 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 22:10 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:10 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:09 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 22:09 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 22:02 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 22:00 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 21:46 | <otto@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 21:46 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 21:46 | <urbanecm@deploy1001> | Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 25s) | [production] | 
            
  | 21:43 | <urbanecm@deploy1001> | Synchronized dblists/special.dblist: 8decd01: Add gewikimedia to special wikis (duration: 01m 06s) | [production] | 
            
  | 21:35 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 21:28 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 21:16 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . | [production] | 
            
  | 21:16 | <otto@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 20:54 | <eileen> | process-control config revision is 21eb2e891f | [production] | 
            
  | 20:29 | <otto@deploy1001> | Synchronized php-1.35.0-wmf.22/extensions/WikimediaEvents/modules/ext.wikimediaEvents/clientError.js: [[gerrit:576942|Include required url in mediawiki/client/error event (T246030)]] (duration: 01m 05s) | [production] | 
            
  | 19:58 | <otto@deploy1001> | Synchronized php-1.35.0-wmf.22/extensions/WikimediaEvents/modules/ext.wikimediaEvents/clientError.js: SWAT: [[gerrit:576931|Fix callback parameters for client error logging (T246030)]] (duration: 01m 07s) | [production] | 
            
  | 19:52 | <shdubsh> | restart logstash on logstash2005 -- testing field type mismatch mitigation | [production] | 
            
  | 18:43 | <mutante> | starting new DHCP servers to confirm they work and letting puppet immediately stop them again to clear systemd status | [production] | 
            
  | 18:30 | <mutante> | notebook1003 - restarted nagios-nrpe-server | [production] | 
            
  | 17:41 | <addshore> | stop item term rebuild at Q Q60345318 as I generate more lists (T219123) | [production] | 
            
  | 16:50 | <otto@cumin1001> | conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics-external | [production] | 
            
  | 16:49 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:45 | <cmjohnson@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:05 | <ottomata> | destroying unused eventgate-main 'main' and eventgate-analytics 'analytics' helm releases - installed: false | [production] | 
            
  | 16:02 | <addshore> | addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --sleep 1 --batch-size=50  # T244115 | [production] | 
            
  | 15:47 | <liw@deploy1001> | Synchronized php: group1 wikis to 1.35.0-wmf.22 (duration: 01m 03s) | [production] | 
            
  | 15:46 | <liw@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.22 | [production] | 
            
  | 15:29 | <vgutierrez> | upgrading ATS to version 8.0.6 on eqiad | [production] | 
            
  | 15:11 | <thcipriani> | restarting zuul | [production] | 
            
  | 14:55 | <akosiaris@cumin1001> | conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics-external | [production] | 
            
  | 14:44 | <filippo@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 14:41 | <filippo@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 14:25 | <vgutierrez> | upgrading ATS to version 8.0.6 on codfw | [production] | 
            
  | 14:19 | <liw@deploy1001> | rebuilt and synchronized wikiversions files: Revert "group1 wikis to 1.35.0-wmf.21 | [production] |