| 2020-10-19
      
      ยง | 
    
  | 20:08 | <jgiannelos@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 20:08 | <jgiannelos@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 20:06 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 20:06 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 20:01 | <mutante> | decom'ing wtp200[1-9].codfw.wmnet (pooled=inactive) T265558 | [production] | 
            
  | 20:00 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: dc=codfw,name=wtp200[1-9].codfw.wmnet | [production] | 
            
  | 19:57 | <jgiannelos@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | [production] | 
            
  | 19:57 | <otto@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 19:57 | <otto@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . | [production] | 
            
  | 19:52 | <otto@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 19:52 | <otto@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . | [production] | 
            
  | 19:51 | <otto@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 19:45 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@3c590e2]: Fix column mismatch for discovery.wikibase_item and multilist handler for esbulk uploads (duration: 03m 35s) | [production] | 
            
  | 19:41 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@3c590e2]: Fix column mismatch for discovery.wikibase_item and multilist handler for esbulk uploads | [production] | 
            
  | 19:35 | <otto@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . | [production] | 
            
  | 19:34 | <otto@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . | [production] | 
            
  | 19:33 | <mutante> | wtp2001 - sudo confctl decommission | [production] | 
            
  | 19:29 | <dzahn@cumin1001> | conftool action : set/weight=0; selector: dc=codfw,cluster=parsoid,service=canary | [production] | 
            
  | 19:01 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: GrowthExperiments: Set default variant to D on trwiki (T243445, T265556) (duration: 00m 56s) | [production] | 
            
  | 18:37 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 18902aa75efafb7d56ca347c12781dbe59f2f8ad: Change votewiki language temporarily to fa for fawiki elections (T262689) (duration: 00m 56s) | [production] | 
            
  | 18:31 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable and configure GrowthExperiments on trwiki (T243445) (duration: 00m 57s) | [production] | 
            
  | 18:29 | <tzatziki> | removing 10 files for legal compliance | [production] | 
            
  | 18:24 | <catrope@deploy1001> | Synchronized php-1.36.0-wmf.13/extensions/MobileFrontend/: Fix mobile diff redirect when curid parameter is present (T265654) (duration: 00m 58s) | [production] | 
            
  | 18:20 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: GrowthExperiments: Enable variant C/D for new users (T265556) (duration: 00m 56s) | [production] | 
            
  | 18:10 | <catrope@deploy1001> | Synchronized wmf-config/CommonSettings.php: Drop wgHiddenPrefs hack for VE beta feature (T254349) (duration: 00m 56s) | [production] | 
            
  | 17:53 | <robh@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:44 | <robh@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:18 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:16 | <robh@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 15:59 | <Urbanecm> | mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=smnwiki --cluster=all | [production] | 
            
  | 15:31 | <elukey> | update puppet compilers' facts | [production] | 
            
  | 14:36 | <bpirkle@deploy1001> | Synchronized wmf-config/CommonSettings.php: gerrit:634841 Add api.wikimedia.org to the list of allowed CORS origins (duration: 00m 57s) | [production] | 
            
  | 14:32 | <bpirkle@deploy1001> | Synchronized wmf-config/InitialiseSettings-labs.php: gerrit:634356 Configuration for user menu and sidebar special pages (duration: 00m 55s) | [production] | 
            
  | 14:30 | <bpirkle@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: gerrit:634356 Configuration for user menu and sidebar special pages (duration: 00m 56s) | [production] | 
            
  | 14:15 | <moritzm> | installing llvm-toolchain-7 bugfix updates from Buster point release | [production] | 
            
  | 13:34 | <Urbanecm> | Start of `[urbanecm@mwmaint2001 ~/updateVarDumps/output/group2-medium]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > output/$wiki.log; done < wikis.dblist` (T246539; wikis.dblist is medium wikis from group2.dblist) | [production] | 
            
  | 13:33 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . | [production] | 
            
  | 13:32 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . | [production] | 
            
  | 13:31 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . | [production] | 
            
  | 13:26 | <moritzm> | import prometheus-openldap-exporter 0+git20171128-2+deb10u1  for buster-wikimedia  T264388 | [production] | 
            
  | 12:48 | <moritzm> | installing httpcomponents-client security updates on Buster | [production] | 
            
  | 12:26 | <Urbanecm> | Creation of smnwiki is done (T264859) | [production] | 
            
  | 12:25 | <urbanecm@deploy1001> | Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 00m 56s) | [production] | 
            
  | 12:22 | <urbanecm@deploy1001> | Synchronized langlist: Creating smnwiki (T264859) (duration: 00m 56s) | [production] | 
            
  | 12:16 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Creating smnwiki (T264859) (duration: 00m 55s) | [production] | 
            
  | 12:16 | <marostegui> | Sanitize smnwiki on db1124:3315 and db2094:3315 - T264900 | [production] | 
            
  | 12:15 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: Creating smnwiki (T264859) (duration: 00m 56s) | [production] | 
            
  | 12:15 | <marostegui> | Deploy schema change on smnwiki T265321 T264900 | [production] | 
            
  | 12:14 | <urbanecm@deploy1001> | rebuilt and synchronized wikiversions files: Creating smnwiki (T264859) | [production] | 
            
  | 12:12 | <urbanecm@deploy1001> | Synchronized dblists: Creating smnwiki (T264859) (duration: 00m 55s) | [production] |