| 2020-04-06
      
      ยง | 
    
  | 12:59 | <urbanecm@deploy1001> | Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 22s) | [production] | 
            
  | 12:55 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) | [production] | 
            
  | 12:54 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: 77b9ae9: Create grwikimedia (duration: 00m 58s) | [production] | 
            
  | 12:53 | <marostegui> | Deploy schema change on db1107 | [production] | 
            
  | 12:53 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1107 for schema change', diff saved to https://phabricator.wikimedia.org/P10904 and previous config saved to /var/cache/conftool/dbconfig/20200406-125308-marostegui.json | [production] | 
            
  | 12:52 | <urbanecm@deploy1001> | Synchronized multiversion/MWMultiVersion.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) | [production] | 
            
  | 12:52 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P10903 and previous config saved to /var/cache/conftool/dbconfig/20200406-125222-marostegui.json | [production] | 
            
  | 12:46 | <urbanecm@deploy1001> | rebuilt and synchronized wikiversions files: 77b9ae9: Create grwikimedia | [production] | 
            
  | 12:44 | <urbanecm@deploy1001> | Synchronized dblists/: 77b9ae9: Create grwikimedia (duration: 00m 59s) | [production] | 
            
  | 12:37 | <XioNoX> | Update eqiad analytics filters with new APT IPs | [production] | 
            
  | 12:27 | <hnowlan@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . | [production] | 
            
  | 12:21 | <marostegui> | Deploy schema change on db1089 | [production] | 
            
  | 12:21 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1089 for schema change', diff saved to https://phabricator.wikimedia.org/P10902 and previous config saved to /var/cache/conftool/dbconfig/20200406-122123-marostegui.json | [production] | 
            
  | 12:20 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1105:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10901 and previous config saved to /var/cache/conftool/dbconfig/20200406-122058-marostegui.json | [production] | 
            
  | 12:14 | <hnowlan@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . | [production] | 
            
  | 12:08 | <hnowlan@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . | [production] | 
            
  | 12:04 | <godog> | test grafana 6.7.2 upgrade on grafana2001 - T244208 | [production] | 
            
  | 11:57 | <awight> | EU swat complete | [production] | 
            
  | 11:53 | <awight@deploy1001> | Synchronized php-1.35.0-wmf.26/extensions/TwoColConflict: SWAT: [[gerrit:586309|Backport talk page and EventLogging changes (T248243, T249404) (duration: 00m 59s) | [production] | 
            
  | 11:52 | <elukey@cumin1001> | END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) | [production] | 
            
  | 11:48 | <elukey@cumin1001> | START - Cookbook sre.aqs.roll-restart | [production] | 
            
  | 11:48 | <awight@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:586325|Create account creator and rollback groups on yowiki (T249487)]] (duration: 00m 59s) | [production] | 
            
  | 11:32 | <awight@deploy1001> | Synchronized php-1.35.0-wmf.26/extensions/ContentTranslation: SWAT: [[gerrit:586311|Avoid failure on restoring draft with no categories (T249400)]] (duration: 01m 02s) | [production] | 
            
  | 11:25 | <awight@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: double-syncing (duration: 00m 58s) | [production] | 
            
  | 11:24 | <marostegui> | Deploy schema change on db1105:3311 | [production] | 
            
  | 11:24 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1105:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10900 and previous config saved to /var/cache/conftool/dbconfig/20200406-112417-marostegui.json | [production] | 
            
  | 11:21 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1099:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10899 and previous config saved to /var/cache/conftool/dbconfig/20200406-112123-marostegui.json | [production] | 
            
  | 11:18 | <elukey> | import AMD ROCm 3.3 packages in buster-wikimedia (component thirdparty/rocm33) - T247082 | [production] | 
            
  | 11:17 | <awight@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:580394|cirrus: Increase commonswiki near match weight (T245642)]] (duration: 00m 59s) | [production] | 
            
  | 11:11 | <awight@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:585779| Whitelist X-Wikimedia-Debug header for cross-wiki API requests (T249107)]] (duration: 00m 59s) | [production] | 
            
  | 10:51 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 00m 58s) | [production] | 
            
  | 10:50 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 01m 12s) | [production] | 
            
  | 09:50 | <XioNoX> | push pfw firewall policies - T249267 | [production] | 
            
  | 09:40 | <marostegui> | Deploy schema change on db1099:3311 | [production] | 
            
  | 09:39 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1099:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10898 and previous config saved to /var/cache/conftool/dbconfig/20200406-093944-marostegui.json | [production] | 
            
  | 09:11 | <ema> | cp2027: upgrade varnish to 5.1.3-1wm13 and restart varnish-fe T249344 | [production] | 
            
  | 09:08 | <ema> | upload varnish 5.1.3-1wm13 to buster-wikimedia on apt1001.wm.org T249344 | [production] | 
            
  | 08:55 | <ariel@deploy1001> | Finished deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link (duration: 00m 09s) | [production] | 
            
  | 08:55 | <ariel@deploy1001> | Started deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link | [production] | 
            
  | 08:54 | <elukey> | bootstrap wdqs200[7,8] - T246343 | [production] | 
            
  | 08:50 | <marostegui> | Deploy schema change on db1139:3311 | [production] | 
            
  | 08:18 | <_joe_> | conversion of codfw api done | [production] | 
            
  | 08:07 | <marostegui> | Deploy schema change on dbstore1003:3311 | [production] | 
            
  | 07:54 | <vgutierrez> | rolling restart of ats-tls to disable wmf-analytics log - T249335 T237993 | [production] | 
            
  | 07:50 | <dcausse> | search index: deleting stale index wikidatawiki_content_1585224806 on cloudelastic:9243 | [production] | 
            
  | 07:49 | <_joe_> | eqiad API migrated to envoy for local TLS termination, now starting codfw | [production] | 
            
  | 07:35 | <elukey> | restart elasticsearch_6@cloudelastic-chi-eqiad on cloudelastic1003 as attempt to fix heavy GC runs (old gen) - T231517 | [production] | 
            
  | 07:35 | <marostegui> | Rename wb_terms on eqiad excluding labsdb1009, labdb1010, labsdb1011 - T248086 | [production] | 
            
  | 07:06 | <marostegui> | Rename wb_terms on codfw - T248086 | [production] | 
            
  | 06:45 | <XioNoX> | delete BGP to AS25074 in amsix | [production] |