2301-2350 of 10000 results (64ms)
2020-04-06 ยง
14:07 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:47 <sukhe> upload cescout 0.1.1-1 to apt.wm.o (buster) - T247273 [production]
13:26 <elukey> reboot stat1008 as test to verify ROCm 3.3 upgrades [production]
13:22 <elukey> stat1008 upgraded to ROCm 3.3 (enables Tensorflow 2.x) [production]
13:05 <ema> cache: upgrade varnish to 5.1.3-1wm13, begin rolling varnish-fe restarts T249344 [production]
13:03 <marostegui> Deploy schema change on db1118 [production]
13:03 <jbond42> updating gnutls on buster [production]
13:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118 for schema change', diff saved to https://phabricator.wikimedia.org/P10906 and previous config saved to /var/cache/conftool/dbconfig/20200406-130320-marostegui.json [production]
13:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1107 after schema change', diff saved to https://phabricator.wikimedia.org/P10905 and previous config saved to /var/cache/conftool/dbconfig/20200406-130255-marostegui.json [production]
12:59 <Urbanecm> Creation of grwikimedia is done (T245911) [production]
12:59 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 22s) [production]
12:55 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:54 <urbanecm@deploy1001> Synchronized static/images/project-logos/: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:53 <marostegui> Deploy schema change on db1107 [production]
12:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1107 for schema change', diff saved to https://phabricator.wikimedia.org/P10904 and previous config saved to /var/cache/conftool/dbconfig/20200406-125308-marostegui.json [production]
12:52 <urbanecm@deploy1001> Synchronized multiversion/MWMultiVersion.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P10903 and previous config saved to /var/cache/conftool/dbconfig/20200406-125222-marostegui.json [production]
12:46 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: 77b9ae9: Create grwikimedia [production]
12:44 <urbanecm@deploy1001> Synchronized dblists/: 77b9ae9: Create grwikimedia (duration: 00m 59s) [production]
12:37 <XioNoX> Update eqiad analytics filters with new APT IPs [production]
12:27 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:21 <marostegui> Deploy schema change on db1089 [production]
12:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1089 for schema change', diff saved to https://phabricator.wikimedia.org/P10902 and previous config saved to /var/cache/conftool/dbconfig/20200406-122123-marostegui.json [production]
12:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1105:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10901 and previous config saved to /var/cache/conftool/dbconfig/20200406-122058-marostegui.json [production]
12:14 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:08 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:04 <godog> test grafana 6.7.2 upgrade on grafana2001 - T244208 [production]
11:57 <awight> EU swat complete [production]
11:53 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/TwoColConflict: SWAT: [[gerrit:586309|Backport talk page and EventLogging changes (T248243, T249404) (duration: 00m 59s) [production]
11:52 <elukey@cumin1001> END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) [production]
11:48 <elukey@cumin1001> START - Cookbook sre.aqs.roll-restart [production]
11:48 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:586325|Create account creator and rollback groups on yowiki (T249487)]] (duration: 00m 59s) [production]
11:32 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/ContentTranslation: SWAT: [[gerrit:586311|Avoid failure on restoring draft with no categories (T249400)]] (duration: 01m 02s) [production]
11:25 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: double-syncing (duration: 00m 58s) [production]
11:24 <marostegui> Deploy schema change on db1105:3311 [production]
11:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1105:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10900 and previous config saved to /var/cache/conftool/dbconfig/20200406-112417-marostegui.json [production]
11:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1099:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10899 and previous config saved to /var/cache/conftool/dbconfig/20200406-112123-marostegui.json [production]
11:18 <elukey> import AMD ROCm 3.3 packages in buster-wikimedia (component thirdparty/rocm33) - T247082 [production]
11:17 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:580394|cirrus: Increase commonswiki near match weight (T245642)]] (duration: 00m 59s) [production]
11:11 <awight@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:585779| Whitelist X-Wikimedia-Debug header for cross-wiki API requests (T249107)]] (duration: 00m 59s) [production]
10:51 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 00m 58s) [production]
10:50 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 01m 12s) [production]
09:50 <XioNoX> push pfw firewall policies - T249267 [production]
09:40 <marostegui> Deploy schema change on db1099:3311 [production]
09:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1099:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10898 and previous config saved to /var/cache/conftool/dbconfig/20200406-093944-marostegui.json [production]
09:11 <ema> cp2027: upgrade varnish to 5.1.3-1wm13 and restart varnish-fe T249344 [production]
09:08 <ema> upload varnish 5.1.3-1wm13 to buster-wikimedia on apt1001.wm.org T249344 [production]
08:55 <ariel@deploy1001> Finished deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link (duration: 00m 09s) [production]
08:55 <ariel@deploy1001> Started deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link [production]
08:54 <elukey> bootstrap wdqs200[7,8] - T246343 [production]