1251-1300 of 10000 results (64ms)
2020-04-06 ยง
15:04 <elukey@cumin1001> END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) [production]
14:59 <addshore> deploy slot done [production]
14:55 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Test commons: Define entity sources configuration T248664 (cache bust) (duration: 00m 57s) [production]
14:54 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Test commons: Define entity sources configuration T248664 (duration: 00m 57s) [production]
14:50 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase, entity source, use modern repoDatabase and interwikiPrefix T248664 (cache bust) (duration: 00m 57s) [production]
14:49 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase, entity source, use modern repoDatabase and interwikiPrefix T248664 (duration: 00m 58s) [production]
14:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10912 and previous config saved to /var/cache/conftool/dbconfig/20200406-144220-marostegui.json [production]
14:41 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase client entity source config T248664 (cache bust) (duration: 00m 58s) [production]
14:40 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase client entity source config T248664 (duration: 00m 59s) [production]
14:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10911 and previous config saved to /var/cache/conftool/dbconfig/20200406-143755-marostegui.json [production]
14:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10910 and previous config saved to /var/cache/conftool/dbconfig/20200406-143042-marostegui.json [production]
14:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10909 and previous config saved to /var/cache/conftool/dbconfig/20200406-142607-marostegui.json [production]
14:24 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (cachebust) (duration: 00m 58s) [production]
14:23 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (duration: 00m 59s) [production]
14:09 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
14:07 <elukey@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
14:07 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:47 <sukhe> upload cescout 0.1.1-1 to apt.wm.o (buster) - T247273 [production]
13:26 <elukey> reboot stat1008 as test to verify ROCm 3.3 upgrades [production]
13:22 <elukey> stat1008 upgraded to ROCm 3.3 (enables Tensorflow 2.x) [production]
13:05 <ema> cache: upgrade varnish to 5.1.3-1wm13, begin rolling varnish-fe restarts T249344 [production]
13:03 <marostegui> Deploy schema change on db1118 [production]
13:03 <jbond42> updating gnutls on buster [production]
13:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118 for schema change', diff saved to https://phabricator.wikimedia.org/P10906 and previous config saved to /var/cache/conftool/dbconfig/20200406-130320-marostegui.json [production]
13:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1107 after schema change', diff saved to https://phabricator.wikimedia.org/P10905 and previous config saved to /var/cache/conftool/dbconfig/20200406-130255-marostegui.json [production]
12:59 <Urbanecm> Creation of grwikimedia is done (T245911) [production]
12:59 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 22s) [production]
12:55 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:54 <urbanecm@deploy1001> Synchronized static/images/project-logos/: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:53 <marostegui> Deploy schema change on db1107 [production]
12:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1107 for schema change', diff saved to https://phabricator.wikimedia.org/P10904 and previous config saved to /var/cache/conftool/dbconfig/20200406-125308-marostegui.json [production]
12:52 <urbanecm@deploy1001> Synchronized multiversion/MWMultiVersion.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P10903 and previous config saved to /var/cache/conftool/dbconfig/20200406-125222-marostegui.json [production]
12:46 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: 77b9ae9: Create grwikimedia [production]
12:44 <urbanecm@deploy1001> Synchronized dblists/: 77b9ae9: Create grwikimedia (duration: 00m 59s) [production]
12:37 <XioNoX> Update eqiad analytics filters with new APT IPs [production]
12:27 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:21 <marostegui> Deploy schema change on db1089 [production]
12:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1089 for schema change', diff saved to https://phabricator.wikimedia.org/P10902 and previous config saved to /var/cache/conftool/dbconfig/20200406-122123-marostegui.json [production]
12:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1105:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10901 and previous config saved to /var/cache/conftool/dbconfig/20200406-122058-marostegui.json [production]
12:14 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:08 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:04 <godog> test grafana 6.7.2 upgrade on grafana2001 - T244208 [production]
11:57 <awight> EU swat complete [production]
11:53 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/TwoColConflict: SWAT: [[gerrit:586309|Backport talk page and EventLogging changes (T248243, T249404) (duration: 00m 59s) [production]
11:52 <elukey@cumin1001> END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) [production]
11:48 <elukey@cumin1001> START - Cookbook sre.aqs.roll-restart [production]
11:48 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:586325|Create account creator and rollback groups on yowiki (T249487)]] (duration: 00m 59s) [production]
11:32 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/ContentTranslation: SWAT: [[gerrit:586311|Avoid failure on restoring draft with no categories (T249400)]] (duration: 01m 02s) [production]
11:25 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: double-syncing (duration: 00m 58s) [production]