201-250 of 10000 results (37ms)
2020-04-06 ยง
14:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10911 and previous config saved to /var/cache/conftool/dbconfig/20200406-143755-marostegui.json [production]
14:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10910 and previous config saved to /var/cache/conftool/dbconfig/20200406-143042-marostegui.json [production]
14:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10909 and previous config saved to /var/cache/conftool/dbconfig/20200406-142607-marostegui.json [production]
14:24 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (cachebust) (duration: 00m 58s) [production]
14:23 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (duration: 00m 59s) [production]
14:09 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
14:07 <elukey@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
14:07 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:47 <sukhe> upload cescout 0.1.1-1 to apt.wm.o (buster) - T247273 [production]
13:26 <elukey> reboot stat1008 as test to verify ROCm 3.3 upgrades [production]
13:22 <elukey> stat1008 upgraded to ROCm 3.3 (enables Tensorflow 2.x) [production]
13:05 <ema> cache: upgrade varnish to 5.1.3-1wm13, begin rolling varnish-fe restarts T249344 [production]
13:03 <marostegui> Deploy schema change on db1118 [production]
13:03 <jbond42> updating gnutls on buster [production]
13:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118 for schema change', diff saved to https://phabricator.wikimedia.org/P10906 and previous config saved to /var/cache/conftool/dbconfig/20200406-130320-marostegui.json [production]
13:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1107 after schema change', diff saved to https://phabricator.wikimedia.org/P10905 and previous config saved to /var/cache/conftool/dbconfig/20200406-130255-marostegui.json [production]
12:59 <Urbanecm> Creation of grwikimedia is done (T245911) [production]
12:59 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 22s) [production]
12:55 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:54 <urbanecm@deploy1001> Synchronized static/images/project-logos/: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:53 <marostegui> Deploy schema change on db1107 [production]
12:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1107 for schema change', diff saved to https://phabricator.wikimedia.org/P10904 and previous config saved to /var/cache/conftool/dbconfig/20200406-125308-marostegui.json [production]
12:52 <urbanecm@deploy1001> Synchronized multiversion/MWMultiVersion.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) [production]
12:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P10903 and previous config saved to /var/cache/conftool/dbconfig/20200406-125222-marostegui.json [production]
12:46 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: 77b9ae9: Create grwikimedia [production]
12:44 <urbanecm@deploy1001> Synchronized dblists/: 77b9ae9: Create grwikimedia (duration: 00m 59s) [production]
12:37 <XioNoX> Update eqiad analytics filters with new APT IPs [production]
12:27 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:21 <marostegui> Deploy schema change on db1089 [production]
12:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1089 for schema change', diff saved to https://phabricator.wikimedia.org/P10902 and previous config saved to /var/cache/conftool/dbconfig/20200406-122123-marostegui.json [production]
12:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1105:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10901 and previous config saved to /var/cache/conftool/dbconfig/20200406-122058-marostegui.json [production]
12:14 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:08 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
12:04 <godog> test grafana 6.7.2 upgrade on grafana2001 - T244208 [production]
11:57 <awight> EU swat complete [production]
11:53 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/TwoColConflict: SWAT: [[gerrit:586309|Backport talk page and EventLogging changes (T248243, T249404) (duration: 00m 59s) [production]
11:52 <elukey@cumin1001> END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) [production]
11:48 <elukey@cumin1001> START - Cookbook sre.aqs.roll-restart [production]
11:48 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:586325|Create account creator and rollback groups on yowiki (T249487)]] (duration: 00m 59s) [production]
11:32 <awight@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/ContentTranslation: SWAT: [[gerrit:586311|Avoid failure on restoring draft with no categories (T249400)]] (duration: 01m 02s) [production]
11:25 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: double-syncing (duration: 00m 58s) [production]
11:24 <marostegui> Deploy schema change on db1105:3311 [production]
11:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1105:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10900 and previous config saved to /var/cache/conftool/dbconfig/20200406-112417-marostegui.json [production]
11:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1099:3311 after schema change', diff saved to https://phabricator.wikimedia.org/P10899 and previous config saved to /var/cache/conftool/dbconfig/20200406-112123-marostegui.json [production]
11:18 <elukey> import AMD ROCm 3.3 packages in buster-wikimedia (component thirdparty/rocm33) - T247082 [production]
11:17 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:580394|cirrus: Increase commonswiki near match weight (T245642)]] (duration: 00m 59s) [production]
11:11 <awight@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:585779| Whitelist X-Wikimedia-Debug header for cross-wiki API requests (T249107)]] (duration: 00m 59s) [production]
10:51 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 00m 58s) [production]
10:50 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 01m 12s) [production]
09:50 <XioNoX> push pfw firewall policies - T249267 [production]