7251-7300 of 10000 results (92ms)
2019-11-06 §
16:11 <mdholloway> MachineVision: Imported Freebase to Wikidata ID mappings on testcommonswiki (T227349) [production]
15:58 <mdholloway> created MachineVision tables on testcommonswiki (T227349) [production]
15:52 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Configure MachineVision and enable on testcommonswiki (T227349) (duration: 01m 00s) [production]
15:47 <mholloway-shell@deploy1001> Synchronized wmf-config/CommonSettings.php: MachineVision: Use an HTTP proxy in production (T236843) (duration: 01m 01s) [production]
15:42 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: MachineVision: Do not restrict to testing users on Beta (duration: 01m 00s) [production]
15:31 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: MachineVision: Fix Beta config with updated service name (duration: 01m 02s) [production]
14:45 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: repool es1019 with low weight (duration: 00m 59s) [production]
14:41 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Enable streaks and revert counts (T234955, T234956) (duration: 01m 00s) [production]
14:27 <jynus> upgrade and restart es1019 [production]
14:23 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: depool es1019 (duration: 01m 00s) [production]
14:07 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db1074 at 50%', diff saved to https://phabricator.wikimedia.org/P9539 and previous config saved to /var/cache/conftool/dbconfig/20191106-140702-jynus.json [production]
12:38 <Urbanecm> EU SWAT done [production]
12:38 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: a239b14: Allow certain users to create account at closed wikis (T222117; 2/2) (duration: 01m 00s) [production]
12:36 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: a239b14: Allow certain users to create account at closed wikis (T222117; 1/2) (duration: 00m 59s) [production]
12:34 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 3e9ede0: Add 104 (Cookbook) to $wgContentNamespaces for bnwikibooks (T236840) (duration: 01m 00s) [production]
12:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 5875c45: [cirrus] Disable instant indexing on wikidata (duration: 01m 15s) [production]
11:57 <jynus> upgrade and restart db2048 [production]
11:35 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db1074 at 10%', diff saved to https://phabricator.wikimedia.org/P9537 and previous config saved to /var/cache/conftool/dbconfig/20191106-113510-jynus.json [production]
11:14 <jynus> stopping db1074 for maintenance (will create temporary s2 lag on wikireplicas) [production]
11:06 <jynus@cumin1001> dbctl commit (dc=all): 'Depool db1074', diff saved to https://phabricator.wikimedia.org/P9536 and previous config saved to /var/cache/conftool/dbconfig/20191106-110603-jynus.json [production]
09:46 <moritzm> upgrading mw1262-mw1265,mw1276 servers to PHP 7.2.24 T237239 [production]
09:33 <jynus> stop and upgrade labsdb1011 T236015 [production]
09:25 <jynus> depooling labsdb1011 for wikireplica service T236015 [production]
09:10 <onimisionipe@deploy1001> Finished deploy [wdqs/wdqs@2cb2dde]: T233213 (duration: 11m 38s) [production]
08:58 <onimisionipe@deploy1001> Started deploy [wdqs/wdqs@2cb2dde]: T233213 [production]
08:51 <jynus> upgrading wmf-mariadb101-client on cumin hosts [production]
08:51 <moritzm> upgrading remaining mwdebug* servers to PHP 7.2.24 T237239 [production]
08:33 <jynus> upgrading db2102 mariadb (test-s1) [production]
07:48 <onimisionipe@deploy1001> Finished deploy [wdqs/wdqs@2cb2dde]: T233213 (duration: 11m 38s) [production]
07:37 <onimisionipe@deploy1001> Started deploy [wdqs/wdqs@2cb2dde]: T233213 [production]
02:59 <vgutierrez> Switch from nginx to ats-tls on cp5012 - T231627 [production]
00:07 <mdholloway> created table wikimedia_editor_tasks_edit_streak on x1/wikishared (T234956) [production]
2019-11-05 §
23:32 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.35.0-wmf.5 refs T233853 [production]
23:25 <twentyafterfour@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.5 refs T233853 (duration: 24m 13s) [production]
23:01 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.5 refs T233853 [production]
22:51 <twentyafterfour@deploy1001> scap failed: CalledProcessError Command 'cp -r "/tmp/scap_l10n_2905573311"/* "/srv/mediawiki-staging/php-1.35.0-wmf.5/cache/l10n"' returned non-zero exit status 1 (duration: 01m 26s) [production]
22:50 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.5 refs T233853 [production]
22:39 <twentyafterfour@deploy1001> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki="testwiki" --outdir="/tmp/scap_l10n_2076118383" --threads=30 --lang en --quiet' returned non-zero exit status 1 (duration: 01m 26s) [production]
22:38 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.5 refs T233853 [production]
22:17 <twentyafterfour> scap failed with error: A copy of your installation's LocalSettings.php must exist and be readable in the source directory. Use --conf to specify it. refs T233853 [production]
22:09 <twentyafterfour@deploy1001> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki="testwiki" --outdir="/tmp/scap_l10n_840646293" --threads=30 --lang en --quiet' returned non-zero exit status 1 (duration: 04m 54s) [production]
22:04 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.5 refs T233853 [production]
22:03 <XioNoX> remove 127.0.0.1/32 and ::1/128 from cr2-esams:lo0.0 [production]
21:58 <XioNoX> remove 127.0.0.1/32 and ::1/128 from cr3-esams:lo0.0 [production]
20:45 <mutante> shutting down cobalt (formerly gerrit server) [production]
20:44 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:43 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:33 <XioNoX> push fw policies to pfw3-eqiad - T236201 [production]
20:23 <XioNoX> push fw policies to pfw3-codfw - T236201 [production]
20:17 <joal@deploy1001> Finished deploy [analytics/refinery@ea631bd]: Analytics deploy for spark upgrade - forgotten patch (duration: 08m 21s) [production]