1351-1400 of 10000 results (27ms)
2020-07-17 §
07:33 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
07:32 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
07:30 <elukey@cumin1001> START - Cookbook sre.ganeti.makevm [production]
06:30 <XioNoX> rename msw1-codfw interface range [production]
06:28 <XioNoX> rename msw1-eqiad interface range [production]
04:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1111', diff saved to https://phabricator.wikimedia.org/P11934 and previous config saved to /var/cache/conftool/dbconfig/20200717-044748-marostegui.json [production]
04:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1092', diff saved to https://phabricator.wikimedia.org/P11933 and previous config saved to /var/cache/conftool/dbconfig/20200717-044658-marostegui.json [production]
2020-07-16 §
22:15 <mutante> testreduce1001 manually git clone 'scandium' branch of integration/visualdiff into /srv/visualdiff (T257906) [production]
21:54 <crusnov@deploy1001> Finished deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 part 3 (duration: 01m 49s) [production]
21:52 <crusnov@deploy1001> Started deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 part 3 [production]
21:42 <crusnov@deploy1001> Finished deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 part 2 (duration: 01m 33s) [production]
21:41 <crusnov@deploy1001> Started deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 part 2 [production]
21:40 <crusnov@deploy1001> Finished deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 (duration: 01m 01s) [production]
21:39 <crusnov@deploy1001> Started deploy [netbox/deploy@39c5cae]: Deploying Netbox 2.8.7 [production]
21:08 <cstone> payments-wiki revision changed from 91852dbc9b to bf91f8adff [production]
20:32 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable client error logging on Catalan Wikipedia (T258073) (duration: 00m 57s) [production]
19:32 <sbassett> Deployed mitigations for T257687 [production]
19:14 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T248418 TimedMediaHandler: Make videojs the only player on all group0 (duration: 00m 57s) [production]
18:54 <herron@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
18:53 <herron@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
18:50 <herron@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
18:49 <addshore> deployment windows finished with [production]
18:46 <addshore@deploy1001> Synchronized wmf-config/extension-list: [[gerrit:611393]] extension-list: Load WikibaseClient via JSON (duration: 00m 56s) [production]
18:36 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:613226]] Wikibase: Always set wgWBRepoSettings idGeneratorSeparateDbConnection PT 2/2 (duration: 00m 56s) [production]
18:35 <addshore@deploy1001> Synchronized wmf-config/Wikibase.php: [[gerrit:613226]] Wikibase: Always set wgWBRepoSettings idGeneratorSeparateDbConnection PT 1/2 (duration: 00m 56s) [production]
18:25 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:613165]] T138104 Wikibase: stop setting wmgWikibaseTmpSerializeEmptyListsAsObjects (duration: 00m 57s) [production]
18:23 <addshore@deploy1001> Synchronized wmf-config/config/incubatorwiki.yaml: [[gerrit:613199]] T256957 Move VisualEditor from beta to default on incubatorwiki PT2/2 (duration: 00m 57s) [production]
18:22 <addshore@deploy1001> Synchronized dblists/visualeditor-nondefault.dblist: [[gerrit:613199]] T256957 Move VisualEditor from beta to default on incubatorwiki PT1/2 (duration: 00m 56s) [production]
18:20 <addshore@deploy1001> Synchronized wmf-config/config/nlwikimedia.yaml: [[gerrit:613198]] T256142 Move VisualEditor from beta to default on nlwikimedia PT2/2 (duration: 00m 57s) [production]
18:18 <addshore@deploy1001> Synchronized dblists/visualeditor-nondefault.dblist: [[gerrit:613198]] T256142 Move VisualEditor from beta to default on nlwikimedia PT1/2 (duration: 00m 56s) [production]
18:14 <addshore@deploy1001> Synchronized wmf-config/Wikibase.php: [[gerrit:613164]] T138104 Wikibase: stop setting wgWBRepoSettings tmpSerializeEmptyListsAsObjects (duration: 00m 57s) [production]
18:12 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:613192]] T246420 Enable limited-width layout for Modern Vector (duration: 00m 56s) [production]
18:08 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:612870]] T246977 Disable affinity quicksurveys for the following wikis (duration: 00m 57s) [production]
18:03 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
18:03 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:54 <herron@cumin1001> START - Cookbook sre.ganeti.makevm [production]
17:53 <herron@cumin1001> START - Cookbook sre.ganeti.makevm [production]
17:50 <herron@cumin1001> START - Cookbook sre.ganeti.makevm [production]
17:50 <herron@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
17:49 <herron@cumin1001> START - Cookbook sre.ganeti.makevm [production]
17:17 <XioNoX> msw1-eqiad delete unused VC-ports [production]
17:05 <XioNoX> msw1-codfw - replace member-range with list of individual interfaces [production]
16:45 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Wikibase/: Backport: [[gerrit:613173|Re add OtherProjectsSidebarGenerator::buildProjectLinkSidebarFromItemId (T258184)]] (duration: 01m 02s) [production]
16:11 <effie> reboot rdb1009 - T254990 [production]
16:06 <effie> Reboot rdb1010 - T254990 [production]
15:51 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Wikibase/: Backport: [[gerrit:613170|Revert "Revert "Removes OtherProjectsSidebar hook"" (T258184)]] (duration: 01m 02s) [production]
15:40 <lucaswerkmeister-wmde@deploy1001> scap failed: average error rate on 7/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/e474f13ffac6b8c3bf919c4aeafc8c9b for details) [production]
15:15 <akosiaris> lower codfw mobileapps kubernetes traffic to 10% T218733. Will open up task for it [production]
15:15 <akosiaris@cumin1001> conftool action : set/weight=24; selector: dc=codfw,service=mobileapps,name=scb.* [production]
15:07 <XioNoX> repool eqsin - T257154 [production]