1651-1700 of 10000 results (65ms)
2019-12-12 §
05:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:56 <aborrero@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
05:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:47 <marostegui> Deploy schema change on db1102:3314 [production]
05:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1097:3314 after schema change T233135', diff saved to https://phabricator.wikimedia.org/P9861 and previous config saved to /var/cache/conftool/dbconfig/20191212-054708-marostegui.json [production]
03:25 <ejegg> updated fundraising internal dashboard from 3917f7d9dc to c1ded3c473 [production]
01:42 <volker-e@deploy1001> Finished deploy [design/style-guide@481eaf6]: Deploy design/style-guide: (duration: 00m 07s) [production]
01:41 <volker-e@deploy1001> Started deploy [design/style-guide@481eaf6]: Deploy design/style-guide: [production]
2019-12-11 §
23:42 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Add ability to load the DiscussionTools extension, disabled everywhere T240468 (duration: 01m 02s) [production]
23:30 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set wmgUseDiscussionTools false everywhere T240468 (duration: 01m 03s) [production]
23:19 <jforrester@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.10 (duration: 01m 02s) [production]
23:18 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.10 [production]
23:13 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/CentralNotice/includes/CentralNoticeHooks.php: T240505 Remove CentralNotice's used of deprecated jquery.ui module aliases (duration: 01m 25s) [production]
22:59 <cstone> civicrm revision changed from 7b971ac58c to 8c8aa0e6d3 [production]
22:08 <arlolra@deploy1001> Finished deploy [parsoid/deploy@5ba7506]: (no justification provided) (duration: 01m 51s) [production]
22:07 <arlolra@deploy1001> Started deploy [parsoid/deploy@5ba7506]: (no justification provided) [production]
22:04 <arlolra@deploy1001> Finished deploy [parsoid/deploy@5ba7506]: (no justification provided) (duration: 07m 13s) [production]
21:57 <arlolra@deploy1001> Started deploy [parsoid/deploy@5ba7506]: (no justification provided) [production]
21:40 <arlolra> Updated Parsoid to af576d5 (T237693, T238777, T237306, T239875, T240053) [production]
21:31 <arlolra@deploy1001> Finished deploy [parsoid/deploy@5ba7506]: Updating Parsoid to af576d5 (duration: 09m 12s) [production]
21:21 <arlolra@deploy1001> Started deploy [parsoid/deploy@5ba7506]: Updating Parsoid to af576d5 [production]
21:17 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 back to 1.34.0-wmf.8 [production]
21:16 <jforrester@deploy1001> sync-wikiversions aborted: group0 to 1.34.0-wmf.0 (duration: 00m 00s) [production]
20:39 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Remove testing group restriciton on commonswiki (duration: 01m 04s) [production]
20:36 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Show UploadWizard CTA on commonswiki (duration: 01m 03s) [production]
20:32 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Update labeling job delay to 48 hours (duration: 01m 05s) [production]
20:11 <jforrester@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.10 (duration: 01m 02s) [production]
20:10 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.10 [production]
19:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3314 for schema change T233135', diff saved to https://phabricator.wikimedia.org/P9858 and previous config saved to /var/cache/conftool/dbconfig/20191211-195306-marostegui.json [production]
19:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1103:3314 after schema change T233135', diff saved to https://phabricator.wikimedia.org/P9857 and previous config saved to /var/cache/conftool/dbconfig/20191211-195130-marostegui.json [production]
19:43 <awight> Morning SWAT complete [production]
19:43 <eileen> re-enabled dedupe (off from last night benevity import attempt) [production]
19:43 <eileen> process-control config revision is 8c073ae64a [production]
19:34 <awight@deploy1001> Synchronized php-1.35.0-wmf.8/extensions/Cite: SWAT: [[gerrit:556372|Lazily fetch user interface language to prevent cache split (take 2) (T240426, T239988)]] (duration: 00m 40s) [production]
19:33 <awight> Overriding scap canaries for T240426 [production]
19:24 <awight@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
19:18 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: eaa4c2c: Remove unused wmgCheckUserForceSummary (duration: 01m 01s) [production]
19:15 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (duration: 01m 02s) [production]
19:11 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (duration: 01m 02s) [production]
19:10 <urbanecm@deploy1001> sync-file aborted: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (T239936) (duration: 00m 02s) [production]
19:08 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 9ca31f4: Enable CheckUser Special:Investigate page on testwiki (T239936) (duration: 01m 02s) [production]
18:53 <mholloway-shell@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/MachineVision: Fix no-JS warning message (T240210) (duration: 01m 02s) [production]
16:43 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/Wikibase/lib/includes/Store/Sql/SqlEntityInfoBuilder.php: Consider any type of empty value as uncached in SqlEntityInfoBuilder (T237984) (duration: 01m 03s) [production]
16:39 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.8/extensions/Wikibase/lib/includes/Store/Sql/SqlEntityInfoBuilder.php: Consider any type of empty value as uncached in SqlEntityInfoBuilder (T237984) (duration: 01m 03s) [production]
16:28 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp1075.eqiad.wmnet,service=ats-be [production]
16:28 <ema> cp1075 ats-be: temporarily switch to plain HTTP for api and appservers (apache directly instead of nginx) [production]
16:24 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp1075.eqiad.wmnet,service=ats-be [production]
15:23 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'blubberoid' for release 'production' . [production]
15:21 <rzl@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'blubberoid' for release 'production' . [production]