1-50 of 10000 results (17ms)
2020-04-15 ยง
22:11 <mholloway-shell@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/MachineVision: Fix: Initialize categories array for initial images (T250321) (duration: 01m 07s) [production]
21:48 <maryum> removing duplicate incdices from production ES clusters that were created when reindexing failed [production]
20:16 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@1907571]: Update mobileapps to ff34d0b5 (duration: 04m 57s) [production]
20:11 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@1907571]: Update mobileapps to ff34d0b5 [production]
19:53 <addshore> pool wdqs1006 caught up [production]
19:44 <addshore> depool wdqs1006 to catch up on lag [production]
19:04 <jforrester@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.28 (duration: 01m 05s) [production]
19:03 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.28 [production]
18:44 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: Idc81a885b2f3, T196309 (duration: 01m 07s) [production]
18:12 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-sync (duration: 01m 07s) [production]
18:10 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:589029|Fix GrowthExperiments helpdesk URL for frwiktionary (T235964)]] (duration: 01m 06s) [production]
16:08 <volker-e@deploy1001> Finished deploy [design/style-guide@a4d5794]: Deploy design/style-guide: (duration: 00m 11s) [production]
16:08 <volker-e@deploy1001> Started deploy [design/style-guide@a4d5794]: Deploy design/style-guide: [production]
15:46 <ejegg> updated fundraising CiviCRM from 18d7567cd7 to 1224b080c1 [production]
15:36 <ema> cp2029,cp3050: upgrade purged to 0.6, restart varnish-fe T249583 [production]
15:30 <ema> upload purged 0.6 to buster-wikimedia T249583 [production]
15:19 <papaul> upgrading firmware on restbase2014 [production]
14:36 <vgutierrez> rolling upgrade to ATS 8.0.7-rc0-1wm2 on cp[3064,3065,2042,2041,1090,1089] - T249335 [production]
14:32 <jforrester@deploy1001> Synchronized wmf-config/ProductionServices.php: Drop 'parsoidphp' service, we use 'parsoid' now (duration: 01m 06s) [production]
14:27 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Use 'parsoid' service in lieu of 'parsoidphp' (duration: 01m 07s) [production]
14:25 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 06s) [production]
14:23 <jforrester@deploy1001> Synchronized wmf-config/ProductionServices.php: Add 'parsoid' service to replace 'parsoidphp' (duration: 01m 06s) [production]
14:17 <jforrester@deploy1001> Synchronized wmf-config/wikitech.php: Use MediaWikiServices::getAuthManager on wikitech (duration: 01m 06s) [production]
14:14 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T242912 Remove wgEnablePartialBlocks config, no longer read (duration: 01m 07s) [production]
14:12 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: wmgExtraLanguageNames: Remove 'smn', supported by core since 1.35.0-wmf.26 (duration: 01m 06s) [production]
14:10 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 06s) [production]
14:09 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T250181 T250183 Wikibase: Use false instead of database names for 'local' entity sources on test wikis (duration: 01m 06s) [production]
14:02 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 05s) [production]
14:01 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop defining wmgMobileFrontend and wmgMinervaNeue, unread (duration: 01m 06s) [production]
13:59 <jforrester@deploy1001> Synchronized wmf-config/mobile.php: Stop reading wmgMobileFrontend and wmgMinervaNeue, always true (duration: 01m 06s) [production]
13:52 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Stop setting wgContentHandlerUseDB, now unread (duration: 01m 06s) [production]
13:32 <ema> upload varnish_5.1.3-1wm14 to buster-wikimedia T249810 [production]
13:26 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/Flow/Hooks.php: T248727 Adjust to RevisionUndeleted hook now having (duration: 01m 04s) [production]
13:25 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/LiquidThreads/classes/DeletionController.php: T248727 Adjust to RevisionUndeleted hook now having (duration: 01m 06s) [production]
13:23 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.28/includes/page/PageArchive.php: T248727 Fix RevisionUndeleted hook to add (duration: 01m 08s) [production]
13:23 <kormat@cumin1001> dbctl commit (dc=all): 'Increase db1114's weight to 100% of target, and reduce db1104 slightly T250224', diff saved to https://phabricator.wikimedia.org/P10990 and previous config saved to /var/cache/conftool/dbconfig/20200415-132310-kormat.json [production]
13:10 <hashar> contint2001: starting zuul-merger process # T224591 [production]
12:49 <kormat@cumin1001> dbctl commit (dc=all): 'Increase db1114's weight to 50% of target T250224', diff saved to https://phabricator.wikimedia.org/P10989 and previous config saved to /var/cache/conftool/dbconfig/20200415-124931-kormat.json [production]
12:41 <vgutierrez> rolling upgrade to ATS 8.0.7-rc0-1wm2 in ulsfo and eqsin - T249335 [production]
12:03 <mutante> puppetmaster1001: revoking ganeti01.svc.eqiad.wmnet and ganeti01.svc.codfw.wmnet certificates. adding eqiad and codfw to cergen .yaml file, recreating ganeti certs [production]
11:27 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:588701|Deploy Welcome Survey to Serbian Wikipedia and French Wiktionary (T249956)]] (double-sync) (duration: 01m 03s) [production]
11:26 <awight@deploy1001> sync-file aborted: SWAT: [[gerrit:588701|Deploy Welcome Survey to Serbian Wikipedia and French Wiktionary (T249956)]] (double-sync) (duration: 00m 02s) [production]
11:23 <awight> EU SWAT complete [production]
11:22 <awight@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/TwoColConflict: SWAT: [[gerrit:588966|Flatten exit logging (T248601)]] (duration: 01m 09s) [production]
11:09 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:588701|Deploy Welcome Survey to Serbian Wikipedia and French Wiktionary (T249956)]] (duration: 01m 24s) [production]
10:57 <marostegui> Deploy schema change on s8 codfw master - T250057 [production]
10:25 <ema> cp3050: varnish-frontend-restart to clear mbox lag and see how long it takes to show up T249583 [production]
10:02 <ema> upload purged 0.5 to buster-wikimedia T249583 [production]
09:50 <jynus@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
09:48 <jynus@cumin2001> START - Cookbook sre.hosts.downtime [production]