201-250 of 10000 results (25ms)
2019-01-14 §
07:48 <elukey> executed bmc-device --debug --cold-reset on dbstore1002 - "No more sessions available" for mgmt [production]
2019-01-13 §
16:33 <hoo> Updated operations/dumps/dcat (559dee37452..a86285f4e7) on snapshot1008 [production]
2019-01-12 §
21:46 <akosiaris> restart all zotero pods in eqiad [production]
16:12 <moritzm> rebooting mw2167 for a test [production]
02:16 <legoktm@deploy1001> Synchronized docroot/mediawiki.org/keys: Add Mukunda's new subkey that was used for the 1.32 release - T213521 (duration: 00m 47s) [production]
2019-01-11 §
21:56 <jforrester@deploy1001> Finished scap: Full scap sync to update wmf.12 i18n for the weekend Idf2a67860f (duration: 19m 12s) [production]
21:37 <jforrester@deploy1001> Started scap: Full scap sync to update wmf.12 i18n for the weekend Idf2a67860f [production]
18:43 <legoktm@deploy1001> Synchronized wmf-config/CommonSettings.php: Update ExtensionDistributor for 1.32 release - https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/483735 (duration: 00m 46s) [production]
18:07 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2060 T210713 (duration: 00m 46s) [production]
17:10 <marostegui> Deploy schema change on db2060 - T210713 [production]
16:55 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2060 T210713 (duration: 00m 46s) [production]
16:53 <marostegui> Defragment change_tag table on db2060 - T210713 [production]
14:51 <anomie@mwmaint1002> Running migrateActors.php on test wikis and mediawikiwiki for T188327. This may cause lag in codfw. [production]
14:37 <jynus> upgrade and restart db2091 (s2, s4) [production]
14:12 <jynus> updating mariadb client packages on cumin* hosts [production]
11:36 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: repool es1018 fully (duration: 00m 46s) [production]
11:21 <jynus> stop, upgrade and reboot es2017 [production]
11:04 <jynus> stop, upgrade and reboot es2016 [production]
10:51 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: repool es1018 with low load (duration: 00m 46s) [production]
10:31 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: repool es2013 (duration: 00m 45s) [production]
10:30 <jynus> upgrade and restart es1018 [production]
09:58 <jynus> upgrade and reboot es2013 [production]
09:53 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: depool es2013 (duration: 00m 45s) [production]
09:49 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: depool es2013 (duration: 00m 47s) [production]
09:32 <jynus> reset iLo on db2053 [production]
08:49 <moritzm> installing tmpreaper security updates [production]
02:40 <krinkle@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Ib87407165382 (duration: 00m 46s) [production]
01:20 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT T211993 Enable GrowthExperiments help panel for 50% of new users on cswiki and kowiki (duration: 00m 46s) [production]
01:05 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT T211993 Enable GrowthExperiments help panel on cswiki and kowiki (duration: 00m 45s) [production]
01:03 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.12/extensions/WikimediaEvents/includes/PageViews.php: SWAT: T213186 GrowthExperiments: Support templates for help desk title (duration: 00m 46s) [production]
00:50 <XioNoX> bump prefix limit for AS6939 in eqsin [production]
00:18 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.12/extensions/AbuseFilter/includes/AbuseFilterHooks.php: T213453: Use slot in onEditFilterMergedContent and newVariableHolderForEdit in AbuseFilter (duration: 00m 47s) [production]
00:12 <James_F> 482373 is live on mwdebug1002 for extensive checks. [production]
00:08 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT Help panel: Set help desk page correctly on kowiki Ia94cfc571 (duration: 00m 46s) [production]
2019-01-10 §
23:45 <Krinkle> krinkle@tunsten: upgrade xhgui to include upstream f039fb9f99f - T213218 [production]
23:45 <Krinkle> upgraded xhgui to upstream 2965240c91e52 (current upstream master) - T213218 [production]
23:36 <jforrester@deploy1001> Synchronized wmf-config/Wikibase.php: T213497 [Commons, TestCommons] Don't use Wikibase entity search (duration: 00m 46s) [production]
22:57 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.12/extensions/Wikibase/repo/includes/EditEntity/MediawikiEditFilterHookRunner.php: T213453: Pass slotrole into EditFilterMergedContent hook in Wikibase repo (duration: 00m 47s) [production]
20:47 <marxarelli> both mediawiki error rates and 500 response rates have subsided back to pre-deploy levels [production]
20:19 <marxarelli> seeing increase in "60 second timed out" error rate and rise in 503 rate, as was the case with group1 deployment. continuing to monitor [production]
20:11 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.12 [production]
20:11 <gehel> restart blazegraph on wdqs1009 to validate new config [production]
20:02 <tgr@deploy1001> Synchronized php-1.33.0-wmf.12/extensions/WikimediaEvents/modules/ve-wme/campaigns.js: SWAT: [[gerrit:483485|Remove unnecessary addPlugin wrapper (T213338)]] (duration: 00m 53s) [production]
19:50 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:481987|Remove AICaptcha settings (T186244)]] (duration: 00m 52s) [production]
19:47 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:468831|Whitelist *.*.archive.org in wgCopyUploadsDomains (T207581)]] (duration: 00m 53s) [production]
19:41 <tgr> ran mwscript namespaceDupes.php bnwikibooks --fix (238 links fixed) [production]
19:41 <volans> installed spicerack 0.0.12-1 on cumin2001 T205884 [production]
19:39 <volans> uploaded spicerack_0.0.12-1_amd64.deb to apt.wikimedia.org stretch-wikimedia T205884 [production]
19:39 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:458870|Note that namespaceDupes.php maintenance script run will be needed after the deployment. (T203534)]] (duration: 00m 53s) [production]
19:14 <marostegui> Deploy schema change on dbstore1001 - T85757 [production]