701-750 of 10000 results (25ms)
2020-06-25 §
00:48 <twentyafterfour> restart php-fpm on phab1001 to fix T256343 [production]
00:12 <twentyafterfour> phabricator updated, all seems normal [production]
00:11 <twentyafterfour> updating phabricator to release/2020-06-25/1, momentary (<1 minute) downtime expected. [production]
2020-06-24 §
23:44 <mutante> releases2002 - systemctl stop jenkins, kill 15244 (rogue jenkins process), start jenkins with systemctl start jenkins (T247652) [production]
23:43 <mutante> releases1002 - kill rogue jenkins process, start jenkins with systemctl start jenkins (T247652) [production]
23:02 <mutante> releases1002/2002 - disabling puppet, removing failing cron job to pull deployment_charts (because /srv/deployment-charts does not exist yet) [production]
21:45 <shdubsh> install mtail 3.0.0~rc35+wmf2 on logstash1007 - T255776 [production]
20:42 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.38 (duration: 01m 06s) [production]
20:41 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.38 [production]
20:41 <brennen> train 1.35.0-wmf.38: attempting to roll forward to group1 after php-fpm restart on mw1287 (T256305, T254175) [production]
20:32 <cdanis> restarting php-fpm on mw1287 T256305 [production]
20:32 <bsitzmann@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
20:30 <bsitzmann@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
20:28 <bsitzmann@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
20:14 <halfak@deploy1001> Finished deploy [ores/deploy@1b87365]: T254505 (duration: 14m 08s) [production]
20:09 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@80c763d]: Update mobileapps to a413db4f (duration: 03m 37s) [production]
20:06 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@80c763d]: Update mobileapps to a413db4f [production]
20:00 <halfak@deploy1001> Started deploy [ores/deploy@1b87365]: T254505 [production]
19:38 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert Migrate SearchSatisfaction from EventLogging to EventGate on group1 - T249261 (duration: 01m 06s) [production]
19:17 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert group1 wikis to 1.35.0-wmf.37 [production]
19:11 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.38 (duration: 01m 04s) [production]
19:10 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.38 [production]
19:01 <brennen> train 1.35.0-wmf.38: finished triage meeting, clear to proceed to group 1 (T254175) [production]
18:53 <joal@deploy1001> Finished deploy [analytics/refinery@1112749] (thin): Regular analytics weekly train THIN [analytics/refinery@1112749] (duration: 00m 09s) [production]
18:53 <joal@deploy1001> Started deploy [analytics/refinery@1112749] (thin): Regular analytics weekly train THIN [analytics/refinery@1112749] [production]
18:53 <joal@deploy1001> Finished deploy [analytics/refinery@1112749]: Regular analytics weekly train [analytics/refinery@1112749] (duration: 05m 50s) [production]
18:49 <Urbanecm> Morning B&C deploy window is done [production]
18:48 <cstone> payments-wiki revision changed from 28ad76dcd7 to 91852dbc9b [production]
18:47 <Urbanecm> mwscript namespaceDupes.php --wiki=guwiki --fix (T255358) [production]
18:47 <joal@deploy1001> Started deploy [analytics/refinery@1112749]: Regular analytics weekly train [analytics/refinery@1112749] [production]
18:46 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 2a1dfc5: Set namespace aliases for guwiki (T255358) (duration: 01m 05s) [production]
18:42 <Urbanecm> mwscript namespaceDupes.php --wiki=banwiki --add-prefix=T255941 --fix (T255941) [production]
18:41 <Urbanecm> Run mwscript namespaceDupes.php --wiki=banwiki --fix (T255941) [production]
18:41 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: c6d6c85: Set WP as a NS_PROJECT alias for banwiki (T255941) (duration: 01m 06s) [production]
18:38 <Urbanecm> Run mwscript namespaceDupes.php dewiktionary --fix (T256242) [production]
18:38 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 2b93e0f: Define Rekonstruktion NS for dewiktionary (T256242) (duration: 01m 05s) [production]
18:29 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: dea9214: Revert "IS: Cleanup some redundant rows." (T256279) (duration: 01m 05s) [production]
18:25 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventBus: Emit kafka purges for everything gerrit:607298 (duration: 01m 05s) [production]
18:19 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable MediaModeration on group0 gerrit:607327 (duration: 01m 04s) [production]
18:08 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable click tracking in Vector on beta cluster gerrit:607136 IS.php (duration: 01m 05s) [production]
18:06 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Enable click tracking in Vector on beta cluster gerrit:607136 IS-labs.php (duration: 01m 07s) [production]
17:31 <elukey> update archiva-ci user's password in Jenkins credentials plugin [production]
16:56 <elukey> update archiva-deploy user's password in Jenkins credentials plugin [production]
16:46 <ppchelko@deploy1001> Finished deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, feeds timed out, redo (duration: 05m 11s) [production]
16:41 <ppchelko@deploy1001> Started deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, feeds timed out, redo [production]
16:40 <ppchelko@deploy1001> Finished deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, take 2 (duration: 14m 11s) [production]
16:34 <brennen@deploy1001> Finished scap: (no justification provided) (duration: 60m 22s) [production]
16:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:27 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:26 <ppchelko@deploy1001> Started deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, take 2 [production]