301-350 of 10000 results (25ms)
2017-09-14 §
17:18 <eevans@tin> Started restart [electron-render/deploy@8dd5f13]: (no justification provided) [production]
17:16 <gehel@tin> Finished deploy [wikimedia/discovery/analytics@ab5d5c1]: moving discovery/analytics to scap3 (duration: 00m 04s) [production]
17:16 <gehel@tin> Started deploy [wikimedia/discovery/analytics@ab5d5c1]: moving discovery/analytics to scap3 [production]
16:59 <krinkle@tin> Synchronized php-1.30.0-wmf.17/extensions/NavigationTiming: T104902 (duration: 01m 00s) [production]
15:51 <bblack> repool cp1063 (after wiping varnish storage + restarting all 3x main service daemons) [production]
15:51 <bblack> cp1064 backend restart, mailbox lag [production]
15:46 <bblack> depool cp1063 (upload eqiad) - seems to be having some iowait issues? [production]
14:07 <dereckson@tin> Synchronized php-1.30.0-wmf.18/extensions/CheckUser/specials/SpecialCheckUser.php: Fix Special cu for ip ranges (temp) (T175898) (duration: 00m 49s) [production]
13:34 <dcausse@tin> Synchronized wmf-config/CirrusSearch-production.php: Setup Cirrus MLR models for top 20 language AB test (duration: 00m 49s) [production]
13:33 <dcausse@tin> Synchronized wmf-config/CirrusSearch-common.php: Setup Cirrus MLR models for top 20 language AB test (duration: 00m 48s) [production]
13:31 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: Setup Cirrus MLR models for top 20 language AB test (duration: 00m 50s) [production]
11:14 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Remove all references to db1049, pool db1100 (duration: 00m 49s) [production]
11:12 <akosiaris> upload apertium-crh-tur_0.2.0~r81866-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
11:12 <jynus@tin> Synchronized wmf-config/db-codfw.php: Remove all references to db1049 (duration: 00m 50s) [production]
09:51 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: name=wtp1025.eqiad.wmnet [production]
09:43 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: name=wtp1025.eqiad.wmnet [production]
09:43 <akosiaris@puppetmaster1001> conftool action : set/weight=1; selector: name=wtp1025.eqiad.wmnet [production]
09:41 <gehel> re-enabling puppet on all cassandra nodes - T171704 [production]
09:41 <akosiaris@tin> Finished deploy [parsoid/deploy@cec7d17]: test deploy using dsh groups. T165520 (duration: 09m 30s) [production]
09:32 <akosiaris@tin> Started deploy [parsoid/deploy@cec7d17]: test deploy using dsh groups. T165520 [production]
09:02 <akosiaris@tin> Finished deploy [parsoid/deploy@cec7d17]: test deploy using dsh groups. T165520 (duration: 02m 25s) [production]
09:00 <akosiaris@tin> Started deploy [parsoid/deploy@cec7d17]: test deploy using dsh groups. T165520 [production]
08:13 <gehel> merging cassandra refactoring for puppet - T171704 [production]
02:55 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Sep 14 02:55:10 UTC 2017 (duration 7m 28s) [production]
02:47 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.18) (duration: 07m 58s) [production]
02:27 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.17) (duration: 09m 27s) [production]
00:46 <MaxSem> restarted populateIpChanges to use updated code [production]
00:26 <twentyafterfour> everything appears to be up and running. Phabricator upgrade complete. [production]
00:23 <twentyafterfour> running puppet on phab1001 to restore files which get lost by scap deploy [production]
00:21 <twentyafterfour@tin> Finished deploy [phabricator/deployment@7e3a0a8]: (no justification provided) (duration: 00m 01s) [production]
00:21 <twentyafterfour@tin> Started deploy [phabricator/deployment@7e3a0a8]: (no justification provided) [production]
00:21 <twentyafterfour@tin> Finished deploy [phabricator/deployment@7e3a0a8]: (no justification provided) (duration: 00m 25s) [production]
00:20 <twentyafterfour@tin> Started deploy [phabricator/deployment@7e3a0a8]: (no justification provided) [production]
00:18 <twentyafterfour> Begin phabricator upgrade #phab-2017-09-13 [production]
2017-09-13 §
23:48 <dereckson@tin> Synchronized php-1.30.0-wmf.18/maintenance/populateIpChanges.php: Improve ip_changes update script to insert rows in batches ([[Gerrit:377918]]) (duration: 00m 49s) [production]
23:29 <dereckson@tin> Synchronized php-1.30.0-wmf.18/extensions/Wikidata/extensions/Wikibase/client: Split page set before constructing InjectRCRecordsJob (T175316) (duration: 00m 57s) [production]
23:28 <dereckson@tin> Synchronized php-1.30.0-wmf.18/extensions/Echo/modules/api/mw.echo.api.APIHandler.js: (no justification provided) (duration: 00m 48s) [production]
23:26 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Set $wgScoreSafeMode to false (T174413) (duration: 00m 50s) [production]
22:06 <maxsem@tin> Synchronized php-1.30.0-wmf.18/extensions/EventBus/: https://gerrit.wikimedia.org/r/#/c/377900/1 (duration: 00m 49s) [production]
22:03 <maxsem@tin> Synchronized php-1.30.0-wmf.18/extensions/ArticleCreationWorkflow/: https://gerrit.wikimedia.org/r/#/c/377900/1 (duration: 00m 49s) [production]
21:55 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/377874/ (duration: 00m 47s) [production]
21:23 <ejegg> updated payments-wiki from ed2e4811067ad3d74433e8d7f4944ae838af6e28 to 26b16eadc119e3edddec83ac0e680ac60c43ecaf [production]
21:16 <MaxSem|grrrr> populating ip_changes on group1 wikis [production]
20:43 <bblack> re-routed ulsfo->eqiad around possible codfw damage as well - https://gerrit.wikimedia.org/r/#/c/377871/ [production]
20:34 <bblack> deployed https://gerrit.wikimedia.org/r/#/c/377845/ (no gerrit bot, jenkins lint failing, etc) due to possible codfw routing issues [production]
19:39 <andrewbogott> rebooting labtestvirt2001 [production]
19:35 <ppchelko@tin> Finished deploy [changeprop/deploy@86e8103]: Separate kafka metrics by rule (duration: 01m 18s) [production]
19:34 <ppchelko@tin> Started deploy [changeprop/deploy@86e8103]: Separate kafka metrics by rule [production]
19:21 <urandom> T172384: Upgrading restbase-dev100[5-6] to Cassandra 3.11.0-wmf4 [production]
19:19 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.18 [production]