7201-7250 of 10000 results (55ms)
2017-03-20 §
15:34 <dcausse@tin> Synchronized wmf-config/CommonSettings.php: T157479 [es5 upgrade] step 3: depool eqiad for writes (1/3) (duration: 00m 45s) [production]
15:15 <hashar@tin> Synchronized php-1.29.0-wmf.16/extensions/Translate: ElasticTTM: set the index when deleting docs (duration: 00m 53s) [production]
15:08 <hashar@tin> Synchronized php-1.29.0-wmf.16/includes/specials/SpecialWatchlist.php: Restoring Watchlist: Fix form and preference overriding https://gerrit.wikimedia.org/r/#/c/343433/ (duration: 00m 51s) [production]
14:36 <hashar@tin> Synchronized php-1.29.0-wmf.16/includes/specials/SpecialAllPages.php: Disable SpecialAllPages on all wikis. Temporary workaround (duration: 01m 08s) [production]
14:36 <hashar> Disabled [[Special:AllPages]] on all wikis making it spurts a blank page instead. ( https://gerrit.wikimedia.org/r/#/c/343647/ ) [production]
14:32 <akosiaris> disable puppet on all rdb* nodes to shepherd https://gerrit.wikimedia.org/r/343027 into production. T159850 [production]
14:28 <elukey> (Correct one) Temporary hack for T160888 - moved /srv/mw-log/archive/api.log-20170224.gz to /srv/mw-log/archive/api_log_backup_elukey/ to avoid rsync timeouts to stat1002 (the file is big and close to being deleted for retention) [production]
14:27 <elukey> Temporary hack for T160886 - moved /srv/mw-log/archive/api.log-20170224.gz to /srv/mw-log/archive/api_log_backup_elukey/ to avoid rsync timeouts to stat1002 (the file is big and close to being deleted for retention) [production]
14:22 <hashar@tin> Synchronized php-1.29.0-wmf.16/includes/specials/SpecialWatchlist.php: reverts commit SpecialWatchlist.php 0d675d29d925bda7b42958f99b5e3cac3f78c8a3 (duration: 00m 43s) [production]
13:55 <jynus> shutting down es2015 for maintenance T160242 [production]
13:41 <zfilipin@tin> Synchronized wmf-config/: SWAT: [[gerrit:343592|Enable CollaborationKit on beta enwiki (T138325)]] (duration: 00m 44s) [production]
13:35 <zfilipin@tin> Synchronized php-1.29.0-wmf.16/tests/phpunit/includes/specials/SpecialWatchlistTest.php: SWAT: [[gerrit:343433|Watchlist: Fix form and preference overriding (T160734)]] (duration: 00m 48s) [production]
13:34 <zfilipin@tin> Synchronized php-1.29.0-wmf.16/includes/specials/SpecialWatchlist.php: SWAT: [[gerrit:343433|Watchlist: Fix form and preference overriding (T160734)]] (duration: 01m 01s) [production]
11:39 <akosiaris> return rdb1007 client-output-buffer-limit config to initially configured value T159850 [production]
10:09 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1094 after crash (duration: 00m 47s) [production]
09:42 <godog> swift bump ms-be2028 -> ms-be2039 weight - T158337 [production]
09:37 <jynus> restarting db1094 for upgrade [production]
09:02 <dcausse> refreshing ttm documents in elastic@codfw [production]
08:47 <hashar> Jenkins: depooling / deleting Precise instances. T158652 [production]
08:28 <dcausse> cirrus: refreshing all comp sugggest indices in elastic@codfw [production]
02:23 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Mar 20 02:23:38 UTC 2017 (duration 5m 25s) [production]
02:18 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.16) (duration: 06m 44s) [production]
2017-03-19 §
18:40 <ariel@tin> Finished deploy [dumps/dumps@8cff500]: generate json status files for use by downloaders (duration: 00m 02s) [production]
18:39 <ariel@tin> Started deploy [dumps/dumps@8cff500]: generate json status files for use by downloaders [production]
10:43 <ariel@tin> Finished deploy [dumps/dumps@87d748b]: dump magic words and namespace info (duration: 00m 02s) [production]
10:43 <ariel@tin> Started deploy [dumps/dumps@87d748b]: dump magic words and namespace info [production]
02:24 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Mar 19 02:24:53 UTC 2017 (duration 5m 23s) [production]
02:19 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.16) (duration: 07m 29s) [production]
2017-03-18 §
20:16 <chasemp> labstore1005 service nfs-exportd restart [production]
19:43 <chasemp> test on labstore1004 nfs-exportd candidate /root/nfs-exportd-candidate.py --observer-pass xxxxxx --interval 0 --config-path /etc/nfs-mounts.yaml --exports-d-path /root/fake_export/ --debug [production]
18:38 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 after crash (duration: 01m 02s) [production]
18:20 <jynus> powercycling db1094 [production]
02:36 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Mar 18 02:36:00 UTC 2017 (duration 5m 23s) [production]
02:30 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.16) (duration: 11m 29s) [production]
00:06 <mutante> lists: creating new list wikimedia-nys (Noongar language) (T159499) [production]
2017-03-17 §
23:48 <mutante> lists: creating new list wikispecies-admin (T159625) [production]
23:36 <catrope@tin> Synchronized php-1.29.0-wmf.16/extensions/VisualEditor/lib/ve: Fixes for T154123 T160479 T160190 T160197 (duration: 00m 42s) [production]
23:30 <mutante> lists: making Steinsplitter and Zhuyifei1999 list admins of commons-poty (T160672) [production]
16:16 <elukey> reimage restbase-dev1001.eqiad.wmnet [production]
14:01 <marostegui> Deploy schema change on dbstore1001 and db2051 (s4) - T160415 - T73563 [production]
14:00 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2051 - T160415 - T73563 (duration: 00m 42s) [production]
13:39 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2058 - T160415 - T73563 (duration: 01m 06s) [production]
12:46 <chasemp> labsdb10[01|03] maintain-views --table user_groups --all-database --replace-all --debug [production]
12:44 <chasemp> labsdb10[09|10|11] maintain-views --table user_groups --all-database --replace-all --debug [production]
11:33 <elukey> reimage analytics1044 (Hadoop Worker node) to Debian Jessie [production]
10:58 <akosiaris> reimage helium.eqiad.wmnet to jessie [production]
09:04 <jynus> killing 11h-running query on db1089 from terbium (orphan process) [production]
08:32 <marostegui> Deploy schema change on dbstore2002 and db2058 (s4) - T160415 T73563 [production]
08:31 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2058 - T160415 - T73563 (duration: 00m 43s) [production]
08:00 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2065 - T160415 - T73563 (duration: 00m 44s) [production]