|
2015-08-25
§
|
| 07:11 |
<_joe_> |
stopping redis on rdb1003,4, wiping AOF, restarting |
[production] |
| 06:38 |
<jynus> |
performing schema change on officewiki, mediawikiwiki and metawiki |
[production] |
| 02:21 |
<l10nupdate@tin> |
Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 06m 26s) |
[production] |
| 01:48 |
<ottomata> |
starting move of kafka partitions for topic webrequest_upload to new brokers. this will take a while! |
[production] |
| 01:43 |
<ottomata> |
restarting kafka on new brokers kafka1013,1014,1020 to apply increase in num.replica.fetchers |
[production] |
| 00:58 |
<bd808> |
Updated tin:/srv/deployment/integration/slave-scripts to b287e93 (Revert "Run mw-install-mysql.sh with statement tracing") and synced via trebuchet |
[releng] |
|
2015-08-24
§
|
| 23:46 |
<mattflaschen@tin> |
Synchronized wmf-config: Remove wgFlowOccupyPages (duration: 00m 12s) |
[production] |
| 23:38 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/233636/ (duration: 00m 12s) |
[production] |
| 23:36 |
<bd808> |
Updated tin:/srv/deployment/integration/slave-scripts to a2cdf4f (Run mw-install-mysql.sh with statement tracing) and synced via trebuchet |
[releng] |
| 22:29 |
<andrewbogott> |
cold-migrating ores-web-02 to labvirt1004. |
[ores] |
| 22:16 |
<tgr@tin> |
Synchronized wmf-config/CommonSettings-labs.php: change OAuth DB on beta +enable writes (duration: 00m 12s) |
[production] |
| 21:55 |
<tgr@tin> |
Synchronized wmf-config/CommonSettings-labs.php: set beta OAuth to readonly (duration: 00m 13s) |
[production] |
| 21:54 |
<tgr@tin> |
Synchronized wmf-config/CommonSettings-labs.php: set beta OAuth to readonly (duration: 00m 13s) |
[production] |
| 21:51 |
<tgr> |
migrating OAuth to metawiki on beta - T108648 |
[releng] |
| 21:42 |
<akosiaris> |
enabled puppet on maps-test200{1,2,3,4}.codfw.wmnet |
[production] |
| 20:51 |
<bd808> |
Restarted puppetmaster on integration-puppetmaster |
[releng] |
| 20:47 |
<bd808> |
Ran sudo apt-get install hhvm hhvm-dev on integration-slave-trusty-1016 to get hhvm 3.6.5+dfsg1-1+wm3 |
[releng] |
| 20:21 |
<arlolra> |
updated Parsoid to version 0b2fbae7 |
[production] |
| 18:58 |
<bblack> |
reloading primary LVS pybals for BlankPage change ( https://gerrit.wikimedia.org/r/#/c/233053/ ) + ulimit fixup ( https://gerrit.wikimedia.org/r/#/c/233484/ ) |
[production] |
| 18:34 |
<matt_flaschen> |
Completed on Beta Cluster: foreachwiki populateContentModel.php --ns=all --table=page | tee populateContentModel_page_table_all_namespaces_all_wikis_2015-08-24.log |
[releng] |
| 18:31 |
<bblack> |
reloading backup LVS pybals for BlankPage change ( https://gerrit.wikimedia.org/r/#/c/233053/ ) |
[production] |
| 18:24 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/233480 |
[releng] |
| 18:23 |
<matt_flaschen> |
Running on Beta Cluster: foreachwiki populateContentModel.php --ns=all --table=page | tee populateContentModel_page_table_all_namespaces_all_wikis_2015-08-24.log |
[releng] |
| 17:31 |
<YuviPanda> |
deleted instance staging-mc3, redundant and should help provide space on labvirt1007 |
[staging] |
| 17:19 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC settings |
[production] |
| 17:05 |
<YuviPanda> |
kill instance android-build to make space on labvirt1007 (android-builder is the successor) |
[mobile] |
| 16:37 |
<valhallasw`cloud> |
more processes were started, so added a talk page message on [[User:Coet]] (who was starting the processes according to /var/log/auth.log) and using 'write coet' on tools-bastion-01 |
[tools] |
| 16:23 |
<bd808@tin> |
Purged l10n cache for 1.26wmf18 |
[production] |
| 16:23 |
<bd808@tin> |
Purged l10n cache for 1.26wmf17 |
[production] |
| 16:15 |
<valhallasw`cloud> |
kill -9'ing because normal killing doesn't work |
[tools] |
| 16:13 |
<valhallasw`cloud> |
killing all processes of tools.cobain which are flooding tools-bastion-01 |
[tools] |
| 16:05 |
<andrewbogott> |
rebooting labnet1001 |
[production] |
| 15:53 |
<_joe_> |
restarted nutcracker on mw1010, holding a 150 GB deleted logfile |
[production] |
| 15:47 |
<Krenair> |
running sync-common on mw1010 to bring it up to date after clearing some space |
[production] |
| 15:44 |
<krenair@tin> |
Purged l10n cache for 1.26wmf16 |
[production] |
| 15:41 |
<krenair@tin> |
Purged l10n cache for 1.26wmf15 |
[production] |
| 15:38 |
<krenair@tin> |
Synchronized php-1.26wmf19/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/233411/1 (duration: 00m 49s) |
[production] |
| 15:37 |
<hashar> |
stopped and restarted Zuul |
[production] |
| 15:31 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/232919/ and https://gerrit.wikimedia.org/r/#/c/232915/ (duration: 01m 34s) |
[production] |
| 15:29 |
<krenair@tin> |
Synchronized w/static/images/project-logos/knwikiquote.png: https://gerrit.wikimedia.org/r/#/c/232919/ (duration: 02m 04s) |
[production] |
| 15:23 |
<hashar> |
hard rebooting integration-slave-trusty-1017 |
[releng] |
| 15:19 |
<Krenair> |
No space left on mw1010, cannot ping or ssh to mw2180 |
[production] |
| 15:19 |
<hashar> |
hard rebooting integration-slave-trusty-1014 |
[releng] |
| 15:16 |
<krenair@tin> |
Synchronized docroot/noc/db.php: https://gerrit.wikimedia.org/r/#/c/232920/ (duration: 01m 34s) |
[production] |
| 15:16 |
<hashar> |
apt-get upgrade all Trusty slaves |
[releng] |
| 15:14 |
<hashar> |
apt-get upgrade on gallium |
[releng] |
| 15:14 |
<hashar> |
apt-get upgrade on gallium |
[production] |
| 15:12 |
<hashar> |
integration-slave-precise-1011 and integration-slave-precise-1014 went offline due to elasticsearch not starting properly. https://phabricator.wikimedia.org/T109497 |
[releng] |
| 15:06 |
<hashar> |
upgrading packages on precise slaves |
[releng] |
| 14:48 |
<andrewbogott> |
forcing wikitech logouts in order to flush everyone’s service catalog |
[production] |