|
2016-02-09
§
|
| 11:19 |
<paravoid> |
stopping pybal on lvs2002 |
[production] |
| 11:13 |
<legoktm> |
disabling puppet on all *(trusty|precise)* slaves |
[releng] |
| 11:05 |
<paravoid> |
installing linux-image-4.4.0 on lvs2005 and rebooting for testing |
[production] |
| 10:53 |
<apergos> |
salt minions on labs instances that respond to labcontrol1001 will be coming back up over the next 1/2 hour as puppet runs (salt master key fixes) |
[production] |
| 10:45 |
<elukey> |
disabled puppet, redis and memcached on mc1004 for jessie migration |
[production] |
| 10:33 |
<_joe_> |
pybal updated everywhere |
[production] |
| 10:32 |
<gehel> |
elasticsearch codfw: cleanup leftover logs /var/log/elasticsearch/*.[2-7] |
[production] |
| 10:25 |
<hashar> |
pooling in integration-slave-trusty-1018 |
[releng] |
| 10:24 |
<gehel> |
elasticsearch eqiad: cleanup leftover logs /var/log/elasticsearch/*.[2-7] |
[production] |
| 10:09 |
<_joe_> |
upgrading pybal on active nodes in esams and eqiad |
[production] |
| 10:04 |
<_joe_> |
depooling elastic1021.eqiad.wmnet as RAM has failed |
[production] |
| 09:56 |
<jynus> |
running table engine conversion script on db1069 (potential small lag on labs for 1 day) |
[production] |
| 09:40 |
<moritzm> |
restarted cassandra-a service on praseodymium |
[production] |
| 09:21 |
<ema> |
restarted hhvm on mw1132 |
[production] |
| 08:49 |
<_joe_> |
installing the new pybal package in esams and eqiad backups |
[production] |
| 08:23 |
<moritzm> |
restarted cassandra-a service on praseodymium |
[production] |
| 07:11 |
<_joe_> |
manually touched (with -h) the wmf-config/PrivateSettings.php symlink on all mw* hosts |
[production] |
| 07:02 |
<tgr@mira> |
Synchronized wmf-config/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 20s) |
[production] |
| 07:01 |
<tgr@mira> |
Synchronized private/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 19s) |
[production] |
| 03:19 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/269359 |
[releng] |
| 02:53 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/238988 |
[releng] |
| 01:58 |
<legoktm> |
added SMalyshev to wikidata-query gerrit group |
[production] |
| 01:34 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/extensions: https://gerrit.wikimedia.org/r/#/c/269344/ and https://gerrit.wikimedia.org/r/#/c/269293/1 (duration: 01m 51s) |
[production] |
| 01:27 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/extensions/OAuth/frontend/specialpages/SpecialMWOAuthManageConsumers.php: https://gerrit.wikimedia.org/r/#/c/269333/ (duration: 01m 19s) |
[production] |
| 01:24 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/resources/src: https://gerrit.wikimedia.org/r/#/c/269140/ (duration: 01m 19s) |
[production] |
| 00:54 |
<krenair@mira> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/266509/ (duration: 01m 17s) |
[production] |
| 00:52 |
<krenair@mira> |
Synchronized docroot/noc: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 17s) |
[production] |
| 00:50 |
<krenair@mira> |
Synchronized wmf-config/ProductionServices.php: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 18s) |
[production] |
| 00:42 |
<hashar> |
killed Zuul scheduler. On gallium edited /usr/share/python/zuul/local/lib/python2.7/site-packages/zuul/trigger/gerrit.py and modified: replication_timeout = 300 -> replication_timeout = 10 . Started Zuul |
[production] |
| 00:39 |
<hashar> |
gallium edited /usr/share/python/zuul/local/lib/python2.7/site-packages/zuul/trigger/gerrit.py and modified: replication_timeout = 300 -> replication_timeout = 10 |
[releng] |
| 00:37 |
<hashar> |
live hacking Zuul code to have it stop sleeping() on force merge |
[releng] |
| 00:36 |
<hashar> |
killing zuul |
[releng] |
| 00:26 |
<krenair@mira> |
Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) |
[production] |
| 00:24 |
<krenair@mira> |
Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) |
[production] |
| 00:17 |
<krenair@mira> |
Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 17s) |
[production] |
| 00:15 |
<krenair@mira> |
Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 16s) |
[production] |
|
2016-02-08
§
|
| 23:48 |
<legoktm> |
finally deploying https://gerrit.wikimedia.org/r/269327 |
[releng] |
| 23:30 |
<ori@mira> |
Synchronized php-1.27.0-wmf.12/includes/interwiki/Interwiki.php: ac6e170fa5: Fix-up for I5a979f047031e (duration: 01m 18s) |
[production] |
| 23:24 |
<bd808@mira> |
Synchronized wmf-config/logging.php: logging: Collect mw1017 logs for debugging (9d6d0e0) (duration: 01m 18s) |
[production] |
| 23:20 |
<bd808@mira> |
Synchronized wmf-config/logging.php: logging: Send all udp2log eligible messages to $wmgDefaultMonologHandler (cd25586) (duration: 01m 17s) |
[production] |
| 23:16 |
<bd808@mira> |
Synchronized wmf-config/logging.php: Monolog: Add mwversion to udp2log log events (9b54967) (duration: 01m 18s) |
[production] |
| 23:14 |
<hashar> |
zuul promote --pipeline gate-and-submit --changes 269065,2 https://gerrit.wikimedia.org/r/#/c/269065/ |
[releng] |
| 23:10 |
<hashar> |
pooling integration-slave-precise-1001 1002 1004 |
[releng] |
| 23:04 |
<bd808@mira> |
Synchronized wmf-config/logging.php: Monolog: normalize messages before PSR3 expansion (e5ee5d8) (duration: 01m 18s) |
[production] |
| 22:52 |
<ori@mira> |
Synchronized wmf-config/missing.php: Ib5407c560: Update missing.php for interwiki.php (duration: 01m 18s) |
[production] |
| 22:51 |
<ori@mira> |
Synchronized docroot and w: Ifd7fe8c3c: createTxtFileSymlinks.sh: drop interwiki.cdb; add interwiki.php (duration: 01m 21s) |
[production] |
| 22:47 |
<hashar> |
Err need to reboot newly provisioned instances before adding them to Jenkins (kernel upgrade,apache restart etc) |
[releng] |
| 22:45 |
<hashar> |
Pooled https://integration.wikimedia.org/ci/computer/integration-slave-precise-1003/ |
[releng] |
| 22:43 |
<bd808@mira> |
Synchronized php-1.27.0-wmf.12/includes/debug/logger/monolog/WikiProcessor.php: Add $wgVersion to MediaWiki\Logger\Monolog\WikiProcessor (3cea726) (duration: 01m 19s) |
[production] |
| 22:25 |
<hashar> |
integration-slave-precise-{1001-1004} applied role::ci::slave::labs, running puppet in slaves. I have added the instances as Jenkins slaves and put them offline. Whenever puppet is done, we can mark them online in Jenkins then monitor the jobs running on them are working properly |
[releng] |