|
2015-04-02
§
|
| 14:51 |
<hashar> |
applying role::ci::slave::labs::common on integration-slave-jessie-1001 |
[releng] |
| 14:49 |
<hashar> |
integration: nice thing, newly created instances are automatically made to point to integration-pummetmaster via hiera! Just have to sign the certificate on the master using: puppet ca list ; puppet ca sign i-000xxxx.eqiad.wmflabs |
[releng] |
| 14:42 |
<hashar> |
Created [[Nova_Resource:I-00000a3b.eqiad.wmflabs|integration-slave-jessie-1001]] to try out CI slave on Jessie ([[T94836]]) |
[releng] |
| 14:13 |
<hashar> |
Jenkins: migrated Zuul cloner on Precise labs slaves (100[1-4] to a version provided by a Debian package. Jobs console output should now shows <tt>Zuul version: 2.0.0-304-g685ca22-wmf1precise1</tt> |
[production] |
| 14:11 |
<hashar> |
reduced integration-slave1004 executors from 6 to 5 to make it on par with the other precise slaves |
[releng] |
| 14:10 |
<hashar> |
integration-slave100[1-4] are now using Zuul provided by a Debian package as of https://gerrit.wikimedia.org/r/#/c/195272/ PS 16 |
[releng] |
| 14:04 |
<hashar> |
uninstall the pip installed zuul version from Precise labs slaves by doing: pip uninstall zuul && rm /usr/local/bin/zuul* . Switching them all to a Debian package |
[releng] |
| 13:45 |
<hashar> |
pooling back integration-slave1001 and 1002 which are using zuul-cloner provided by a debian package |
[releng] |
| 13:35 |
<hashar> |
reloading Jenkins configuration files from disk to make it knows about a change manually applied to most jobs config.xml files for https://gerrit.wikimedia.org/r/#/c/201451/ |
[releng] |
| 13:01 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/201458 |
[releng] |
| 12:51 |
<andrewbogott> |
restarted opendj, pdns on neptunium, nembus, virt1000, labcontrol2001 |
[production] |
| 12:48 |
<paravoid> |
repooling esams |
[production] |
| 12:42 |
<paravoid> |
upgrading junos on mr1-esams |
[production] |
| 12:19 |
<hashar> |
preventing job to run on integration-slave1001 by replacing its label with 'DoNotLabelThisSlaveHashar'. Going to install Zuul debian package on it |
[releng] |
| 12:15 |
<mark> |
Shutting down cp3014 for 10G upgrade |
[production] |
| 11:02 |
<mark> |
Shutting down cp3012 for 10G upgrade |
[production] |
| 10:38 |
<_joe_> |
stopping pybal on lvs2003, running manually to help debugging |
[production] |
| 09:43 |
<paravoid> |
asw-d-eqiad: routing-engine backup switch FPC 8 -> FPC 4 |
[production] |
| 09:42 |
<paravoid> |
asw-d-eqiad: routing-engine backup switch FPC 7 -> FPC 5, master switchover FPC 8 -> FPC 5 |
[production] |
| 09:37 |
<hashar> |
rebooting integration-zuul-server homedir seems to be stalled/missing |
[releng] |
| 08:31 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Apr 2 08:30:42 UTC 2015 (duration 30m 41s) |
[production] |
| 08:12 |
<hashar> |
upgrading packages on integration-dev |
[releng] |
| 07:48 |
<springle> |
on sync-file from tin: mw2213.codfw.wmnet returned [255]: Host key verification failed |
[production] |
| 07:46 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1027, warm up (duration: 00m 11s) |
[production] |
| 06:41 |
<bblack> |
re-depooled esams ... |
[production] |
| 06:34 |
<Jamesofur> |
manually merged Ximilian global account per request and account confirmation |
[production] |
| 06:13 |
<bblack> |
re-pooling esams (GTT event never happened AFAICS) |
[production] |
| 05:14 |
<greg-g> |
and right when I log'd that, things seem to be recovering |
[releng] |
| 05:13 |
<springle> |
xtrabackup clone db1027 to db1035 |
[production] |
| 05:12 |
<greg-g> |
the shinken alerts about beta cluster issues are due to wmflabs having issues. |
[releng] |
| 03:45 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1027 (duration: 00m 11s) |
[production] |
| 03:32 |
<springle> |
reinstall db1035, reclone data |
[production] |
| 03:18 |
<LocalisationUpdate> |
completed (1.25wmf24) at 2015-04-02 03:08:52+00:00 |
[production] |
| 03:03 |
<l10nupdate> |
Synchronized php-1.25wmf24/cache/l10n: (no message) (duration: 08m 55s) |
[production] |
| 02:41 |
<l10nupdate> |
Synchronized php-1.25wmf23/cache/l10n: (no message) (duration: 08m 56s) |
[production] |
| 02:06 |
<legoktm> |
set email for TheFons@global and attached nlwiki |
[production] |
| 00:03 |
<krenair> |
Synchronized php-1.25wmf24/extensions/OpenStackManager/nova/OpenStackNovaHost.php: https://gerrit.wikimedia.org/r/201386 (duration: 00m 12s) |
[production] |
| 00:01 |
<krenair> |
Synchronized php-1.25wmf23/extensions/OpenStackManager/nova/OpenStackNovaHost.php: https://gerrit.wikimedia.org/r/201385 (duration: 00m 13s) |
[production] |
|
2015-04-01
§
|
| 23:59 |
<bblack> |
depooling esams ahead of 2h planned GTT link outage coming up in 1h |
[production] |
| 23:41 |
<krenair> |
Synchronized wmf-config: https://gerrit.wikimedia.org/r/200098 (duration: 00m 12s) |
[production] |
| 23:37 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/201374/ (duration: 00m 12s) |
[production] |
| 23:35 |
<krenair> |
Synchronized php-1.25wmf24/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/201360/ (duration: 00m 13s) |
[production] |
| 23:33 |
<krenair> |
Synchronized php-1.25wmf24/extensions/Flow/modules/editor/editors/visualeditor/ext.flow.editors.visualeditor.js: https://gerrit.wikimedia.org/r/#/c/201360/ (duration: 00m 11s) |
[production] |
| 23:29 |
<krenair> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/201093/ (duration: 00m 12s) |
[production] |
| 23:23 |
<krenair> |
Synchronized php-1.25wmf23/extensions/OpenStackManager/nova/OpenStackNovaHost.php: https://gerrit.wikimedia.org/r/#/c/201367/ (duration: 00m 15s) |
[production] |
| 23:02 |
<krenair> |
Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/201197/ (duration: 00m 11s) |
[production] |
| 22:59 |
<awight> |
update payments from f617326761887ed9a9100b472ea3b5736e2c10e6 to d37687239fa79842c0d6ea65e9230a3f14cda867 |
[production] |
| 22:57 |
<twentyafterfour> |
Purged l10n cache for 1.25wmf22 |
[production] |
| 22:57 |
<kaldari> |
Synchronized wmf-config/InitialiseSettings.php: enabling Gather on enwiki (duration: 00m 13s) |
[production] |
| 22:48 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf24 |
[production] |