|
2015-11-11
§
|
| 16:02 |
<mutante> |
uploaded jenkins 1.625.2 to apt.wm.org, upgrading on gallium |
[production] |
| 15:47 |
<moritzm> |
restarted kafka broker on kafka1022 |
[production] |
| 15:34 |
<moritzm> |
stopping kafka broker on kafka1022 (to enable ferm) |
[production] |
| 15:31 |
<moritzm> |
restarted kafka broker on kafka1020 |
[production] |
| 15:25 |
<moritzm> |
stopping kafka1020 to enable ferm |
[production] |
| 15:22 |
<moritzm> |
restarted kafka1018 to enable ferm |
[production] |
| 15:19 |
<moritzm> |
stopping kafka1018 to enable ferm |
[production] |
| 15:04 |
<moritzm> |
disabled puppet on kafka1018, kafka1020, kafka1022 (for enabling ferm) |
[production] |
| 14:18 |
<godog> |
start cassandra instance a on restbase2001 |
[production] |
| 13:54 |
<mobrovac> |
restbase deployed 0d961a2 (deploy end) |
[production] |
| 13:42 |
<mobrovac> |
restbase deploying 0d961a2 |
[production] |
| 11:28 |
<godog> |
reimage restbase2001.codfw.wmnet - take #2 |
[production] |
| 10:16 |
<jynus> |
disabling puppet and restarting mysql on db2067 |
[production] |
| 10:16 |
<godog> |
reimage restbase2001.codfw.wmnet |
[production] |
| 10:07 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2067 for maintenance (not db1067) (duration: 00m 30s) |
[production] |
| 10:05 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1067 for maintenance (duration: 00m 30s) |
[production] |
| 09:57 |
<twentyafterfour@tin> |
Synchronized php-1.27.0-wmf.6/extensions/OAuth/: really fix T118372 this time (duration: 00m 29s) |
[production] |
| 09:43 |
<twentyafterfour@tin> |
Synchronized php-1.27.0-wmf.6/extensions/OAuth/: oauth login broken by php error. This fixes T118372 (duration: 00m 31s) |
[production] |
| 08:51 |
<jynus> |
importing wmf-mariadb10_10.0.22-1_amd64.deb wmf-mysql57_5.7.9-1_amd64.deb on carbon |
[production] |
| 04:19 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: rm some old log channels (duration: 00m 31s) |
[production] |
| 03:23 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.6/includes/cache/MessageBlobStore.php: Logging for T93800 (duration: 00m 31s) |
[production] |
| 02:51 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.5/includes/Title.php: Deploy I47517021471 which was merged earlier today but forgotten (duration: 01m 58s) |
[production] |
| 02:36 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.5/cache/l10n: l10nupdate for 1.27.0-wmf.5 (duration: 07m 01s) |
[production] |
| 01:48 |
<mutante> |
repooled mw1083 (T116184) |
[production] |
| 00:58 |
<mutante> |
added jenkins_1.625.1 to APT repo. precise-wikimedia |
[production] |
| 00:50 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.6 |
[production] |
| 00:38 |
<twentyafterfour@tin> |
Finished scap: grr: sync 1.27.0-wmf.6 (duration: 55m 05s) |
[production] |
|
2015-11-10
§
|
| 23:42 |
<twentyafterfour@tin> |
Started scap: grr: sync 1.27.0-wmf.6 |
[production] |
| 23:41 |
<twentyafterfour@tin> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.7rNhS6PIRi" ' returned non-zero exit status 1 (duration: 00m 09s) |
[production] |
| 23:41 |
<twentyafterfour@tin> |
Started scap: grr: sync 1.27.0-wmf.6 |
[production] |
| 23:40 |
<twentyafterfour@tin> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.yIUW9abUwO" ' returned non-zero exit status 1 (duration: 00m 15s) |
[production] |
| 23:39 |
<twentyafterfour@tin> |
Started scap: trying again: sync 1.27.0-wmf.6 |
[production] |
| 23:23 |
<ori> |
ran sudo chgrp -R wikidev /srv/mediawiki-staging/php-1.27.0-wmf.6 on tin |
[production] |
| 22:43 |
<twentyafterfour@tin> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.sEpytaqlt1" ' returned non-zero exit status 1 (duration: 01m 42s) |
[production] |
| 22:41 |
<twentyafterfour@tin> |
Started scap: testwiki to 1.27.0-wmf.6 |
[production] |
| 21:51 |
<hashar> |
installed Zuul package on scandium.eqiad.wmnet . zuul-merger not running |
[production] |
| 21:15 |
<mutante> |
scb1001 - mobile endpoint health CRIT |
[production] |
| 21:15 |
<mutante> |
mira unmerged changes in mw-staging |
[production] |
| 21:14 |
<mutante> |
restbase2001: cassandra CQl refused |
[production] |
| 21:14 |
<mutante> |
aqs1001-1003: CRITICAL: Test Get aggregate page views |
[production] |
| 21:12 |
<mutante> |
tungsten - signed new puppet certs, re-installed |
[production] |
| 20:48 |
<moritzm> |
kafka re-enabled on kafka1013 |
[production] |
| 20:41 |
<moritzm> |
stopping kafka broker on kafka1013 to activate ferm |
[production] |
| 20:26 |
<ottomata> |
starting kafka broker on kafka1012 after applying base ferm |
[production] |
| 20:14 |
<ottomata> |
stopping kafka broker on kafka1012 to apply base ferm |
[production] |
| 20:09 |
<moritzm> |
disabled puppet on kafk1012/1013 in preparation of ferm activation |
[production] |
| 20:08 |
<_joe_> |
restarting jobchron across the cluster |
[production] |
| 18:41 |
<ottomata> |
powercycling analytics1031 |
[production] |
| 16:51 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.5/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.init.js: https://gerrit.wikimedia.org/r/#/c/252231/ (duration: 00m 35s) |
[production] |
| 16:45 |
<krenair@tin> |
Synchronized wmf-config/Wikibase-labs.php: (no message) (duration: 00m 34s) |
[production] |