2015-05-27
§
|
14:47 |
<cmjohnson1> |
powering down cp1070 to relocate within the same rack |
[production] |
13:30 |
<hashar> |
All Jenkins slaves are disconnected due to some ssh error. CI is down. |
[production] |
13:27 |
<hashar> |
restarting Jenkins for java upgrade |
[production] |
13:13 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool pc1001 (duration: 00m 13s) |
[production] |
11:16 |
<akosiaris> |
rebooting ganeti100{1..4} for bridge networking configuration |
[production] |
09:59 |
<paravoid> |
powercycling ms-be1001; dead, console unresponsive |
[production] |
06:35 |
<springle> |
clone dbstore2001 data to dbstore2002 |
[production] |
05:48 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed May 27 05:47:25 UTC 2015 (duration 47m 24s) |
[production] |
02:53 |
<LocalisationUpdate> |
completed (1.26wmf7) at 2015-05-27 02:52:25+00:00 |
[production] |
02:48 |
<l10nupdate> |
Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 06m 52s) |
[production] |
02:29 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-27 02:28:34+00:00 |
[production] |
02:24 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 45s) |
[production] |
2015-05-26
§
|
18:21 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Group1 wikis to 1.26wmf7 |
[production] |
17:13 |
<krenair> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 15s) |
[production] |
17:10 |
<krenair> |
Synchronized multiversion/MWMultiVersion.php: open cnwikimedia (duration: 00m 13s) |
[production] |
16:27 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) |
[production] |
16:12 |
<krenair> |
rebuilt wikiversions.cdb and synchronized wikiversions files: add cnwikimedia |
[production] |
16:08 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) |
[production] |
16:08 |
<krenair> |
Synchronized database lists: (no message) (duration: 00m 15s) |
[production] |
16:07 |
<krenair> |
Synchronized w/static/images/project-logos/cnwikimedia.png: (no message) (duration: 00m 19s) |
[production] |
15:52 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1063 (duration: 00m 14s) |
[production] |
15:32 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1063 (warm period) (duration: 00m 13s) |
[production] |
15:24 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/213652/ (duration: 00m 15s) |
[production] |
15:23 |
<krenair> |
Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/213257/ (duration: 00m 14s) |
[production] |
14:54 |
<bblack> |
restarted ganglia-monitor on all cp* (many were obviously-broken, probably most recently from bad startup after the reboots last week) |
[production] |
14:14 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool db1063 (duration: 00m 12s) |
[production] |
08:24 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool pc1001 (duration: 00m 13s) |
[production] |
05:53 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue May 26 05:52:50 UTC 2015 (duration 52m 49s) |
[production] |
03:02 |
<LocalisationUpdate> |
completed (1.26wmf7) at 2015-05-26 03:01:12+00:00 |
[production] |
02:55 |
<l10nupdate> |
Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 09m 31s) |
[production] |
02:29 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-26 02:28:08+00:00 |
[production] |
02:24 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 44s) |
[production] |
01:35 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1026, warm up (duration: 00m 14s) |
[production] |
2015-05-25
§
|
16:36 |
<jynus> |
running diagnostics on mariadb@pc1001: a very small amount of requests may experience extra latency |
[production] |
14:17 |
<duh> |
intentionally not scapping right now, will let l10nupdate sync it out |
[production] |
14:16 |
<legoktm> |
Synchronized php-1.26wmf7/extensions/WikimediaMessages/i18n/: ExtensionDistributor message updates (duration: 00m 17s) |
[production] |
13:53 |
<legoktm> |
Synchronized php-1.26wmf7/extensions/ExtensionDistributor: Update ExtensionDistributor to master (duration: 00m 13s) |
[production] |
13:38 |
<jynus> |
Synchronized wmf-config/InitialiseSettings-labs.php: restbase change from yurik (duration: 00m 14s) |
[production] |
13:37 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1018 (warm cache) (duration: 00m 13s) |
[production] |
13:09 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1018 (duration: 00m 14s) |
[production] |
10:31 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool db1018 (duration: 00m 13s) |
[production] |
08:36 |
<YuviKTM> |
running du -d 1 -h > du-may-25-2015 on /exp/project/tools on labstore1001 to audit tools' NFS usage |
[production] |
05:12 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon May 25 05:11:47 UTC 2015 (duration 11m 46s) |
[production] |
02:50 |
<LocalisationUpdate> |
completed (1.26wmf7) at 2015-05-25 02:49:45+00:00 |
[production] |
02:45 |
<l10nupdate> |
Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 06m 32s) |
[production] |
02:27 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-25 02:26:39+00:00 |
[production] |
02:22 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 36s) |
[production] |