9351-9400 of 10000 results (42ms)
2015-05-27 §
13:30 <hashar> All Jenkins slaves are disconnected due to some ssh error. CI is down. [production]
13:27 <hashar> restarting Jenkins for java upgrade [production]
13:13 <jynus> Synchronized wmf-config/db-eqiad.php: repool pc1001 (duration: 00m 13s) [production]
11:16 <akosiaris> rebooting ganeti100{1..4} for bridge networking configuration [production]
09:59 <paravoid> powercycling ms-be1001; dead, console unresponsive [production]
06:35 <springle> clone dbstore2001 data to dbstore2002 [production]
05:48 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed May 27 05:47:25 UTC 2015 (duration 47m 24s) [production]
02:53 <LocalisationUpdate> completed (1.26wmf7) at 2015-05-27 02:52:25+00:00 [production]
02:48 <l10nupdate> Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 06m 52s) [production]
02:29 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-27 02:28:34+00:00 [production]
02:24 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 45s) [production]
2015-05-26 §
18:21 <twentyafterfour> rebuilt wikiversions.cdb and synchronized wikiversions files: Group1 wikis to 1.26wmf7 [production]
17:13 <krenair> Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 15s) [production]
17:10 <krenair> Synchronized multiversion/MWMultiVersion.php: open cnwikimedia (duration: 00m 13s) [production]
16:27 <krenair> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) [production]
16:12 <krenair> rebuilt wikiversions.cdb and synchronized wikiversions files: add cnwikimedia [production]
16:08 <krenair> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) [production]
16:08 <krenair> Synchronized database lists: (no message) (duration: 00m 15s) [production]
16:07 <krenair> Synchronized w/static/images/project-logos/cnwikimedia.png: (no message) (duration: 00m 19s) [production]
15:52 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1063 (duration: 00m 14s) [production]
15:32 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1063 (warm period) (duration: 00m 13s) [production]
15:24 <krenair> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/213652/ (duration: 00m 15s) [production]
15:23 <krenair> Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/213257/ (duration: 00m 14s) [production]
14:54 <bblack> restarted ganglia-monitor on all cp* (many were obviously-broken, probably most recently from bad startup after the reboots last week) [production]
14:14 <jynus> Synchronized wmf-config/db-eqiad.php: depool db1063 (duration: 00m 12s) [production]
08:24 <jynus> Synchronized wmf-config/db-eqiad.php: depool pc1001 (duration: 00m 13s) [production]
05:53 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue May 26 05:52:50 UTC 2015 (duration 52m 49s) [production]
03:02 <LocalisationUpdate> completed (1.26wmf7) at 2015-05-26 03:01:12+00:00 [production]
02:55 <l10nupdate> Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 09m 31s) [production]
02:29 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-26 02:28:08+00:00 [production]
02:24 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 44s) [production]
01:35 <springle> Synchronized wmf-config/db-eqiad.php: repool db1026, warm up (duration: 00m 14s) [production]
2015-05-25 §
16:36 <jynus> running diagnostics on mariadb@pc1001: a very small amount of requests may experience extra latency [production]
14:17 <duh> intentionally not scapping right now, will let l10nupdate sync it out [production]
14:16 <legoktm> Synchronized php-1.26wmf7/extensions/WikimediaMessages/i18n/: ExtensionDistributor message updates (duration: 00m 17s) [production]
13:53 <legoktm> Synchronized php-1.26wmf7/extensions/ExtensionDistributor: Update ExtensionDistributor to master (duration: 00m 13s) [production]
13:38 <jynus> Synchronized wmf-config/InitialiseSettings-labs.php: restbase change from yurik (duration: 00m 14s) [production]
13:37 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1018 (warm cache) (duration: 00m 13s) [production]
13:09 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1018 (duration: 00m 14s) [production]
10:31 <jynus> Synchronized wmf-config/db-eqiad.php: depool db1018 (duration: 00m 13s) [production]
08:36 <YuviKTM> running du -d 1 -h > du-may-25-2015 on /exp/project/tools on labstore1001 to audit tools' NFS usage [production]
05:12 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon May 25 05:11:47 UTC 2015 (duration 11m 46s) [production]
02:50 <LocalisationUpdate> completed (1.26wmf7) at 2015-05-25 02:49:45+00:00 [production]
02:45 <l10nupdate> Synchronized php-1.26wmf7/cache/l10n: (no message) (duration: 06m 32s) [production]
02:27 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-25 02:26:39+00:00 [production]
02:22 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 06m 36s) [production]
2015-05-24 §
17:18 <springle> stop mysqld db1002 db1003 db1004 db1005 db1006 db1007 [production]
10:00 <^d> gerrit: manually gc'd all repos to help with clone times [production]
08:55 <godog> resize existing whisper files with new retention on graphite2001 [production]
05:42 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun May 24 05:41:35 UTC 2015 (duration 41m 34s) [production]