801-850 of 10000 results (32ms)
2016-02-19 §
15:29 <elukey> removed kafka1001 from eventbus via confctl [production]
15:14 <andrewbogott> restarting pdns on labservices1001 again [production]
15:02 <andrewbogott> restarting pdns on labservices1001 [production]
15:00 <paravoid> setting up (e)BGP sessions between ulsfo-codfw [production]
14:52 <apergos> labstore1001 issues were (again) cluebot writing to its error log. I chowned that log to root and left a README file in the directory with an explanation plus a pointer to us here if they have questions/need help. [production]
14:48 <moritzm> rolling restart of swift-proxy in eqiad [production]
14:27 <volans> Restarting MariaDB on es2001 (still depooled) [T127330] [production]
14:27 <paravoid> cr2-knams: re-activating BGP with 1257 [production]
14:12 <jynus> restarting mysql at dbstore1001 [production]
13:59 <moritzm> restarting salt-master on neodymium [production]
13:49 <elukey> puppet re-enabled on analytics1027 [production]
13:37 <moritzm> rebooting mira [production]
13:06 <moritzm> restarting slapd on dubnium/pollux [production]
12:48 <moritzm> restarting apache on uranium [production]
12:44 <elukey> puppet stopped on analytics1027 for issues with the cluster [production]
11:40 <godog> start a new ^global- swift container replication eqiad -> codfw [production]
11:39 <akosiaris> reboot cygnus, stuck in 100% IOwait [production]
11:13 <moritzm> rolling restart of aqs cluster for glibc update [production]
11:08 <mark> correction: Reduced sync_speed_max to 100000 (half) for md125 on labstore1001 [production]
11:07 <mark> Reduced sync_speed_max to 100000 (half) for md126 on labstore1001 [production]
11:02 <moritzm> restarted gerrit on ytterbium (actual restart happened ten minutes earlier than this log entry, though) [production]
10:22 <moritzm> rolling restart of cassandra on restbase/eqiad [production]
10:04 <jynus> restarting db021 slave, will be testing/depooled for a while [production]
10:00 <jynus> purging requested rows on eventlogging Edit table (m4) at db1046, db1047, dbstore1002 and dbstore2002 [production]
09:59 <moritzm> rolling restart of cassandra on restbase/codfw [production]
09:03 <_joe_> idled the raid check for md123 on labstore1001 [production]
08:50 <_joe_> killed the backup rsync on labstore1001 to alleviate the high io load [production]
03:00 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Feb 19 03:00:47 UTC 2016 (duration 9m 10s) [production]
02:51 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.14) (duration: 11m 18s) [production]
02:43 <mutante> powercycle cp2017 [production]
02:29 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.13) (duration: 13m 18s) [production]
02:07 <krinkle@tin> Synchronized wmf-config/InitialiseSettings.php: Clean up wmgUseWmfstatic setting (duration: 01m 34s) [production]
02:04 <krinkle@tin> Synchronized wmf-config/CommonSettings.php: Clean up wmgUseWmfstatic setting (duration: 01m 56s) [production]
01:02 <mobrovac> restbase deploy end of fa1207e95 [production]
00:55 <mobrovac> restbase deploy start of fa1207e95 for T127370 [production]
00:55 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Enable cross-wiki notifications beta feature on initial set of wikis (duration: 01m 40s) [production]
00:55 <mobrovac> restbase deploy start of fa1207e95 [production]
00:49 <catrope@tin> Synchronized php-1.27.0-wmf.13/extensions/Echo/: SWAT (duration: 01m 41s) [production]
00:44 <catrope@tin> Synchronized php-1.27.0-wmf.14/extensions/Echo/: SWAT (duration: 01m 37s) [production]
00:41 <catrope@tin> Synchronized wmf-config/filebackend-production.php: Enable deferred writes to codfw swift cluster (duration: 01m 33s) [production]
00:37 <catrope@tin> Synchronized wmf-config/CommonSettings.php: Set initial $wgMaxUserDBWriteDuration value (duration: 01m 38s) [production]
00:28 <catrope@tin> Synchronized wmf-config/CommonSettings.php: VE config var cleanup (2/2) (duration: 01m 38s) [production]
00:26 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: VE config var cleanup (1/2) (duration: 01m 44s) [production]
2016-02-18 §
23:49 <csteipp> deployed patch for T125290 [production]
22:22 <chasemp> reboot labvirt1010 [production]
22:18 <ori@mira> Synchronized php-1.27.0-wmf.13/extensions/SpamBlacklist: I0ad5289324: Pre-cache the link list for external link filters (duration: 02m 26s) [production]
22:01 <chasemp> reboot labvirt1009 [production]
21:59 <krinkle@tin> Synchronized php-1.27.0-wmf.13/includes/rcfeed/IRCColourfulRCFeedFormatter.php: T127360: Ignore RC_CATEGORIZE (duration: 01m 41s) [production]
21:59 <volans> Shutting down MySQL on es2001 (depooled) and starting data trasnfer to es2011 [ T127330 ] [production]
21:32 <chasemp> reboot labvirt1008 [production]