1201-1250 of 10000 results (21ms)
2015-01-30 §
21:38 <YuviPanda|flight> killed diamond taking up 100% on labstore1001 [production]
21:04 <demon> Synchronized docroot/noc/conf/logging.php.txt: (no message) (duration: 00m 06s) [production]
21:02 <demon> Synchronized docroot and w: (no message) (duration: 00m 10s) [production]
20:58 <bblack> reinstalling cp3020 (seems to have fs corruption issues, but may not be hardware...) [production]
19:27 <phuedx> Synchronized php-1.25wmf15/extensions/MobileFrontend/: No-op deployment training (duration: 00m 06s) [production]
19:02 <mutante> cp1039, cp1040 - shut down [production]
18:56 <bblack> rebooting cp3020 again (still depooled) [production]
18:51 <mutante> cp1037,cp1038 - shut down [production]
18:40 <godog> initial rsync from tungsten to graphite1001 T85909 [production]
18:36 <cmjohnson1> removing cp1063 from pybal [production]
18:34 <andyrussg> Synchronized php-1.25wmf15/extensions/CentralNotice: Revert update to CentralNotice (duration: 00m 06s) [production]
18:27 <bblack> rebooting cp3020, something's all wrong there... [production]
18:16 <mutante> cp1037,cp1038,cp1039,cp1040 - disabled puppet, removed from icinga, revoked certs and salt key etc. decom [production]
17:38 <andyrussg> Synchronized php-1.25wmf15/extensions/CentralNotice: Update CentralNotice (duration: 00m 06s) [production]
17:16 <^d> running puppet on ytterbium, gerrit shall restart [production]
16:48 <bblack> expect more icinga "CRITICAL: DPKG CRITICAL" on cache nodes for a while; applying backlog of upstream pkg updates slowly to all [production]
16:18 <bblack> restarting frontend varnishes to apply increased cache sizes from https://gerrit.wikimedia.org/r/#/c/186816/ over the next ~9H [production]
10:04 <paravoid> labstore1001: setting /proc/sys/sunrpc/{nfs,rpc}_debug to 0; rm /var/log/{kern.log,syslog.1,syslog} [production]
04:21 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jan 30 04:20:12 UTC 2015 (duration 20m 11s) [production]
02:25 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-30 02:23:56+00:00 [production]
02:24 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 03s) [production]
02:20 <awight> updated crm from a6b28d0a5e90f7ca68988a15f311465bbb5ae5e6 to ff28f69392fdab74520bf94e4a46586637914480 [production]
02:15 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-30 02:14:31+00:00 [production]
02:14 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
01:36 <mutante> cp1047 - DIMM fail -> T88045 [production]
01:30 <mutante> powercycling cp1047 [production]
2015-01-29 §
23:59 <awight> updated payments from 4743b32c9091d6f2169bea3173e75aa5d2f36eb7 to ce73ed11de9775a596c51acdc036503751961bc8 [production]
22:10 <Krinkle> git-deploy: Deploying integration/slave-scripts I5aa76b0, I4d94af46735c, I66fbce3fa [production]
19:49 <bd808> Updated Wikimania Scholarships (2f4a99f) "Add Sakha to list of languages" [production]
18:29 <reedy> Synchronized wmf-config/InitialiseSettings.php: Disable Extension:Graph on cawiki (duration: 00m 06s) [production]
04:53 <LocalisationUpdate> ResourceLoader cache refresh completed at Thu Jan 29 04:51:55 UTC 2015 (duration 51m 54s) [production]
02:35 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-29 02:34:03+00:00 [production]
02:34 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 02s) [production]
02:21 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-29 02:20:02+00:00 [production]
02:20 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
01:12 <ori> Synchronized wmf-config/CommonSettings.php: Id5186348f: Set $wgResourceLoaderStorageEnabled to false on osmium (duration: 00m 07s) [production]
00:19 <demon> Synchronized wmf-config/: (no message) (duration: 00m 06s) [production]
00:18 <demon> Synchronized php-1.25wmf14/includes/Title.php: (no message) (duration: 00m 06s) [production]
00:17 <demon> Synchronized php-1.25wmf15/includes/Title.php: (no message) (duration: 00m 06s) [production]
00:17 <demon> Synchronized php-1.25wmf15/includes/api/ApiPageSet.php: (no message) (duration: 00m 05s) [production]
00:17 <demon> Synchronized php-1.25wmf14/includes/api/ApiPageSet.php: (no message) (duration: 00m 06s) [production]
00:11 <demon> Synchronized wmf-config/InitialiseSettings.php: flooders on officewiki (duration: 00m 08s) [production]
2015-01-28 §
22:55 <mutante> restarting torrus on netmon1001 [production]
21:21 <subbu> synced parsoid version 88605a4a for restart [production]
21:20 <subbu> synced parsoid version 88605a4a for restart [production]
21:19 <YuviPanda> restarting parsoid across wtp* hosts for subbu [production]
21:00 <YuviPanda> restarted hhvm on mw1069 [production]
20:40 <reedy> Finished scap: mostly nooop, but adding graph to l10n cache (duration: 31m 33s) [production]
20:09 <reedy> Started scap: mostly nooop, but adding graph to l10n cache [production]
20:03 <reedy> Synchronized wmf-config/extension-list: Add Graph to extension-list (duration: 00m 07s) [production]