3751-3800 of 10000 results (17ms)
2013-08-05 §
09:26 <paravoid> powercycling neon, OOM'ed, "login: failure forking: Cannot allocate memory" etc.; icinga down since ~01:00 UTC [production]
02:14 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Aug 5 02:14:37 UTC 2013 [production]
02:06 <LocalisationUpdate> completed (1.22wmf12) at Mon Aug 5 02:05:54 UTC 2013 [production]
2013-08-04 §
17:17 <Nemo_bis> antimony (gitblit) overloaded again as of yesterday around 19 UTC [production]
02:13 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Aug 4 02:13:09 UTC 2013 [production]
02:05 <LocalisationUpdate> completed (1.22wmf12) at Sun Aug 4 02:04:59 UTC 2013 [production]
2013-08-03 §
19:46 <Ryan_Lane> repooling ssl1007-9 [production]
14:40 <reedy> synchronized wmf-config/squid.php 'ssl1007-ssl1009' [production]
07:59 <Ryan_Lane> depooling ssl1007-9 for now. They need to be added to the MW config. [production]
02:37 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Aug 3 02:36:54 UTC 2013 [production]
02:16 <LocalisationUpdate> completed (1.22wmf12) at Sat Aug 3 02:16:47 UTC 2013 [production]
00:14 <marktraceur> Deployed new version of parsoid-regressions via Jenkins Job Builder [production]
00:04 <reedy> synchronized wmf-config/InitialiseSettings.php [production]
2013-08-02 §
22:54 <Ryan_Lane> repooling ssl1001-1007 [production]
22:50 <Ryan_Lane> deppoling ssl1007 for more testing [production]
22:41 <Ryan_Lane> depooling ssl1005-6 to further test load [production]
22:34 <Ryan_Lane> depooling ssl1001-4 to measure load on new hardware [production]
22:10 <Ryan_Lane> pooling ssl1007-9 [production]
21:11 <cmjohnson1> dns update [production]
19:36 <cmjohnson1> dns update [production]
19:21 <paravoid> installing mexia [production]
14:31 <LeslieCarr> pdf3 unresponsive on console , rebooting [production]
13:11 <paravoid> rolling reboot ceph nodes for kernel upgrades [production]
13:05 <paravoid> upgrading ceph to 0.67-rc3 [production]
08:18 <springle> restarting slave threads db32 db52 db39 db51 db45 db43 db56 after OSC bug 49194 [production]
05:33 <catrope> synchronized php-1.22wmf12/resources/startup.js 'touch' [production]
05:33 <catrope> synchronized php-1.22wmf12/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.ViewPageTarget.init.js 'touch' [production]
05:31 <catrope> synchronized wmf-config/CommonSettings.php 'Add plumbing for new VE config vars' [production]
05:30 <catrope> synchronized wmf-config/InitialiseSettings.php 'Add VE config to set Edit source / Edit beta on enwiki' [production]
05:28 <catrope> Finished syncing Wikimedia installation... : Update VE to master [production]
05:22 <catrope> Started syncing Wikimedia installation... : Update VE to master [production]
02:34 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Aug 2 02:34:08 UTC 2013 [production]
02:14 <LocalisationUpdate> completed (1.22wmf12) at Fri Aug 2 02:14:20 UTC 2013 [production]
2013-08-01 §
22:18 <cmjohnson1> authdns update [production]
21:23 <mflaschen> synchronized php-1.22wmf12/extensions/GuidedTour/ 'Sync GuidedTour for E3 deployment' [production]
21:10 <LeslieCarr> restarting gerrit on manganese [production]
21:08 <cmjohnson1> dns update [production]
21:04 <Krinkle> Gerrit has been slow (~ 10 second per request) for about 30 minutes. Seems down entirely now. [production]
20:18 <RobH> authdnsupdate [production]
19:39 <cmjohnson1> dns update [production]
19:35 <hashar> Slightly described the Zuul pipelines at https://integration.wikimedia.org/zuul/ . Descriptions are in the zuul-config layout.yaml file. [production]
19:21 <cmjohnson1> morebots are you working? [production]
19:19 <cmjohnson1> authdns update [production]
18:52 <akosiaris> created aggregates backups on nas1001-a and nas1-a. Created flexible volumes baculasd1 on each and setup a snapmirror relationship between them (from eqiad to pmtpa) [production]
18:41 <cmjohnson1> authdns update [production]
17:28 <csteipp> synchronized wmf-config/CommonSettings.php 'EventLogging for CentralAuth' [production]
17:27 <csteipp> synchronized wmf-config/InitialiseSettings.php 'EventLogging for CentralAuth' [production]
16:48 <akosiaris> set options disk.auto_assign off on nas1001-{a,b}. Then performed disk remove_ownership for 20 disks on nas1001-b and disk assign all on nas1001-a [production]
16:44 <bsitu> synchronized php-1.22wmf12/extensions/Echo/Echo.php 'Update Echo to master' [production]
16:04 <akosiaris> added my ssh public key to root user of nas1-{a,b}, nas1001-{a,b} [production]