451-500 of 10000 results (14ms)
2013-08-06 §
10:36 <Jeff_Green> stopped icinga notifications for db1048, db1046, db48, db49 [production]
10:21 <Jeff_Green> db1046 mysql replication stopped [production]
10:15 <Jeff_Green> stop exim on williams.wikimedia.org [production]
10:15 <Jeff_Green> stop apache on williams.wikimedia.org [production]
02:16 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Aug 6 02:16:18 UTC 2013 [production]
02:06 <LocalisationUpdate> completed (1.22wmf12) at Tue Aug 6 02:06:34 UTC 2013 [production]
2013-08-05 §
15:55 <akosiaris> cleared old cruft snapmirror replication from nas1-a to nas1001-a. Direction has been reverted long ago [production]
14:00 <mark> Put non-European wikivoyage traffic on the eqiad text Varnish cluster [production]
09:26 <paravoid> powercycling neon, OOM'ed, "login: failure forking: Cannot allocate memory" etc.; icinga down since ~01:00 UTC [production]
02:14 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Aug 5 02:14:37 UTC 2013 [production]
02:06 <LocalisationUpdate> completed (1.22wmf12) at Mon Aug 5 02:05:54 UTC 2013 [production]
2013-08-04 §
17:17 <Nemo_bis> antimony (gitblit) overloaded again as of yesterday around 19 UTC [production]
02:13 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Aug 4 02:13:09 UTC 2013 [production]
02:05 <LocalisationUpdate> completed (1.22wmf12) at Sun Aug 4 02:04:59 UTC 2013 [production]
2013-08-03 §
19:46 <Ryan_Lane> repooling ssl1007-9 [production]
14:40 <reedy> synchronized wmf-config/squid.php 'ssl1007-ssl1009' [production]
07:59 <Ryan_Lane> depooling ssl1007-9 for now. They need to be added to the MW config. [production]
02:37 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Aug 3 02:36:54 UTC 2013 [production]
02:16 <LocalisationUpdate> completed (1.22wmf12) at Sat Aug 3 02:16:47 UTC 2013 [production]
00:14 <marktraceur> Deployed new version of parsoid-regressions via Jenkins Job Builder [production]
00:04 <reedy> synchronized wmf-config/InitialiseSettings.php [production]
2013-08-02 §
22:54 <Ryan_Lane> repooling ssl1001-1007 [production]
22:50 <Ryan_Lane> deppoling ssl1007 for more testing [production]
22:41 <Ryan_Lane> depooling ssl1005-6 to further test load [production]
22:34 <Ryan_Lane> depooling ssl1001-4 to measure load on new hardware [production]
22:10 <Ryan_Lane> pooling ssl1007-9 [production]
21:11 <cmjohnson1> dns update [production]
19:36 <cmjohnson1> dns update [production]
19:21 <paravoid> installing mexia [production]
14:31 <LeslieCarr> pdf3 unresponsive on console , rebooting [production]
13:11 <paravoid> rolling reboot ceph nodes for kernel upgrades [production]
13:05 <paravoid> upgrading ceph to 0.67-rc3 [production]
08:18 <springle> restarting slave threads db32 db52 db39 db51 db45 db43 db56 after OSC bug 49194 [production]
05:33 <catrope> synchronized php-1.22wmf12/resources/startup.js 'touch' [production]
05:33 <catrope> synchronized php-1.22wmf12/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.ViewPageTarget.init.js 'touch' [production]
05:31 <catrope> synchronized wmf-config/CommonSettings.php 'Add plumbing for new VE config vars' [production]
05:30 <catrope> synchronized wmf-config/InitialiseSettings.php 'Add VE config to set Edit source / Edit beta on enwiki' [production]
05:28 <catrope> Finished syncing Wikimedia installation... : Update VE to master [production]
05:22 <catrope> Started syncing Wikimedia installation... : Update VE to master [production]
02:34 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Aug 2 02:34:08 UTC 2013 [production]
02:14 <LocalisationUpdate> completed (1.22wmf12) at Fri Aug 2 02:14:20 UTC 2013 [production]
2013-08-01 §
22:18 <cmjohnson1> authdns update [production]
21:23 <mflaschen> synchronized php-1.22wmf12/extensions/GuidedTour/ 'Sync GuidedTour for E3 deployment' [production]
21:10 <LeslieCarr> restarting gerrit on manganese [production]
21:08 <cmjohnson1> dns update [production]
21:04 <Krinkle> Gerrit has been slow (~ 10 second per request) for about 30 minutes. Seems down entirely now. [production]
20:18 <RobH> authdnsupdate [production]
19:39 <cmjohnson1> dns update [production]
19:35 <hashar> Slightly described the Zuul pipelines at https://integration.wikimedia.org/zuul/ . Descriptions are in the zuul-config layout.yaml file. [production]
19:21 <cmjohnson1> morebots are you working? [production]