8451-8500 of 10000 results (46ms)
2014-12-23 §
19:40 <chasemp> updated phab sprint app to 0.6.1.4 [production]
18:32 <paravoid> restarting icing [production]
15:06 <_joe_> gracefully reloading apache on palladium to clean up old puppet master instances [production]
14:50 <_joe_> restarted apache on strontium to verify hiera is working [production]
14:17 <godog> restart icinga on neon [production]
08:30 <_joe_> restarting gitblit, stuck at 100% cpu on a thread [production]
03:25 <andrewbogott> graceful'd apache2 on virt1000 (same intermittent passenger crash as always) [production]
2014-12-22 §
23:43 <springle> xtrabackup clone db2010 to db2030 [production]
21:26 <legoktm> ran delete from localnames where ln_name="Nonoh" and ln_wiki="ruwiki" limit 1; on centralauth for https://phabricator.wikimedia.org/T85041 [production]
20:02 <awight> update paments from 3dde7be76284aa37b74038dfb4473671999dfcff to ce7fb9af37c4bba2a84668387b61729df4f9723c [production]
19:54 <awight> deployed CentralNotice RecordImpression logging for hide cookie bug [production]
19:53 <awight> Synchronized php-1.25wmf13/extensions/CentralNotice: RecordImpression logging for CentralNotice hide cookie bug (duration: 00m 06s) [production]
19:53 <awight> Synchronized php-1.25wmf12/extensions/CentralNotice: RecordImpression logging for CentralNotice hide cookie bug (duration: 00m 06s) [production]
19:04 <anomie> deployed T85113 [production]
18:59 <YuviPanda> running sync-common on virt1000 [production]
17:42 <cmjohnson1> taking neon down again to reseat idrac nic card [production]
17:04 <cmjohnson1> powering down neon (icinga) to drain flea power and reset idrac [production]
16:37 <_joe_> uploading java8 packages for trusty [production]
12:40 <_joe_> upgrading HHVM to the latest version [releng]
2014-12-21 §
14:18 <hashar> Upgrading Zuul merger and server on gallium wmf-deploy-20141030-1 to wmf-deploy-20141221-1 [production]
14:16 <hashar> Restarted moretbots on tools labs following some doc at https://wikitech.wikimedia.org/wiki/Morebots [production]
14:16 <hashar> Cleaning the mess Zuul code base is https://phabricator.wikimedia.org/T84917 . Updated master/labs branches and tagged it wmf-deploy-20141221-1 [production]
2014-12-20 §
02:59 <mattflaschen> Synchronized php-1.25wmf13/resources/src/jquery.tipsy/jquery.tipsy.js: Fix "live" deprecated live mode of jQuery tipsy (duration: 00m 05s) [production]
02:59 <mattflaschen> Synchronized php-1.25wmf12/resources/src/jquery.tipsy/jquery.tipsy.js: Fix "live" deprecated live mode of jQuery tipsy (duration: 00m 05s) [production]
02:57 <mattflaschen> Synchronized php-1.25wmf13/extensions/PageTriage/modules/ext.pageTriage.views.toolbar/: Fix to PageTriage not to use jQuery live (duration: 00m 07s) [production]
02:57 <mattflaschen> Synchronized php-1.25wmf12/extensions/PageTriage/modules/ext.pageTriage.views.toolbar/: Fix to PageTriage not to use jQuery live (duration: 00m 05s) [production]
01:18 <awight> payments rolled back to 3dde7be76284aa37b74038dfb4473671999dfcff [production]
00:57 <awight> payments updated from 3dde7be76284aa37b74038dfb4473671999dfcff to ce7fb9af37c4bba2a84668387b61729df4f9723c [production]
00:35 <springle> Synchronized wmf-config/db-eqiad.php: repool db1072 warm up. depool db1066 replication error (duration: 00m 05s) [production]
2014-12-19 §
23:39 <awight> payments rolled back ab93b636fae7bcb38a155c019ad102f3b071918c --> 3dde7be76284aa37b74038dfb4473671999dfcff [production]
23:28 <awight> payments updated from 3dde7be76284aa37b74038dfb4473671999dfcff to ab93b636fae7bcb38a155c019ad102f3b071918c [production]
23:23 <awight> rollback payments to 3dde7be76284aa37b74038dfb4473671999dfcff [production]
23:18 <awight> updated payments from 3dde7be76284aa37b74038dfb4473671999dfcff to ab93b636fae7bcb38a155c019ad102f3b071918c [production]
23:01 <greg-g> Krinkle restarted Gearman, which got the jobs to flow again [releng]
21:27 <awight> update crm from ae7b2381667dd65d68812c58f61e3ea66fa9fa6f to 80241fd2a43f03796b416d728661470f875a590a [production]
20:51 <Krinkle> integration-slave1005 (new Ubuntu Trusty instance) is now pooled [releng]
18:51 <Krinkle> Re-created and provisioning integration-slave1005 (UbuntuTrusty) [releng]
18:23 <bd808> redis input to logstash stuck; restarted service [releng]
18:16 <bd808> ran `apt-get dist-upgrade` on logstash01 [releng]
18:02 <bd808> removed local mwdeploy user & group from videoscaler01 [releng]
18:01 <bd808> deployment-videoscaler01 has mysteriously aquired a local mwdeploy user instead of the ldap one [releng]
17:58 <bd808> forcing puppet run on deploymnet-videoscaler01 [releng]
17:54 <hoo> Manually transferred the email from enwiki account "Hob Gadling" to the centralauth account of the same name (after a partially failed account creation). [production]
12:54 <aude> Synchronized php-1.25wmf12/extensions/Wikidata/extensions/Wikibase/lib/resources/jquery.wikibase: js caching issues (duration: 00m 05s) [production]
07:24 <Krinkle> Restarting Gearman connection to Jenkins [releng]
07:24 <Krinkle> Attempt #5 at re-creating integration-slave1001. Completed provisioning per Setup instructions. Pooled. [releng]
07:15 <andrewbogott> disabled puppet and nova-compute on virt1010 and virt1011 until I can sort out a libvirt issue. [production]
06:55 <_joe_> restarted HHVM on mw1184, stuck in HPHP::StatCache::refresh [production]
05:33 <Krinkle> Rebasing integration-puppetmaster with latest operations/puppet upstream (5 patches) [releng]
03:36 <springle> Synchronized wmf-config/db-eqiad.php: depool db1028 (duration: 00m 06s) [production]