451-500 of 10000 results (23ms)
2015-01-05 §
17:44 <hoo> Synchronized php-1.25wmf13/extensions/Wikidata/: Update Wikibase: Fix SpecialEntityData and enhance populateSitesTable (duration: 00m 24s) [production]
17:43 <hoo> Synchronized php-1.25wmf12/extensions/Wikidata/: Update Wikibase: Fix SpecialEntityData and enhance populateSitesTable (duration: 00m 14s) [production]
17:22 <bd808> Synchronized wmf-config/logging-labs.php: Beta logging config change (5b628827) (duration: 00m 06s) [production]
17:09 <bd808> Synchronized wmf-config/logging-labs.php: Beta logging config change (b47ee787) (duration: 00m 06s) [production]
17:00 <bd808> restarted logstash on logstash1001 to see if that will make syslog events come back [production]
16:58 <bd808> syslog events not being recorded in logstash as expected (apache2, hhvm) [production]
16:21 <manybubbles> Synchronized php-1.25wmf13/extensions/VisualEditor/: SWAT fix switching between wikitext and VE on mobile (duration: 00m 14s) [production]
16:14 <manybubbles> Synchronized wmf-config/InitialiseSettings.php: SWAT disable creating books in the wikipedia namespace AND shuffle some upload permissions on kowiki (duration: 00m 05s) [production]
16:12 <manybubbles> Synchronized wmf-config/InitialiseSettings.php: SWAT disable creating books in the wikipedia namespace (duration: 00m 06s) [production]
16:03 <manybubbles> Synchronized wmf-config/Wikibase.php: SWAT Display links to Wikidata in the other project sidebar (duration: 00m 06s) [production]
10:40 <springle> xtrabackup clone: db1037 to db1061, db1039 to db1062 [production]
10:23 <springle> Synchronized wmf-config/db-eqiad.php: depool db1061 db1062 (duration: 00m 06s) [production]
10:14 <springle> Synchronized wmf-config/db-eqiad.php: pool db1057, warm up (duration: 00m 07s) [production]
2015-01-04 §
17:35 <springle> xtrabackup clone db1061 to db1057 [production]
16:49 <springle> restarted zuul [production]
15:59 <springle> upgrade db1057 trusty [production]
15:23 <springle> limiting exim/otrs concurrent connections on m2-master to 250 [production]
14:29 <springle> xtrabackup clone db1020 to db2011 [production]
13:49 <springle> dbproxy1002 failed m2-master traffic over to m2-slave. services up. investigating cause [production]
2015-01-03 §
23:23 <subbu> Try #2: hotfix synced to parsoid cores (to return 500 for urwiki:نام_مقامات_اے); git sha 85d8818ec1b692aaab440630a119c539d63d5ca5 [production]
22:38 <YuviPanda> restarted parsoid on wtp1010 [production]
22:38 <YuviPanda> restarted parsoid on wtp1006 [production]
22:37 <YuviPanda> restarted parsoid on wtp1004 [production]
22:29 <subbu> hotfix synced to parsoid cores (to return 500 for urwiki:نام_مقامات_اے); restart coming next [production]
22:15 <YuviPanda> restarted parsoid on wtp* hosts agian [production]
21:19 <YuviPanda> restarting parsoid on wtp* hosts again [production]
20:46 <YuviPanda> restarting parsoid on wtp* again [production]
20:29 <YuviPanda> manually restarted parsoid on wtp1012 [production]
20:12 <YuviPanda> restarting parsoid on all wtp* hosts [production]
20:06 <YuviPanda> restarting parsoid on wtp1008 [production]
17:13 <_joe_> restarting parsoid across the cluster [production]
2015-01-02 §
21:19 <qchris> Ran kafka leader re-election to bring analytics1021 back into the set of leaders [production]
11:48 <godog> reboot es2004, debugging gmond stuck on start/stop [production]
04:59 <springle> Synchronized wmf-config/db-eqiad.php: repool db1061, warm up (duration: 00m 06s) [production]
03:29 <springle> clone and deploy es2002 es2003 es2004 [production]
2015-01-01 §
15:19 <springle> upgrade db1061 trusty [production]
15:19 <springle> upgrade db1061 trusty [production]
2014-12-31 §
23:45 <springle> Synchronized wmf-config/db-eqiad.php: depool db1061 (duration: 00m 05s) [production]
14:02 <springle> Synchronized wmf-config/db-eqiad.php: repool db1065, warm up (duration: 00m 06s) [production]
09:47 <godog> updating precise-wikimedia from third-party repo (hwraid) [production]
09:45 <godog> previous reprepro update also accidentally updated elasticsearch in trusty-wikimedia to 1.3.7 [production]
09:43 <godog> updating trusty-wikimedia from third-party repo (hwraid) [production]
02:22 <springle> upgrade db1065 trusty [production]
02:16 <springle> Synchronized wmf-config/db-eqiad.php: depool db1065 (duration: 00m 05s) [production]
02:03 <awight> updated payments from 78b72063e4e0cc76b7e168be1e626d5e10e34d4a to 62c81d4574e5e994ff8f3cac7115eff335bd5265 [production]
00:52 <bd808> restarted elasticsearch on logstash1001 [production]
00:49 <awight> updated payments from e81f473acc5b31b49dd27714c40f9b71c3462e26 to 78b72063e4e0cc76b7e168be1e626d5e10e34d4a [production]
00:42 <bd808> log2udp events still not making it into logstash; possibly related to earlier elasticsearch cluster issues; I don't want to restart elasticsearch on logstash1001 while the cluster is still recovering form that. [production]
00:33 <bd808> restarted logstash on logstash1001; log2udp events not being recorded in elasticsearch [production]
2014-12-30 §
21:52 <bd808> restarted elasticsearch on logstash1002; it had dropped from the cluster [production]