Using Lemur for non-emr clusters

[jeroenvandijk]

At my company we've just bought a Hex (a portable Hadoop cluster in our case) and I would like to use Lemur to launch jobs on it. I think some changes are needed in order to make Lemur suitable for this. Does anyone else have the need to use Lemur for non-emr clusters or ideas of the required changes to Lemur?

[mlimotte]

Cool. You can probably just run it in local mode (lemur local ...),
assuming your hadoop config is configured to point to the cluster. Certain
things are ignored in local mode (like the hadoop config, and, obviously,
cluster size and instance type). Local mode operates by constructing and
executing a hadoop command line. You could try it out and see what the gap
is compared to your specific needs.

marc

On Sat, Nov 8, 2014 at 6:54 AM, Jeroen van Dijk notifications@github.com
wrote:

At my company we've just bought a Hex http://bigboards.io (a portable
Hadoop cluster in our case) and I would like to use Lemur to launch jobs on
it. I think some changes are needed in order to make Lemur suitable for
this. Does anyone else have the need to use Lemur for non-emr clusters or
ideas of the required changes to Lemur?

—
Reply to this email directly or view it on GitHub
#32.