Skip to content

Adding steps for Apex runner, to run Wordcount example using Sandbox#10

Open
sandeepdeshmukh wants to merge 2 commits intoeljefe6a:masterfrom
sandeepdeshmukh:apex-runner
Open

Adding steps for Apex runner, to run Wordcount example using Sandbox#10
sandeepdeshmukh wants to merge 2 commits intoeljefe6a:masterfrom
sandeepdeshmukh:apex-runner

Conversation

@sandeepdeshmukh
Copy link
Copy Markdown
Collaborator

No description provided.


### Apache Apex
1. Download pre-configured [Sandbox from here](http://www.datatorrent.com/downloads/3.6.0/datatorrent-sandbox-3.6.0-beam.ova). The sandbox has all pre-requisites installed and setup.
1. Download some data for processing. Run `curl http://www.gutenberg.org/cache/epub/1128/pg1128.txt > /tmp/kinglear.txt`
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ideally, it'd be good to write these instructions from the perspective of running one of the examples in this repo (e.g. Exercise1).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am checking if we can run this example at least in local mode using Apex runner. For Apex to use YARN, right now it needs to use apex cli and the pipeline code should be in populateDAG() of the Apex program rather than main.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay. If not, can you at least add a note indicating that these are general Apex instructions, and that the examples in this repo won't just work unchanged?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants