Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for debug output that shows stage statistics #47

Open
nchammas opened this issue Nov 6, 2015 · 2 comments
Open

Add support for debug output that shows stage statistics #47

nchammas opened this issue Nov 6, 2015 · 2 comments

Comments

@nchammas
Copy link
Owner

nchammas commented Nov 6, 2015

Sometimes, especially if you are debugging something, you want to see a little more information on what Flintrock is doing.

One type of information I've often found myself wanting to see, for example, are statistics on how long it took to do the various sub-steps in an operation. How long is it taking to download Hadoop? How long does it take the Spark master to come up? And so forth.

So first we just need some minimal plumbing to support configurable debug output. From there we can add stuff like these statistics.

@nchammas
Copy link
Owner Author

As noted in #133, it may even be useful to see information like this by default.

@nchammas nchammas changed the title Add support for debug output that shows additional information Add support for debug output that shows stage statistics Apr 2, 2017
@nchammas
Copy link
Owner Author

nchammas commented Apr 2, 2017

Retitling issue per this comment, though I'm thinking we could as well just roll this whole issue in #27.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant