Skip to content
This repository has been archived by the owner on May 17, 2022. It is now read-only.

Commit

Permalink
Github Release
Browse files Browse the repository at this point in the history
  • Loading branch information
krishnan-r committed Jul 20, 2017
1 parent a2365d1 commit c6dfc09
Show file tree
Hide file tree
Showing 2 changed files with 27 additions and 18 deletions.
8 changes: 6 additions & 2 deletions .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,9 @@ script:
- sbt package
- cd $TRAVIS_BUILD_DIR/extension/
- python setup.py sdist --formats=gztar,zip
- cd $TRAVIS_BUILD_DIR/extension/dist/
- cp sparkmonitor*.tar.gz sparkmonitor.tar.gz
- cp sparkmonitor*.zip sparkmonitor.zip
after_success:
- cd $TRAVIS_BUILD_DIR/notebooks/
- git clone "https://github.com/prasanthkothuri/sparkTraining"
Expand All @@ -35,8 +38,9 @@ after_success:
. && docker push krishnanr/sparkmonitor '
deploy:
provider: releases
file_glob: true
file: extension/dist/*
file:
- $TRAVIS_BUILD_DIR/extension/dist/sparkmonitor.tar.gz
- $TRAVIS_BUILD_DIR/extension/dist/sparkmonitor.zip
skip_cleanup: true
api_key:
secure: a3buqLV2wwwAY6mkCSKT8/qHf8pFTa9/UP4Op3WPlkS2rYTAKw8cI3dAWd99dr5oCXkbbJc4aIA/e9voS1xAR+9mGYW+X3EakB8fRWnwQjg1/mRdsNp4S9wyeat1ETt4+/M1etcZed+uuuIUDfCyWgGGlu+bLGubHYqHIWhAE3lrT3PKjQVNGP/A5Tkctmoz+YE9gHoCNkFwa4cQ0p/hUeE97UT86u1RriHNJ1yKbqfX5/0FaOU6BbZogsGzk5tKBJyJtdACi3fgbLKlBPS7+aIE2wydl7PtQxwnLUV8Gitcb6+rfPQTYzQfc3vX2izfKBx6sC4hFZ433MdGw/3neyfUj1/Gh/tHnHrl4tSkt5VgKD7i4TPQiVLjt2N9tdkgZyqhjfJwit5r5IxSoSbdPsUK6uNIxDLsInFiakPyjwciczDToJihP/drelAuuWqIymKPPE70AGX1VsRI8H5JakXfkzI741ZpyiFiq3Z/b3WPqC/+bXnNS7aF5+P8SkYJVhGbMq6toq8gfYP36rYY2OAo55X7qTCqGkbxv8nAIwJNtrg3U0u5ra7ciamp6/ht8LmVVBfy0XERHzdejhqbHeyNpA1LFSiCkhvpZYWxpPgJOUbW+jkf4Ujk4fJwmvmS2FLsqMNzeOYqhUYwY5mwpmoaDjTFQ50Eu2BcouByVCw=
Expand Down
37 changes: 21 additions & 16 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,9 +10,7 @@
## Installation
### Quick Install
```bash
git clone https://github.com/krishnan-r/sparkmonitor/
cd sparkmonitor/extension
pip install -e .
pip install https://github.com/krishnan-r/sparkmonitor/releases/latest/sparkmonitor.tar.gz #Use sparkmonitor.zip for Windows
#Frontend
jupyter nbextension install sparkmonitor --py --user --symlink
jupyter nbextension enable sparkmonitor --py --user
Expand All @@ -23,40 +21,47 @@ ipython profile create
echo "c.InteractiveShellApp.extensions.append('sparkmonitor')" >> $(ipython profile locate default)/ipython_kernel_config.py
```
### Details
For development purposes the extension folders are symlinked to the appropriate directories. This way making changes is easier.

1. First clone the repository and switch to it.
1. Install the python package in the latest tagged github release. The python package contains the javascript resources and the listener jar file.

```bash
git clone https://github.com/krishnan-r/sparkmonitor/
cd sparkmonitor/extension
pip install https://github.com/krishnan-r/sparkmonitor/releases/sparkmonitor.tar.gz # sparkmonitor.zip for Windows
```
2. Install the python package

```bash
pip install -e .
```

3. The frontend extension is symlinked (```--symlink```) into the jupyter configuration directory by `jupyter nbextension` command. The second line configures the frontend extension to load on notebook startup.
2. The frontend extension is symlinked (```--symlink```) into the jupyter configuration directory by `jupyter nbextension` command. The second line configures the frontend extension to load on notebook startup.

```bash
jupyter nbextension install --py sparkmonitor --user --symlink
jupyter nbextension enable sparkmonitor --user --py
```
4. Configure the serverextension to load when the notebook server starts
3. Configure the serverextension to load when the notebook server starts

```bash
jupyter serverextension enable --py --user sparkmonitor
```

5. Create the default profile configuration files (Skip if file already exists)
4. Create the default profile configuration files (Skip if config file already exists)
```bash
ipython profile create
```
6. Configure the kernel to load the extension on startup. This is added to the configuration files in users home directory
5. Configure the kernel to load the extension on startup. This is added to the configuration files in users home directory
```bash
echo "c.InteractiveShellApp.extensions.append('sparkmonitor')" >> $(ipython profile locate default)/ipython_kernel_config.py
```
## Build from Source
```bash
git clone https://github.com/krishnan-r/sparkmonitor
cd sparkmonitor/extension
#Build Javascript
yarn install
npm webpack -p
#Build Scala jar
cd scalalistener/jupyterspark/
sbt package
#Install as python package in editable format
pip install -e .
# sparkmonitor package is not installed. Configure with jupyter as above.
```

# Testing with Docker
To do a quick test of the extension run the following docker container and connect to port 80 of localhost.
Expand Down

0 comments on commit c6dfc09

Please sign in to comment.