运行Apache Zeppelin

2 年 ago

新, 韵

2 minutes

作为一个未来有可能会迷上的工具，Apache Zeppelin的笔记本。先简单记录下运行过程中的粗略日志。顺便一提，我先尝试在Docker上的CentOS6上运行，但遇到了许多问题，所以先暂停，并改为在Ubuntu上（可以是Digital Ocean的虚拟机，也可以是实体机）进行了尝试。

环境

Incubator-zeppelin 2015/05/22

安装

套餐

由于出现了一个错误，错误信息是“Maven的版本必须是3.1.0或更高”，所以我没有使用apt-get命令来安装，而是选择单独安装。

# apt-get update
# apt-get install openjdk-7-jdk
# apt-get install git
# apt-get install npm

Maven:
maven

# wget http://ftp.riken.jp/net/apache/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz
# tar zxf apache-maven-3.3.3-bin.tar.gz -C /usr/local
# export PATH=/usr/local/apache-maven-3.3.3/bin:$PATH
# export JAVA_HOME=/usr/lib/jvm/jre-openjdk
# mvn --version
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T07:57:37-04:00)
Maven home: /usr/local/apache-maven-3.3.3
Java version: 1.7.0_79, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-7-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.13.0-52-generic", arch: "amd64", family: "unix"

泽普林收到

# useradd -m hoge
# su - hoge
$ export PATH=/usr/local/apache-maven-3.3.3/bin:$PATH
$ export JAVA_HOME=/usr/lib/jvm/jre-openjdk
$ git clone https://github.com/apache/incubator-zeppelin.git
$ cd incubator-zeppelin/

建立

$ mvn clean package
$ mvn clean package -Pspark-1.3 -DskipTests

（略、ここは時間ちょっとかかります）

[INFO]
[INFO] Zeppelin ........................................... SUCCESS [  8.382 s]
[INFO] Zeppelin: Interpreter .............................. SUCCESS [ 35.828 s]
[INFO] Zeppelin: Zengine .................................. SUCCESS [ 13.561 s]
[INFO] Zeppelin: Spark .................................... SUCCESS [ 45.576 s]
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [  5.224 s]
[INFO] Zeppelin: Angular interpreter ...................... SUCCESS [  4.360 s]
[INFO] Zeppelin: Shell interpreter ........................ SUCCESS [  2.799 s]
[INFO] Zeppelin: Hive interpreter ......................... SUCCESS [  6.845 s]
[INFO] Zeppelin: Tajo interpreter ......................... SUCCESS [  4.346 s]
[INFO] Zeppelin: web Application .......................... SUCCESS [03:59 min]
[INFO] Zeppelin: Server ................................... SUCCESS [01:23 min]
[INFO] Zeppelin: Packaging distribution ................... SUCCESS [  1.305 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:32 min
[INFO] Finished at: 2015-05-22T20:42:04-04:00
[INFO] Final Memory: 81M/285M
[INFO] ------------------------------------------------------------------------
$

启动和停止 hé

hoge@mydroplet-test:~/incubator-zeppelin$ bin/zeppelin-daemon.sh start
Log dir doesn't exist, create /home/hoge/incubator-zeppelin/logs
Pid dir doesn't exist, create /home/hoge/incubator-zeppelin/run
Zeppelin start                                             [  OK  ]

hoge@mydroplet-test:~/incubator-zeppelin$ bin/zeppelin-daemon.sh stop
Zeppelin stop                                              [  OK  ]

浏览器访问 (Browser access)

在中国网络中，使用8080端口进行访问。

动了动了。

将来的未来

因为可以在集群上运行，所以万一学会了Scala，也许可以用它来做一些事情。但是首先要熟悉使用sh和md命令行。

请看一下

https://github.com/apache/incubator-zeppelin