{"id":46728,"date":"2022-12-09T13:35:25","date_gmt":"2023-12-16T14:28:43","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/46728-2\/"},"modified":"2024-04-29T04:28:08","modified_gmt":"2024-04-28T20:28:08","slug":"46728-2","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/46728-2\/","title":{"rendered":""},"content":{"rendered":"

\u306f\u3058\u3081\u306b<\/h1>\n

Hortonworks\u306eHDF\u3092\u8a66\u305d\u3046\u3068\u601d\u3044\u307e\u3057\u305f\u304c\u3001PC\u3067\u306f\u30ea\u30bd\u30fc\u30b9\u4e0d\u8db3\u3067\u8a66\u305b\u306a\u304b\u3063\u305f\u306e\u3067\u305d\u308c\u305e\u308c\u306e\u30d1\u30fc\u30c4\u3067\u8a66\u3057\u3066\u307f\u307e\u3059\u3002\u307e\u305a\u306fNiFi\u3068Kafka\u3092Windows\u74b0\u5883\u3067\u4f7f\u3063\u3066\u307f\u3088\u3046\u3068\u601d\u3044\u307e
\n\u3059\u3002<\/p>\n

\u8ffd\u8a18\uff1a\u5f8c\u65e5Apache MiNiFi on Windows\u3082\u5b9f\u65bd\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n

1. \u524d\u63d0<\/h1>\n

\u4ee5\u4e0b\u306e\u74b0\u5883\u3067\u52d5\u4f5c\u3057\u305f\u5185\u5bb9\u3092\u8a18\u8ff0\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n

Windows 10 Home (64bit) *Memory 8G
\nJDK 1.8<\/p>\n

2. NiFi\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u8d77\u52d5<\/h1>\n
\"image.png\"<\/div>\n

DOS\u7a93\u3092\u7acb\u3061\u4e0a\u3052\u3001bin\\run-nifi.bat\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/p>\n

C:\\dev\\NIFI\\nifi-1.4.0\\bin>dir\r\n \u30c9\u30e9\u30a4\u30d6 C \u306e\u30dc\u30ea\u30e5\u30fc\u30e0 \u30e9\u30d9\u30eb\u306f Windows \u3067\u3059\r\n \u30dc\u30ea\u30e5\u30fc\u30e0 \u30b7\u30ea\u30a2\u30eb\u756a\u53f7\u306f A295-434A \u3067\u3059\r\n\r\n C:\\dev\\NIFI\\nifi-1.4.0\\bin \u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\r\n\r\n2018\/01\/08  15:00    <DIR>          .\r\n2018\/01\/08  15:00    <DIR>          ..\r\n2017\/09\/28  13:48             1,872 dump-nifi.bat\r\n2017\/09\/28  13:48             1,120 nifi-env.bat\r\n2017\/09\/28  13:48             1,110 nifi-env.sh\r\n2017\/09\/28  13:48            11,888 nifi.sh\r\n2017\/09\/28  13:48             1,871 run-nifi.bat\r\n2017\/09\/28  13:48             1,832 status-nifi.bat\r\n               6 \u500b\u306e\u30d5\u30a1\u30a4\u30eb              19,693 \u30d0\u30a4\u30c8\r\n               2 \u500b\u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea  34,516,406,272 \u30d0\u30a4\u30c8\u306e\u7a7a\u304d\u9818\u57df\r\n\r\nC:\\dev\\NIFI\\nifi-1.4.0\\bin>run-nifi.bat\r\n2018-01-08 15:02:22,666 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi...\r\n2018-01-08 15:02:22,668 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: C:\\dev\\NIFI\\NIFI-1~1.0\r\n2018-01-08 15:02:22,670 INFO [main] org.apache.nifi.bootstrap.Command Command: C:\\dev\\Java\\jdk1.8.0_102\\bin\\java.exe -classpath C:\\dev\\NIFI\\NIFI-1~1.0\\.\\conf;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\javax.servlet-api-3.1.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\jcl-over-slf4j-1.7.25.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\jetty-schemas-3.1.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\jul-to-slf4j-1.7.25.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\log4j-over-slf4j-1.7.25.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\logback-classic-1.2.3.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\logback-core-1.2.3.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\nifi-api-1.4.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\nifi-framework-api-1.4.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\nifi-nar-utils-1.4.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\nifi-properties-1.4.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\nifi-runtime-1.4.0.jar;C:\\dev\\NIFI\\NIFI-1~1.0\\.\\lib\\slf4j-api-1.7.25.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Djava.security.egd=file:\/dev\/urandom -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -XX:+UseG1GC -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=C:\\dev\\NIFI\\NIFI-1~1.0\\.\\conf\\nifi.properties -Dnifi.bootstrap.listen.port=55171 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=C:\\dev\\NIFI\\NIFI-1~1.0\\bin\\..\\\\logs org.apache.nifi.NiFi\r\n2018-01-08 15:02:23,069 WARN [main] org.apache.nifi.bootstrap.Command Failed to set permissions so that only the owner can read pid file C:\\dev\\NIFI\\NIFI-1~1.0\\bin\\..\\run\\nifi.pid; this may allows others to have access to the key needed to communicate with NiFi. Permissions should be changed so that only the owner can read this file\r\n2018-01-08 15:02:23,074 WARN [main] org.apache.nifi.bootstrap.Command Failed to set permissions so that only the owner can read status file C:\\dev\\NIFI\\NIFI-1~1.0\\bin\\..\\run\\nifi.status; this may allows others to have access to the key needed to communicate with NiFi. Permissions should be changed so that only the owner can read this file\r\n2018-01-08 15:02:23,085 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 8140\r\n<\/code><\/pre>\n
\u203b\u505c\u6b62\u3059\u308b\u5834\u5408\u306f\u3001CTRL+C\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002<\/p>\n
\"image.png\"<\/div>\n
3. Kafka\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u8d77\u52d5<\/h1>\n
\"image.png\"<\/div>\n
3.1 ZooKeeper\u306e\u8d77\u52d5<\/h2>\n
DOS\u7a93\u3092\u7acb\u3061\u4e0a\u3052\u3001zookeeper-server-start.bat\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/p>\n
 c:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows \u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\r\n\r\n2018\/01\/08  14:28    <DIR>          .\r\n2018\/01\/08  14:28    <DIR>          ..\r\n2017\/10\/28  00:56             1,241 connect-distributed.bat\r\n2017\/10\/28  00:56             1,239 connect-standalone.bat\r\n2017\/10\/28  00:56               873 kafka-acls.bat\r\n2017\/10\/28  00:56               885 kafka-broker-api-versions.bat\r\n2017\/10\/28  00:56               876 kafka-configs.bat\r\n2017\/10\/28  00:56               925 kafka-console-consumer.bat\r\n2017\/10\/28  00:56               925 kafka-console-producer.bat\r\n2017\/10\/28  00:56               883 kafka-consumer-groups.bat\r\n2017\/10\/28  00:56               884 kafka-consumer-offset-checker.bat\r\n2017\/10\/28  00:56               938 kafka-consumer-perf-test.bat\r\n2017\/10\/28  00:56               874 kafka-mirror-maker.bat\r\n2017\/10\/28  00:56               900 kafka-preferred-replica-election.bat\r\n2017\/10\/28  00:56               940 kafka-producer-perf-test.bat\r\n2017\/10\/28  00:56               888 kafka-reassign-partitions.bat\r\n2017\/10\/28  00:56               880 kafka-replay-log-producer.bat\r\n2017\/10\/28  00:56               886 kafka-replica-verification.bat\r\n2017\/10\/28  00:56             5,276 kafka-run-class.bat\r\n2017\/10\/28  00:56             1,377 kafka-server-start.bat\r\n2017\/10\/28  00:56               997 kafka-server-stop.bat\r\n2017\/10\/28  00:56               882 kafka-simple-consumer-shell.bat\r\n2017\/10\/28  00:56               875 kafka-topics.bat\r\n2017\/10\/28  00:56             1,192 zookeeper-server-start.bat\r\n2017\/10\/28  00:56               905 zookeeper-server-stop.bat\r\n2017\/10\/28  00:56               977 zookeeper-shell.bat\r\n              24 \u500b\u306e\u30d5\u30a1\u30a4\u30eb              27,518 \u30d0\u30a4\u30c8\r\n               2 \u500b\u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea  35,582,828,544 \u30d0\u30a4\u30c8\u306e\u7a7a\u304d\u9818\u57df\r\n\r\nc:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>zookeeper-server-start.bat ..\\..\\config\\zookeeper.properties\r\n[2018-01-08 14:36:18,762] INFO Reading configuration from: ..\\..\\config\\zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)\r\n[2018-01-08 14:36:18,769] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)\r\n[2018-01-08 14:36:18,769] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)\r\n[2018-01-08 14:36:18,771] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)\r\n[2018-01-08 14:36:18,772] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)\r\n[2018-01-08 14:36:18,789] INFO Reading configuration from: ..\\..\\config\\zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)\r\n[2018-01-08 14:36:18,790] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)\r\n[2018-01-08 14:36:18,802] INFO Server environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03\/23\/2017 10:13 GMT (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,802] INFO Server environment:host.name=DESKTOP-F0AFN64 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,803] INFO Server environment:java.version=1.8.0_102 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,806] INFO Server environment:java.vendor=Oracle Corporation (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,806] INFO Server environment:java.home=C:\\dev\\Java\\jdk1.8.0_102\\jre (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,809] INFO Server environment:java.class.path=c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\aopalliance-repackaged-2.5.0-b32.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\argparse4j-0.7.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\commons-lang3-3.5.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\connect-api-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\connect-file-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\connect-json-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\connect-runtime-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\connect-transforms-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\guava-20.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\hk2-api-2.5.0-b32.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\hk2-locator-2.5.0-b32.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\hk2-utils-2.5.0-b32.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-annotations-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-core-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-databind-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-jaxrs-base-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-jaxrs-json-provider-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jackson-module-jaxb-annotations-2.9.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javassist-3.20.0-GA.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javassist-3.21.0-GA.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javax.annotation-api-1.2.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javax.inject-1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javax.inject-2.5.0-b32.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javax.servlet-api-3.1.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\javax.ws.rs-api-2.0.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-client-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-common-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-container-servlet-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-container-servlet-core-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-guava-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-media-jaxb-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jersey-server-2.25.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-continuation-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-http-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-io-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-security-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-server-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-servlet-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-servlets-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jetty-util-9.2.22.v20170606.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\jopt-simple-5.0.4.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka-clients-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka-log4j-appender-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka-streams-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka-streams-examples-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka-tools-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-javadoc.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-javadoc.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-scaladoc.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-scaladoc.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-sources.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-sources.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-test-sources.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-test-sources.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-test.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0-test.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\kafka_2.11-1.0.0.jar.asc;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\log4j-1.2.17.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\lz4-java-1.4.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\maven-artifact-3.5.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\metrics-core-2.2.0.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\osgi-resource-locator-1.0.1.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\plexus-utils-3.0.24.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\reflections-0.9.11.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\rocksdbjni-5.7.3.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\scala-library-2.11.11.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\slf4j-api-1.7.25.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\slf4j-log4j12-1.7.25.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\snappy-java-1.1.4.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\validation-api-1.1.0.Final.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\zkclient-0.10.jar;c:\\dev\\kafka\\kafka_2.11-1.0.0\\libs\\zookeeper-3.4.10.jar (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,810] INFO Server environment:java.library.path=C:\\dev\\Java\\jdk1.8.0_102\\bin;C:\\WINDOWS\\Sun\\Java\\bin;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\dev\\utils\\gradle-4.3.1\\bin;C:\\Program Files\\MongoDB\\Server\\3.2\\bin;C:\\dev\\utils\\apache-maven-3.3.9\\bin;C:\\dev\\Java\\jdk1.8.0_102\\bin;C:\\Program Files (x86)\\Intel\\iCLS Client\\;C:\\Python27\\;C:\\Python27\\Scripts;C:\\ProgramData\\Oracle\\Java\\javapath;C:\\Program Files\\Intel\\iCLS Client\\;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\Program Files (x86)\\Brackets\\command;C:\\Program Files (x86)\\Microsoft SDKs\\Azure\\CLI\\wbin;C:\\Program Files (x86)\\Heroku\\bin;C:\\Program Files (x86)\\git\\cmd;C:\\Program Files (x86)\\Nodist\\bin;C:\\Program Files\\Git\\cmd;C:\\Program Files (x86)\\GtkSharp\\2.12\\bin;C:\\Program Files\\Intel\\WiFi\\bin\\;C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\;C:\\Program Files\\Cloud Foundry;C:\\Program Files (x86)\\Intel\\Intel(R) Management Engine Components\\DAL;C:\\Program Files\\Intel\\Intel(R) Management Engine Components\\DAL;C:\\Program Files (x86)\\Intel\\Intel(R) Management Engine Components\\IPT;C:\\Program Files\\Intel\\Intel(R) Management Engine Components\\IPT;C:\\Users\\tworks55\\AppData\\Local\\Microsoft\\WindowsApps;;C:\\Program Files\\Intel\\WiFi\\bin\\;C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\;C:\\Program Files\\Microsoft VS Code\\bin;. (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,811] INFO Server environment:java.io.tmpdir=C:\\Users\\tworks55\\AppData\\Local\\Temp\\ (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,811] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,812] INFO Server environment:os.name=Windows 10 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,812] INFO Server environment:os.arch=amd64 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,813] INFO Server environment:os.version=10.0 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,813] INFO Server environment:user.name=tworks55 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,814] INFO Server environment:user.home=C:\\Users\\tworks55 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,815] INFO Server environment:user.dir=c:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,825] INFO tickTime set to 3000 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,825] INFO minSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,826] INFO maxSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)\r\n[2018-01-08 14:36:18,892] INFO binding to port 0.0.0.0\/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)\r\n\r\n<\/code><\/pre>\n
\u203b\u505c\u6b62\u3059\u308b\u5834\u5408\u306f\u3001CTRL+C\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002<\/p>\n
3.2 Kafka\u306e\u8d77\u52d5<\/h2>\n
DOS\u7a93\u3092\u7acb\u3061\u4e0a\u3052\u3001kafka-server-start.bat\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/p>\n
C:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>kafka-server-start.bat ..\\..\\config\\server.properties\r\n[2018-01-08 15:20:07,707] INFO KafkaConfig values:\r\n        advertised.host.name = null\r\n        advertised.listeners = null\r\n        advertised.port = null\r\n        alter.config.policy.class.name = null\r\n        authorizer.class.name =\r\n        auto.create.topics.enable = true\r\n        auto.leader.rebalance.enable = true\r\n        background.threads = 10\r\n<\u4e2d\u7565>\r\n[2018-01-08 15:20:07,788] INFO Client environment:java.io.tmpdir=C:\\Users\\tworks55\\AppData\\Local\\Temp\\ (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,788] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,788] INFO Client environment:os.name=Windows 10 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,789] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,789] INFO Client environment:os.version=10.0 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,789] INFO Client environment:user.name=tworks55 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,790] INFO Client environment:user.home=C:\\Users\\tworks55 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,790] INFO Client environment:user.dir=C:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,791] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@130161f7 (org.apache.zookeeper.ZooKeeper)\r\n[2018-01-08 15:20:07,857] INFO Waiting for keeper state SyncConnected (org.I0Itec.zkclient.ZkClient)\r\n[2018-01-08 15:20:07,859] INFO Opening socket connection to server 127.0.0.1\/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)\r\n[2018-01-08 15:20:07,861] INFO Socket connection established to 127.0.0.1\/127.0.0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)\r\n[2018-01-08 15:20:07,871] INFO Session establishment complete on server 127.0.0.1\/127.0.0.1:2181, sessionid = 0x160d444fbd70004, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)\r\n[2018-01-08 15:20:07,873] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)\r\n[2018-01-08 15:20:08,060] INFO Cluster ID = 4-5EtuXgRkuslEisFtCGTg (kafka.server.KafkaServer)\r\n[2018-01-08 15:20:08,091] INFO [ThrottledRequestReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)\r\n[2018-01-08 15:20:08,092] INFO [ThrottledRequestReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)\r\n[2018-01-08 15:20:08,093] INFO [ThrottledRequestReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)\r\n[2018-01-08 15:20:08,126] INFO Loading logs. (kafka.log.LogManager)\r\n[2018-01-08 15:20:08,145] INFO Logs loading complete in 8 ms. (kafka.log.LogManager)\r\n[2018-01-08 15:20:08,196] WARN Error processing kafka.log:type=LogManager,name=LogDirectoryOffline,logDirectory=C:\\tmp\\kafka-logs (com.yammer.metrics.reporting.JmxReporter)\r\njavax.management.MalformedObjectNameException: Invalid character ':' in value part of property\r\n        at javax.management.ObjectName.construct(ObjectName.java:618)\r\n        at javax.management.ObjectName.<init>(ObjectName.java:1382)\r\n        at com.yammer.metrics.reporting.JmxReporter.onMetricAdded(JmxReporter.java:395)\r\n        at com.yammer.metrics.core.MetricsRegistry.notifyMetricAdded(MetricsRegistry.java:516)\r\n        at com.yammer.metrics.core.MetricsRegistry.getOrAdd(MetricsRegistry.java:491)\r\n        at com.yammer.metrics.core.MetricsRegistry.newGauge(MetricsRegistry.java:79)\r\n        at kafka.metrics.KafkaMetricsGroup$class.newGauge(KafkaMetricsGroup.scala:74)\r\n        at kafka.log.LogManager.newGauge(LogManager.scala:50)\r\n        at kafka.log.LogManager$$anonfun$6.apply(LogManager.scala:117)\r\n        at kafka.log.LogManager$$anonfun$6.apply(LogManager.scala:116)\r\n        at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)\r\n        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)\r\n        at kafka.log.LogManager.<init>(LogManager.scala:116)\r\n        at kafka.log.LogManager$.apply(LogManager.scala:799)\r\n        at kafka.server.KafkaServer.startup(KafkaServer.scala:222)\r\n        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)\r\n        at kafka.Kafka$.main(Kafka.scala:92)\r\n        at kafka.Kafka.main(Kafka.scala)\r\n[2018-01-08 15:20:08,201] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)\r\n[2018-01-08 15:20:08,203] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)\r\n[2018-01-08 15:20:08,502] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)\r\n[2018-01-08 15:20:08,505] INFO [SocketServer brokerId=0] Started 1 acceptor threads (kafka.network.SocketServer)\r\n[2018-01-08 15:20:08,523] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,524] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,525] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,532] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)\r\n[2018-01-08 15:20:08,565] INFO [ExpirationReaper-0-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,569] INFO [ExpirationReaper-0-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,571] INFO [ExpirationReaper-0-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)\r\n[2018-01-08 15:20:08,576] INFO Creating \/controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)\r\n[2018-01-08 15:20:08,580] INFO [GroupCoordinator 0]: Starting up. (kafka.coordinator.group.GroupCoordinator)\r\n[2018-01-08 15:20:08,581] INFO [GroupCoordinator 0]: Startup complete. (kafka.coordinator.group.GroupCoordinator)\r\n[2018-01-08 15:20:08,583] INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 2 milliseconds. (kafka.coordinator.group.GroupMetadataManager)\r\n[2018-01-08 15:20:08,587] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral)\r\n[2018-01-08 15:20:08,595] INFO [ProducerId Manager 0]: Acquired new producerId block (brokerId:0,blockStartProducerId:4000,blockEndProducerId:4999) by writing to Zk with path version 5 (kafka.coordinator.transaction.ProducerIdManager)\r\n[2018-01-08 15:20:08,616] INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)\r\n[2018-01-08 15:20:08,618] INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)\r\n[2018-01-08 15:20:08,618] INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)\r\n[2018-01-08 15:20:08,662] INFO Creating \/brokers\/ids\/0 (is it secure? false) (kafka.utils.ZKCheckedEphemeral)\r\n[2018-01-08 15:20:08,671] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral)\r\n[2018-01-08 15:20:08,672] INFO Registered broker 0 at path \/brokers\/ids\/0 with addresses: EndPoint(DESKTOP-F0AFN64,9092,ListenerName(PLAINTEXT),PLAINTEXT) (kafka.utils.ZkUtils)\r\n[2018-01-08 15:20:08,678] INFO Kafka version : 1.0.0 (org.apache.kafka.common.utils.AppInfoParser)\r\n[2018-01-08 15:20:08,678] INFO Kafka commitId : aaa7af6d4a11b29d (org.apache.kafka.common.utils.AppInfoParser)\r\n[2018-01-08 15:20:08,680] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)\r\n\r\n<\/code><\/pre>\n
[2018-01-08 15:20:08,196] WARN Error processing kafka.log:type=LogManager,name=LogDirectoryOffline,logDirectory=C:\\tmp\\kafka-logs (com.yammer.metrics.reporting.JmxReporter)
\njavax.management.MalformedObjectNameException: Invalid character ‘:’ in value part of property
\n\u3068\u3044\u3046\u30a8\u30e9\u30fc\u304c\u8868\u793a\u3055\u308c\u307e\u3059\u304cKAFKA-6156\u3092\u898b\u308b\u3068\u307e\u3060\u30ea\u30ea\u30fc\u30b9\u3055\u308c\u3066\u3044\u306a\u30441.1.0\u3067\u306f\u4fee\u6b63\u3055\u308c\u3066\u3044\u308b\u3088\u3046\u3067\u3059\u3002
\n\u3068\u308a\u3042\u3048\u305a\u4eca\u56de\u306f\u7121\u8996\u3057\u307e\u3059\u3002<\/p>\n
4 Kafka\u306e\u52d5\u4f5c\u78ba\u8a8d<\/h1>\n
4.1 Topic\u306e\u4f5c\u6210\u3068\u78ba\u8a8d<\/h2>\n
DOS\u7a93\u3092\u7acb\u3061\u4e0a\u3052\u3001kafka-topics.bat –create\u3067Topic\u3092\u4f5c\u6210\u3057\u3001kafka-topics.bat –list\u3067\u78ba\u8a8d\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n
c:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic hello-kafka\r\nCreated topic \"hello-kafka\".\r\n\r\nc:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>kafka-topics.bat --list --zookeeper localhost:2181\r\nhello-kafka\r\n<\/code><\/pre>\n
4.2 Producer\u306e\u8d77\u52d5\u3068\u30e1\u30c3\u30bb\u30fc\u30b8\u306e\u9001\u4fe1<\/h2>\n
kafka-console-producer.bat\u3067Producer\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002>\u30de\u30fc\u30af\u304c\u51fa\u3066\u304d\u305f\u3089\u3001\u30ad\u30fc\u30dc\u30fc\u30c9\u3067\u9069\u5f53\u306a\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u6253\u3061\u8fbc\u307f\u307e\u3059\u3002<\/p>\n
c:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>kafka-console-producer.bat --broker-list localhost:9092 --topic hello-kafka\r\n>Hello kafka!\r\n>My name is tworks55\r\n>\r\n<\/code><\/pre>\n
\u203b\u505c\u6b62\u3059\u308b\u5834\u5408\u306f\u3001CTRL+C\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002<\/p>\n
4.3 Consumer\u306e\u8d77\u52d5\u3068\u30e1\u30c3\u30bb\u30fc\u30b8\u306e\u53d7\u4fe1<\/h1>\n
DOS\u7a93\u3092\u7acb\u3061\u4e0a\u3052\u3001kafka-console-consumer.bat\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002\u4e0a\u8a18Producer\u306eDOS\u7a93\u3067\u5165\u529b\u3057\u305f\u30e1\u30c3\u30bb\u30fc\u30b8\u304c\u53d7\u4fe1\u3067\u304d\u308c\u3070\u6210\u529f\u3067\u3059\u3002<\/p>\n
c:\\dev\\kafka\\kafka_2.11-1.0.0\\bin\\windows>kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic hello-kafka --from-beginning\r\nHello kafka!\r\nMy name is tworks55\r\n<\/code><\/pre>\n
*CTRL+C\u3067\u505c\u6b62\u3067\u304d\u3001\u518d\u5ea6\u540c\u3058\u30b3\u30de\u30f3\u30c9\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u518d\u53d7\u4fe1\u3067\u304d\u307e\u3059\u3002–from-beginning\u3092\u5916\u3059\u3068\u540c\u3058\u30e1\u30c3\u30bb\u30fc\u30b8\u306f\u53d7\u4fe1\u3055\u308c\u307e\u305b\u3093\u3002
\n*Procucer\u5074\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u8ffd\u8a18\u3059\u308b\u3068\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u3067\u53d7\u4fe1\u3067\u304d\u307e\u3059\u3002<\/p>\n
\u3053\u308c\u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u5b8c\u4e86\u3067\u3059\u3002<\/p>\n
Kafka\u3092\u505c\u6b62\u3059\u308b\u969b\u3067\u3059\u304c\u3001\u5148\u306bZooKeeper\u3092\u6b62\u3081\u3066\u3057\u307e\u3046\u3068Kafka\u304c\u30a8\u30e9\u30fc\u306b\u306a\u308a\u307e\u3059\u3002
\nConsumer, Producer, Kafka, ZooKeeper\u3068\u3044\u3046\u9806\u3067\u505c\u6b62\u3057\u307e\u3057\u3087\u3046\u3002
\n\u203b\u3044\u308d\u3044\u308d\u306a\u9806\u756a\u3067\u505c\u6b62\u3057\u3066\u307f\u308b\u3068\u305d\u308c\u305e\u308c\u306e\u4f9d\u5b58\u95a2\u4fc2\u306e\u7406\u89e3\u304c\u6df1\u307e\u308b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n
\u53c2\u8003URL<\/h1>\n
https:\/\/nifi.apache.org\/docs\/nifi-docs\/html\/getting-started.html<\/p>\n
Install Apache Kafka On Windows<\/a><\/p><\/blockquote>\n