{"id":46755,"date":"2023-02-13T15:58:53","date_gmt":"2023-01-05T06:36:48","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/"},"modified":"2024-04-29T14:27:51","modified_gmt":"2024-04-29T06:27:51","slug":"46755-2","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/","title":{"rendered":""},"content":{"rendered":"<h1>\u4ee5\u524d\u306b\u66f8\u3044\u305fEqualum\u691c\u8a3c\u306e\u7d9a\u304d\u30fb\u30fb\u30fb\u30fb<\/h1>\n<p>\u524d\u306b\u6295\u7a3f\u3057\u305fEqualum\u306e\u691c\u8a3c\u3067\u3001kafka\u3092\u4e0a\u6d41\u5074\u30c7\u30fc\u30bf\u30bd\u30fc\u30b9\u3068\u3057\u3066\u4f7f\u3048\u306a\u3044\u306e\u304b\uff1f\u30fb\u30fb\u30fb\u306a\u308b\u3054\u8cea\u554f\u3092\u9802\u304f\u30b1\u30fc\u30b9\u304c\u7d50\u69cb\u6709\u308a\u307e\u3057\u305f\u306e\u3067\u3001\u4eca\u56de\u306f\u7c21\u5358\u306akafka\u74b0\u5883\u3068\u306e\u63a5\u7d9a\u691c\u8a3c\u3092\u884c\u3063\u3066\u307f\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<h1>\u307e\u305a\u306fkafka\u74b0\u5883\u306e\u69cb\u7bc9<\/h1>\n<p>\u30cf\u30fc\u30c9\u30a6\u30a8\u30a2\u3092\u6b63\u5f0f\u306b\u7528\u610f\u3057\u3066\u3001\u4fdd\u5b88\u672c\u6d41\u30fb\u738b\u9053\u306ekafka\u74b0\u5883\u3092\u69cb\u7bc9\u3059\u308b\u30fb\u30fb\u3068\u3044\u3046\u65b9\u5411\u6027\u3082\u6709\u308b\u306e\u3067\u3059\u304c\u3001\u4eca\u56de\u306f\u666e\u6bb5\u4f7f\u3044\u306eMBP\u306e\u4e0a\u306b\u30b5\u30e9\u30c3\u3068kafka\u74b0\u5883\u3092\u69cb\u7bc9\u3057\u3066\u3001\u305d\u306e\u74b0\u5883\u306b\u5bfe\u3057\u3066Python\u3067\u4f5c\u3063\u305f\u30b9\u30af\u30ea\u30d7\u30c8\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u6295\u3052\u3001\u305d\u306e\u30e1\u30c3\u30bb\u30fc\u30b8\u3092Equalum\u304c\u53d7\u3051\u53d6\u3063\u3066\u5fc5\u8981\u306a\u51e6\u7406\uff08\u4eca\u56de\u306f\u30e1\u30c3\u30bb\u30fc\u30b8\u306e\u5206\u89e3\u3068\u30ab\u30e9\u30e0\u5316\u3092\u884c\u3044\u307e\u3059\uff09\u3092FLOW\u3067\u4f5c\u6210\u3057\u3001\u30bf\u30fc\u30b2\u30c3\u30c8\u3068\u3057\u3066\u540c\u3058MBP\u4e0a\u3067\u52d5\u3044\u3066\u3044\u308bDocker\u74b0\u5883\u3067\u7a3c\u50cd\u3057\u3066\u3044\u308bMySQL\u306b\u7740\u5730\u3055\u305b\u3066\u307f\u308b\u3053\u3068\u306b\u3057\u307e\u3059\u3002<\/p>\n<h1>\u4e8b\u524d\u306e\u8a00\u3044\u8a33\u30fb\u30fb\u30fbm(_ _)m\uff08\u82e6\u7b11\uff09<\/h1>\n<p>kafka\u5468\u8fba\u306e\u6280\u8853\u60c5\u5831\u306f\u3001\u65e2\u306b\u591a\u304f\u306e\u8af8\u5148\u8f29\u65b9\u304cQiita\u3001\u305d\u306e\u4ed6\u306e\u8a18\u4e8b\u3068\u3057\u3066\u516c\u958b\u3055\u308c\u3066\u3044\u307e\u3059\u306e\u3067\u3001\u305d\u308c\u3089\u306e\u8a18\u4e8b\u3092\u662f\u975e\uff01\u53c2\u8003\u306b\u3057\u3066\u898b\u3066\u304f\u3060\u3055\u3044\u3002\u4eca\u56de\u306e\u691c\u8a3c\u306f\u3001\u3042\u304f\u307e\u3067\u3082\u52d5\u304f\u304b\u3069\u3046\u304b\u3092\u78ba\u8a8d\u3059\u308b\u30fb\u30fb\u3068\u3044\u3046\u90e8\u5206\u3067\u6226\u7565\u7684\u59a5\u5354\u3092\u3057\u3066\u304a\u308a\u307e\u3059\uff08\u6c57\uff09\u3002\u3002\u3002<\/p>\n<p>\u307e\u305f\u3001\u4eca\u56de\u306f\u7d19\u9762\u306e\u90fd\u5408\u4e0a\u30fb\u30fbkafka\u5468\u308a\u306e\u6e96\u5099\u307e\u3067\u306b\u306a\u308a\u307e\u3059\uff08Equalum\u3068\u306e\u9023\u643a\u306f\u6b21\u56de\u3092\u4e88\u5b9a\uff09\u306e\u3067\u3001\u305d\u306e\u8fba\u306f\u4f55\u5352\u3054\u7406\u89e3\u9802\u304d\u305f\u304f\u30fb\u30fb\u30fb<\/p>\n<h2>\u307e\u305a\u6700\u521d\u306bbrew\u74b0\u5883\u306e\u5c0e\u5165\uff08\u5c0e\u5165\u6e08\u307f\u306e\u5834\u5408\u4e0d\u8981\u3067\u3059\uff09<\/h2>\n<p>Mac\u74b0\u5883\u3078homebrew\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n<h2>kafka\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\uff08zookeeper\u3082\u4e00\u7dd2\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u307e\u3059\uff09<\/h2>\n<pre class=\"post-pre\"><code>% brew <span class=\"nb\">install <\/span>kafka \r\n<\/code><\/pre>\n<h2>kafka\u3092\u8d77\u52d5\u3057\u3066\u307f\u307e\u3059<\/h2>\n<p>\u7121\u4e8b\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u304c\u51fa\u6765\u308c\u3070\u3001\u74b0\u5883\u3092\u7acb\u3061\u4e0a\u3052\u3066\u307f\u307e\u3057\u3087\u3046\u3002<\/p>\n<pre class=\"post-pre\"><code>% brew services start zookeeper\r\n% brew services start kafka \r\n<\/code><\/pre>\n<p>zookeeper \u306f localhost:2181, kafka \u306f localhost:9092 \u3067\u8d77\u52d5\u3057\u307e\u3059\uff08\u6a19\u6e96\u8a2d\u5b9a\uff09<br \/>\n\u307e\u305f\u3001\u74b0\u5883\u8a2d\u5b9a\u306e\u30d5\u30a1\u30a4\u30eb\u306f\/usr\/local\/etc\/kafka\/server.properties\u306b\u6709\u308b\u3068\u601d\u3044\u307e\u3059\u306e\u3067\u3001\u53d6\u308a\u6025\u304e\u30c8\u30d4\u30c3\u30af\u3092\u524a\u9664\u51fa\u6765\u308b\u3088\u3046\u306b\u8a2d\u5b9a\u3092\u5909\u66f4\u3057\u3066\u304a\u304d\u307e\u3059\uff08\u6700\u521d\u3001\u30b3\u30de\u30f3\u30c9\u3067\u8a66\u9a13\u7684\u306b\u4f5c\u3063\u305f\u5e7e\u3064\u304b\u306e\u30c8\u30d4\u30c3\u30af\u3092\u3001\u521d\u671f\u5316\uff06\u30ea\u30bd\u30fc\u30b9\u3092\u89e3\u653e\u3057\u3088\u3046\u3068\u524a\u9664\u3057\u3066\u3044\u305f\u306e\u3067\u3059\u304c\u3001\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u3063\u3066\u65e2\u5b58\u30ea\u30b9\u30c8\u3092\u898b\u308b\u3068\u6c38\u4e45\u4e0d\u6ec5\u306e\u30c8\u30d4\u30c3\u30af\u72b6\u614b\u3067\u3001\u3042\u308c\uff1f\u30fb\u30fb\u30fb\u3068\u3044\u3046\u4e8b\u3067\u63a2\u3057\u5f53\u3066\u305f\u8a2d\u5b9a\u306b\u306a\u308a\u307e\u3059\u30fb\u30fb\u30fb\u3054\u53c2\u8003\u307e\u3067\uff09<\/p>\n<pre class=\"post-pre\"><code>delete.topic.enable<span class=\"o\">=<\/span><span class=\"nb\">true<\/span>\r\n<\/code><\/pre>\n<p>\u3053\u306e\u8a2d\u5b9a\u3092\u30d5\u30a1\u30a4\u30eb\u306b\u52a0\u3048\u3066\u304b\u3089\u3001\u74b0\u5883\u3092\u518d\u8d77\u52d5\u3057\u307e\u3059\u3002\u8d77\u52d5\u4e2d\u306e\u74b0\u5883\u3092\u6b62\u3081\u308b\u5834\u5408\u306f<\/p>\n<pre class=\"post-pre\"><code>% brew services stop kafka \r\n% brew services stop zookeeper\r\n<\/code><\/pre>\n<p>\u3092\u884c\u3044\u307e\u3059\u3002<\/p>\n<h1>\u672c\u683c\u7684\u306bkafka\u3092\u5f04\u3063\u3066\u307f\u308b<\/h1>\n<p>\u307e\u305a\u306f\u3001\u691c\u8a3c\u306b\u4f7f\u3046\u30c8\u30d4\u30c3\u30af\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code>% kafka-topics <span class=\"nt\">--create<\/span> <span class=\"nt\">--zookeeper<\/span> localhost:2181 <span class=\"nt\">--replication-factor<\/span> 1 <span class=\"nt\">--partitions<\/span> 1 <span class=\"nt\">--topic<\/span> XXXXX \u2028\u2028\r\n\r\n\u4e2d\u30d1\u30e9\u30e1\u30fc\u30bf\u306f\u5168\u3066\u5fc5\u8981\u307f\u305f\u3044\u306a\u306e\u3067\u3001\u3053\u306e\u307e\u307e\u30b3\u30d4\u30da\u3067\u4f7f\u3063\u3066\u6700\u5f8c\u306e\u30c8\u30d4\u30c3\u30af\u540d\u3060\u3051\u9069\u5b9c\u5909\u66f4\u3057\u307e\u3059\r\n\r\n\u56e0\u307f\u306b\u30fb\u30fb\u30fb\u30fb\r\n<span class=\"k\">*<\/span> <span class=\"nt\">--create<\/span> \u3067\u30c8\u30d4\u30c3\u30af\u306e\u4f5c\u6210\r\n<span class=\"k\">*<\/span> <span class=\"nt\">--zookeeper<\/span> localhost:2181 \u3067 zookeeper \u306e LISTEN \u30a2\u30c9\u30ec\u30b9\u306e\u6307\u5b9a\r\n<span class=\"k\">*<\/span> <span class=\"nt\">--replication-factor<\/span> 1 \u3067\u30ec\u30d7\u30ea\u30ab\u3092 1 \u3064\u306e\u307f\u751f\u6210\r\n<span class=\"k\">*<\/span> <span class=\"nt\">--partitions<\/span> 1 \u3067\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u3092 1 \u3064\u306e\u307f\u751f\u6210\r\n<span class=\"k\">*<\/span> <span class=\"nt\">--topic<\/span> \u3067\u30c8\u30d4\u30c3\u30af\u540d\u3092\u6307\u5b9a \r\n\u3067\u3059\r\n<\/code><\/pre>\n<p>\u4eca\u56de\u306f\u3001MBP\u306e\u8cc7\u6e90\u4fdd\u8b77\u306e\u89b3\u70b9\u304b\u3089\u6700\u5c0f\u69cb\u6210\u3067\u8a2d\u5b9a\u3057\u307e\u3057\u305f\u3002<\/p>\n<h2>\u30c8\u30d4\u30c3\u30af\u5468\u308a\u306e\u51e6\u7406\u306b\u3064\u3044\u3066<\/h2>\n<p>\u74b0\u5883\u304c\u8d77\u52d5\u3057\u3066\u3001\u53d6\u308a\u6025\u304e\u306e\u30c8\u30d4\u30c3\u30af\u3092\u4f5c\u6210\u3057\u305f\u3089\u30ea\u30b9\u30c8\u3067\u8868\u793a\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code>% kafka-topics <span class=\"nt\">--list<\/span> <span class=\"nt\">--zookeeper<\/span> localhost:2181\r\n<\/code><\/pre>\n<p>\u307e\u305f\u3001\u521d\u671f\u5316\u7b49\u3092\u884c\u3046\u5834\u5408\u306f\u3001kafka\u306e\u4f5c\u6cd5\u306b\u5f93\u3063\u3066\uff08\uff1f\uff09\u30c8\u30d4\u30c3\u30af\u81ea\u4f53\u3092\u524a\u9664\u30fb\u521d\u671f\u5316\u3059\u308b\u5fc5\u8981\u304c\u6709\u308a\u307e\u3059\u306e\u3067\u3001\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3067\u51e6\u7406\u3092\u884c\u3044\u307e\u3059\u3002\uff08\u524d\u8ff0\u306e\u8a2d\u5b9a\u3092\u304a\u5fd8\u308c\u306a\u304f\u30fb\u30fb\u30fb\uff09<\/p>\n<pre class=\"post-pre\"><code>% kafka-topics <span class=\"nt\">--delete<\/span> <span class=\"nt\">--zookeeper<\/span> localhost:2181 <span class=\"nt\">--topic<\/span> XXXXXXX\r\n<\/code><\/pre>\n<h2>\u4eca\u56de\u306e\u691c\u8a3c\u3067\u306f\u4f7f\u3044\u307e\u305b\u3093\u304c\u3001\u30b3\u30de\u30f3\u30c9\u51e6\u7406\u3067\u5f04\u308b\u5834\u5408\u306e\u53c2\u8003\u3068\u3057\u3066\u30fb\u30fb\u30fb<\/h2>\n<p>\u30d7\u30ed\u30c7\u30e5\u30fc\u30b5\u30fc\u3092\u8d77\u52d5\u3059\u308b\u5834\u5408\u306f\u3001\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3067\u51e6\u7406\u3092\u884c\u3044\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code>% kafka-console-producer <span class=\"nt\">--broker-list<\/span> localhost:9092 <span class=\"nt\">--topic<\/span> XXXXXXX\r\n<\/code><\/pre>\n<p>\u540c\u69d8\u306b\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u306e\u8d77\u52d5\u306f\u3001\u5c11\u3057\u9577\u3081\u306b\u306a\u308a\u307e\u3059\u304c<\/p>\n<pre class=\"post-pre\"><code>% kafka-console-consumer <span class=\"nt\">--bootstrap-server<\/span> localhost:9092 <span class=\"nt\">--topic<\/span> XXXXXXX <span class=\"nt\">--from-beginning<\/span>\r\n<\/code><\/pre>\n<p>\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u5f85\u53d7\u72b6\u614b\u306b\u306a\u308a\u307e\u3059\u306e\u3067\u3001\u53cc\u65b9\u304c\u8d77\u52d5\u3057\u3066\u3044\u308b\u72b6\u614b\u3067\u9069\u5f53\u306a\u6587\u5b57\u5217\u3092\u5165\u529b\u3057\u3066\u3001\u30ea\u30bf\u30fc\u30f3\u30ad\u30fc\u3092\u62bc\u3059\u4e8b\u306b\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306e\u30b3\u30f3\u30bd\u30fc\u30eb\u306b\u5165\u529b\u3055\u308c\u305f\u6587\u5b57\u5217\u304c\u30e1\u30c3\u30bb\u30fc\u30b8\u3068\u3057\u3066\u8868\u793a\u3055\u308c\u308b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<h1>\u3067\u306f\u3001\u691c\u8a3c\u7528\u306ePython\u3092\u66f8\u304d\u307e\u3059<\/h1>\n<p>\u4eca\u56de\u306e\u691c\u8a3c\u3067\u306f\u3001Python\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f7f\u3063\u3066\uff08pyautogui\uff09\u753b\u9762\u4e0a\u306e\u30de\u30a6\u30b9\u5ea7\u6a19\u3092\u53d6\u5f97\u3057\u3001\u305d\u306e\u60c5\u5831\u3068\u8b58\u5225\u60c5\u5831\u3068\u3057\u3066\u30bf\u30a4\u30e0\u30b9\u30bf\u30f3\u30d7\u7684\u306a\u60c5\u5831\u3092\u7d44\u307f\u5408\u308f\u305b\u3001JSON\u5f62\u5f0f\u3067Equalum\u3092\u901a\u904e\u3055\u305b\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002\u30cd\u30c3\u30c8\u4e0a\u306b\u306f\u8af8\u5148\u8f29\u65b9\u306e\u6b74\u6226\u306e\u82e6\u52b4\u306e\u8cdc\u7269\u304c\u6ca2\u5c71\u516c\u958b\u3055\u308c\u3066\u304a\u308a\u307e\u3059\u306e\u3067\u3001\u305d\u308c\u3089\u3092\u53c2\u8003\u306b\u3057\u3066\u9802\u3051\u3070\u3001\u3055\u307b\u3069\u96e3\u3057\u304f\u306a\u304f\u300c\u53d6\u308a\u6562\u3048\u305a\u52d5\u304f\uff1d\u52d5\u304d\u3092\u4f5c\u308b\uff08\u52d5\u4f5c\u3059\u308b\uff09\u300d\u7248\u306f\u4f5c\u308c\u308b\u304b\u3068\u601d\u3044\u307e\u3059\u3002\u4eca\u56de\u4f5c\u6210\u3057\u3066\u691c\u8a3c\u306b\u4f7f\u3063\u305f\u30b9\u30af\u30ea\u30d7\u30c8\u306f\u4ee5\u4e0b\u306e\u901a\u308a\u3067\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"c1\">#\r\n#   Equalum\u306ekafka\u63a5\u7d9a\u691c\u8a3c\r\n#\r\n#   \u30d7\u30ed\u30c7\u30e5\u30fc\u30b5\u5074\u306e\u51e6\u7406(JSON\u5f62\u5f0f\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u9001\u4fe1)\r\n#\r\n<\/span>\r\n<span class=\"kn\">from<\/span> <span class=\"nn\">kafka<\/span> <span class=\"kn\">import<\/span> <span class=\"n\">KafkaProducer<\/span>\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">pyautogui<\/span>\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">time<\/span>\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">json<\/span>\r\n\r\n\r\n<span class=\"k\">try<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"c1\"># \u5909\u6570\u306e\u521d\u671f\u5316\r\n<\/span>    <span class=\"n\">Counter<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">1<\/span>\r\n    <span class=\"n\">TimeOut<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">60<\/span>\r\n    <span class=\"n\">Sleep<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">1<\/span>\r\n\r\n    <span class=\"c1\"># \u30d7\u30ed\u30c7\u30e5\u30fc\u30b5\u30fc\u3068\u306e\u63a5\u7d9a\u51e6\u7406\r\n<\/span>    <span class=\"n\">producer<\/span> <span class=\"o\">=<\/span> <span class=\"n\">KafkaProducer<\/span><span class=\"p\">(<\/span><span class=\"n\">bootstrap_servers<\/span><span class=\"o\">=<\/span><span class=\"s\">'localhost:9092'<\/span><span class=\"p\">,<\/span> <span class=\"n\">value_serializer<\/span><span class=\"o\">=<\/span><span class=\"k\">lambda<\/span> <span class=\"n\">m<\/span><span class=\"p\">:<\/span> <span class=\"n\">json<\/span><span class=\"p\">.<\/span><span class=\"n\">dumps<\/span><span class=\"p\">(<\/span><span class=\"n\">m<\/span><span class=\"p\">).<\/span><span class=\"n\">encode<\/span><span class=\"p\">(<\/span><span class=\"s\">'utf-8'<\/span><span class=\"p\">))<\/span>\r\n<span class=\"err\">\u3000\u3000<\/span>\r\n    <span class=\"c1\">#\u5b89\u6613\u3067\u3059\u304c\u3001\u7121\u9650\u30eb\u30fc\u30d7\u3067\u51e6\u7406\u3057\u307e\u3059\u3002\r\n<\/span>    <span class=\"k\">while<\/span> <span class=\"bp\">True<\/span><span class=\"p\">:<\/span>\r\n\r\n        <span class=\"c1\"># \u65e5\u4ed8\u60c5\u5831\u3068\u6642\u9593\u60c5\u5831\u306e\u53d6\u5f97\r\n<\/span>        <span class=\"kn\">from<\/span> <span class=\"nn\">datetime<\/span> <span class=\"kn\">import<\/span> <span class=\"n\">datetime<\/span>\r\n        <span class=\"n\">messageId<\/span> <span class=\"o\">=<\/span> <span class=\"n\">datetime<\/span><span class=\"p\">.<\/span><span class=\"n\">now<\/span><span class=\"p\">().<\/span><span class=\"n\">strftime<\/span><span class=\"p\">(<\/span><span class=\"s\">\"%Y\/%m\/%d-%H:%M:%S:%f\"<\/span><span class=\"p\">)<\/span>\r\n\r\n        <span class=\"c1\"># JSON\u5f62\u5f0f\u306b\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u4f5c\u6210\r\n<\/span>        <span class=\"n\">kafka_msg<\/span> <span class=\"o\">=<\/span> <span class=\"p\">{<\/span><span class=\"s\">\"id\"<\/span> <span class=\"p\">:<\/span> <span class=\"n\">messageId<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"x\"<\/span> <span class=\"p\">:<\/span> <span class=\"n\">pyautogui<\/span><span class=\"p\">.<\/span><span class=\"n\">position<\/span><span class=\"p\">().<\/span><span class=\"n\">x<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"y\"<\/span> <span class=\"p\">:<\/span> <span class=\"n\">pyautogui<\/span><span class=\"p\">.<\/span><span class=\"n\">position<\/span><span class=\"p\">().<\/span><span class=\"n\">y<\/span><span class=\"p\">}<\/span>\r\n\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"n\">kafka_msg<\/span><span class=\"p\">)<\/span>\r\n\r\n        <span class=\"c1\"># \u30d7\u30ed\u30c7\u30e5\u30fc\u30b5\u30fc\u306b\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u9001\u308b       \r\n<\/span>        <span class=\"n\">result<\/span> <span class=\"o\">=<\/span> <span class=\"n\">producer<\/span><span class=\"p\">.<\/span><span class=\"n\">send<\/span><span class=\"p\">(<\/span><span class=\"s\">'JSON'<\/span><span class=\"p\">,<\/span> <span class=\"n\">kafka_msg<\/span><span class=\"p\">).<\/span><span class=\"n\">get<\/span><span class=\"p\">(<\/span><span class=\"n\">timeout<\/span><span class=\"o\">=<\/span><span class=\"n\">TimeOut<\/span><span class=\"p\">)<\/span>\r\n\r\n        <span class=\"c1\">#print(result)\r\n<\/span>\r\n        <span class=\"n\">time<\/span><span class=\"p\">.<\/span><span class=\"n\">sleep<\/span><span class=\"p\">(<\/span><span class=\"n\">Sleep<\/span><span class=\"p\">)<\/span>\r\n\r\n        <span class=\"n\">Counter<\/span> <span class=\"o\">=<\/span> <span class=\"n\">Counter<\/span> <span class=\"o\">+<\/span> <span class=\"mi\">1<\/span>\r\n\r\n<span class=\"k\">except<\/span> <span class=\"nb\">KeyboardInterrupt<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">'!!!!! \u5272\u308a\u8fbc\u307f\u767a\u751f !!!!!'<\/span><span class=\"p\">)<\/span>\r\n\r\n<span class=\"k\">finally<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"k\">print<\/span> <span class=\"p\">(<\/span><span class=\"s\">\"\u51e6\u7406\u306e\u7d42\u4e86\"<\/span><span class=\"p\">)<\/span>    \r\n    <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"nb\">str<\/span><span class=\"p\">(<\/span><span class=\"n\">Counter<\/span><span class=\"p\">)<\/span> <span class=\"o\">+<\/span> <span class=\"s\">\"\u56de\u306e\u51e6\u7406\u3092\u5b9f\u884c\u3057\u307e\u3057\u305f\"<\/span><span class=\"p\">)<\/span>\r\n<\/code><\/pre>\n<p>Equalum\u306b\u63a5\u7d9a\u3059\u308b\u524d\u306b\u3001\u53d6\u308a\u6025\u304eMBP\u4e0a\u3067\u7acb\u3061\u4e0a\u3052\u305fkafka\u74b0\u5883\u3092\u901a\u3057\u3066\u307f\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<br \/>\n\u30c8\u30d4\u30c3\u30af\u540d\u3092JSON\u3068\u3057\u3066\u5148\u7a0b\u306e\u30b3\u30de\u30f3\u30c9\u3067\u4f5c\u6210\u3057\u3066\u304a\u304d\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u304c\u5c4a\u3044\u3066\u3044\u308b\u304b\u3092\u78ba\u8a8d\u3059\u308b\u305f\u3081\u306b\u3001\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306e\u4ed5\u7d44\u307f\u3092\u7528\u610f\u3059\u308b<\/h2>\n<p>\u4eca\u56de\u306f\u3001\u53d6\u308a\u6025\u304e\u306e\u52d5\u4f5c\u691c\u8a3c\u3067\u3059\u306e\u3067\u3001\u4ee5\u4e0b\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u3067\u53d7\u4fe1\u72b6\u6cc1\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"c1\">#\r\n#   Equalum\u306ekafka\u63a5\u7d9a\u691c\u8a3c\r\n#\r\n#   \u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306e\u51e6\u7406\r\n#\r\n<\/span>\r\n<span class=\"kn\">from<\/span> <span class=\"nn\">kafka<\/span> <span class=\"kn\">import<\/span> <span class=\"n\">KafkaConsumer<\/span>\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">sys<\/span>\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">json<\/span>\r\n\r\n<span class=\"k\">try<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"c1\"># \u5909\u6570\u306e\u521d\u671f\u5316\r\n<\/span>    <span class=\"n\">Counter<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">1<\/span>\r\n\r\n    <span class=\"c1\"># \u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u306b\u63a5\u7d9a\u3059\u308b\r\n<\/span>    <span class=\"n\">consumer<\/span> <span class=\"o\">=<\/span> <span class=\"n\">KafkaConsumer<\/span><span class=\"p\">(<\/span><span class=\"n\">bootstrap_servers<\/span><span class=\"o\">=<\/span><span class=\"s\">'localhost:9092'<\/span><span class=\"p\">,<\/span> <span class=\"n\">auto_offset_reset<\/span><span class=\"o\">=<\/span><span class=\"s\">'latest'<\/span><span class=\"p\">,<\/span><span class=\"n\">value_deserializer<\/span><span class=\"o\">=<\/span><span class=\"k\">lambda<\/span> <span class=\"n\">m<\/span><span class=\"p\">:<\/span> <span class=\"n\">json<\/span><span class=\"p\">.<\/span><span class=\"n\">loads<\/span><span class=\"p\">(<\/span><span class=\"n\">m<\/span><span class=\"p\">.<\/span><span class=\"n\">decode<\/span><span class=\"p\">(<\/span><span class=\"s\">'utf-8'<\/span><span class=\"p\">)))<\/span>\r\n    <span class=\"n\">consumer<\/span><span class=\"p\">.<\/span><span class=\"n\">subscribe<\/span><span class=\"p\">([<\/span><span class=\"s\">'JSON'<\/span><span class=\"p\">])<\/span>\r\n\r\n    <span class=\"k\">for<\/span> <span class=\"n\">message<\/span> <span class=\"ow\">in<\/span> <span class=\"n\">consumer<\/span><span class=\"p\">:<\/span>\r\n\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">\"\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306b\u9001\u3089\u308c\u3066\u304d\u305fJSON\u30e1\u30c3\u30bb\u30fc\u30b8\u3000\uff1a\u3000\"<\/span> <span class=\"o\">+<\/span> <span class=\"n\">message<\/span><span class=\"p\">)<\/span>\r\n\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">\"<\/span><span class=\"se\">\\n<\/span><span class=\"s\">\u8aad\u307f\u51fa\u3057\u305f\u30c7\u30fc\u30bf<\/span><span class=\"se\">\\n<\/span><span class=\"s\">\"<\/span><span class=\"p\">)<\/span>\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">\"Data ID:\"<\/span><span class=\"p\">,<\/span><span class=\"n\">message<\/span><span class=\"p\">[<\/span><span class=\"mi\">6<\/span><span class=\"p\">][<\/span><span class=\"s\">'id'<\/span><span class=\"p\">])<\/span>\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">\"Data X:\"<\/span><span class=\"p\">,<\/span><span class=\"n\">message<\/span><span class=\"p\">[<\/span><span class=\"mi\">6<\/span><span class=\"p\">][<\/span><span class=\"s\">'x'<\/span><span class=\"p\">])<\/span>\r\n        <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">\"Data Y:\"<\/span><span class=\"p\">,<\/span><span class=\"n\">message<\/span><span class=\"p\">[<\/span><span class=\"mi\">6<\/span><span class=\"p\">][<\/span><span class=\"s\">'y'<\/span><span class=\"p\">])<\/span>\r\n\r\n        <span class=\"n\">Counter<\/span> <span class=\"o\">=<\/span> <span class=\"n\">Counter<\/span> <span class=\"o\">+<\/span> <span class=\"mi\">1<\/span>\r\n\r\n\r\n    <span class=\"c1\"># Terminate the script\r\n<\/span>    <span class=\"n\">sys<\/span><span class=\"p\">.<\/span><span class=\"nb\">exit<\/span><span class=\"p\">()<\/span>\r\n\r\n<span class=\"k\">except<\/span> <span class=\"nb\">KeyboardInterrupt<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"s\">'!!!!! \u5272\u308a\u8fbc\u307f\u767a\u751f !!!!!'<\/span><span class=\"p\">)<\/span>\r\n\r\n<span class=\"k\">finally<\/span><span class=\"p\">:<\/span>\r\n\r\n    <span class=\"k\">print<\/span> <span class=\"p\">(<\/span><span class=\"s\">\"\u51e6\u7406\u306e\u7d42\u4e86\"<\/span><span class=\"p\">)<\/span>    \r\n    <span class=\"k\">print<\/span><span class=\"p\">(<\/span><span class=\"nb\">str<\/span><span class=\"p\">(<\/span><span class=\"n\">Counter<\/span><span class=\"p\">)<\/span> <span class=\"o\">+<\/span> <span class=\"s\">\"\u56de\u306e\u51e6\u7406\u3092\u5b9f\u884c\u3057\u307e\u3057\u305f\"<\/span><span class=\"p\">)<\/span>\r\n\r\n<\/code><\/pre>\n<h2>\u6e96\u5099\u304c\u51fa\u6765\u305f\u3089\u52d5\u4f5c\u78ba\u8a8d\u3057\u307e\u3059<\/h2>\n<p>\u4e21\u65b9\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u8d77\u52d5\u3057\u3066\u3001\u753b\u9762\u4e0a\u3067\u30de\u30a6\u30b9\u3092\u300c\u5fc3\u306e\u307e\u307e\u306b\u300d\u52d5\u304b\u3059\u3068\u3001\uff11\u79d2\u9593\u9694\u3067\u30c7\u30fc\u30bf\u3092\u53d6\u308a\u8fbc\u3093\u3067\u304f\u308c\u307e\u3059\u3002\u52d5\u4f5c\u72b6\u6cc1\u306f\u53cc\u65b9\u306e\u30b3\u30f3\u30bd\u30fc\u30eb\u306b\u51fa\u529b\u3055\u308c\u308b\u3088\u3046\u306b\u306a\u3063\u3066\u3044\u307e\u3059\u306e\u3067\u3001\u305d\u306e\u7d50\u679c\u3092\u78ba\u8a8d\u3057\u3066\u554f\u984c\u304c\u7121\u3044\u69d8\u3067\u6709\u308c\u3070\u3001\u3044\u3088\u3044\u3088Equalum\u3092\u7d4c\u7531\u3055\u305b\u3066MySQL\u306b\u7740\u5730\u3055\u305b\u308b\u4e8b\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<h3>\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306e\u51fa\u529b<\/h3>\n<pre class=\"post-pre\"><code>\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306b\u9001\u3089\u308c\u3066\u304d\u305f\u30e1\u30c3\u30bb\u30fc\u30b8\u3000\uff1a\u3000\r\nConsumerRecord<span class=\"o\">(<\/span><span class=\"nv\">topic<\/span><span class=\"o\">=<\/span><span class=\"s1\">'JSON'<\/span>, <span class=\"nv\">partition<\/span><span class=\"o\">=<\/span>0, <span class=\"nv\">offset<\/span><span class=\"o\">=<\/span>137, <span class=\"nv\">timestamp<\/span><span class=\"o\">=<\/span>1618055496288, <span class=\"nv\">timestamp_type<\/span><span class=\"o\">=<\/span>0, <span class=\"nv\">key<\/span><span class=\"o\">=<\/span>None, <span class=\"nv\">value<\/span><span class=\"o\">={<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:36:287301'<\/span>, <span class=\"s1\">'x'<\/span>: 910, <span class=\"s1\">'y'<\/span>: 454<span class=\"o\">}<\/span>, <span class=\"nv\">headers<\/span><span class=\"o\">=[]<\/span>, <span class=\"nv\">checksum<\/span><span class=\"o\">=<\/span>None, <span class=\"nv\">serialized_key_size<\/span><span class=\"o\">=<\/span><span class=\"nt\">-1<\/span>, <span class=\"nv\">serialized_value_size<\/span><span class=\"o\">=<\/span>56, <span class=\"nv\">serialized_header_size<\/span><span class=\"o\">=<\/span><span class=\"nt\">-1<\/span><span class=\"o\">)<\/span>\r\n\r\n\u8aad\u307f\u51fa\u3057\u305f\u30c7\u30fc\u30bf\r\n\r\nData ID: 2021\/04\/10-20:51:36:287301\r\nData X: 910\r\nData Y: 454\r\n\r\n\/\/\/\/\/\/ \u9014\u4e2d\u7701\u7565 \/\/\/\/\/\/\/\/\/\/\r\n\r\n\u30b3\u30f3\u30b7\u30e5\u30fc\u30de\u5074\u306b\u9001\u3089\u308c\u3066\u304d\u305f\u30e1\u30c3\u30bb\u30fc\u30b8\u3000\uff1a\u3000\r\nConsumerRecord<span class=\"o\">(<\/span><span class=\"nv\">topic<\/span><span class=\"o\">=<\/span><span class=\"s1\">'JSON'<\/span>, <span class=\"nv\">partition<\/span><span class=\"o\">=<\/span>0, <span class=\"nv\">offset<\/span><span class=\"o\">=<\/span>146, <span class=\"nv\">timestamp<\/span><span class=\"o\">=<\/span>1618055505336, <span class=\"nv\">timestamp_type<\/span><span class=\"o\">=<\/span>0, <span class=\"nv\">key<\/span><span class=\"o\">=<\/span>None, <span class=\"nv\">value<\/span><span class=\"o\">={<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:45:335406'<\/span>, <span class=\"s1\">'x'<\/span>: 701, <span class=\"s1\">'y'<\/span>: 253<span class=\"o\">}<\/span>, <span class=\"nv\">headers<\/span><span class=\"o\">=[]<\/span>, <span class=\"nv\">checksum<\/span><span class=\"o\">=<\/span>None, <span class=\"nv\">serialized_key_size<\/span><span class=\"o\">=<\/span><span class=\"nt\">-1<\/span>, <span class=\"nv\">serialized_value_size<\/span><span class=\"o\">=<\/span>56, <span class=\"nv\">serialized_header_size<\/span><span class=\"o\">=<\/span><span class=\"nt\">-1<\/span><span class=\"o\">)<\/span>\r\n\r\n\u8aad\u307f\u51fa\u3057\u305f\u30c7\u30fc\u30bf\r\n\r\nData ID: 2021\/04\/10-20:51:45:335406\r\nData X: 701\r\nData Y: 253\r\n<span class=\"o\">!!!!!<\/span> \u5272\u308a\u8fbc\u307f\u767a\u751f <span class=\"o\">!!!!!<\/span>\r\n\u51e6\u7406\u306e\u7d42\u4e86\r\n11\u56de\u306e\u51e6\u7406\u3092\u5b9f\u884c\u3057\u307e\u3057\u305f\r\n<\/code><\/pre>\n<h3>\u30d7\u30ed\u30c7\u30e5\u30fc\u30b5\u5074\u306e\u5165\u529b<\/h3>\n<pre class=\"post-pre\"><code><span class=\"o\">{<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:36:287301'<\/span>, <span class=\"s1\">'x'<\/span>: 910, <span class=\"s1\">'y'<\/span>: 454<span class=\"o\">}<\/span>\r\n<span class=\"o\">{<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:37:293747'<\/span>, <span class=\"s1\">'x'<\/span>: 905, <span class=\"s1\">'y'<\/span>: 458<span class=\"o\">}<\/span>\r\n\/\/\/\/\/\/\/\/ \u9014\u4e2d\u7701\u7565 \/\/\/\/\/\/\/\/\/\r\n<span class=\"o\">{<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:44:327730'<\/span>, <span class=\"s1\">'x'<\/span>: 605, <span class=\"s1\">'y'<\/span>: 254<span class=\"o\">}<\/span>\r\n<span class=\"o\">{<\/span><span class=\"s1\">'id'<\/span>: <span class=\"s1\">'2021\/04\/10-20:51:45:335406'<\/span>, <span class=\"s1\">'x'<\/span>: 701, <span class=\"s1\">'y'<\/span>: 253<span class=\"o\">}<\/span>\r\n<\/code><\/pre>\n<h1>\u4eca\u56de\u306e\u307e\u3068\u3081<\/h1>\n<p>\u4eca\u56de\u306f\u3001Equalum\u306e\u4e0a\u6d41\u5074\u30c7\u30fc\u30bf\u30bd\u30fc\u30b9\u3068\u3057\u3066\u3001kafka\u3092\u7e4b\u3052\u308b\u305f\u3081\u306e\u524d\u6e96\u5099\u3092\u884c\u3044\u307e\u3057\u305f\u3002Equalum\u793e\u306e\u88fd\u54c1\u30fb\u958b\u767a\u306eVP\u3001CTO\u3068\u3084\u308a\u3068\u308a\u3092\u3055\u305b\u3066\u3082\u3089\u3063\u305f\u969b\u306b\u3001RDB\u7cfb\u306eCDC\u7248Exactly Once\u3060\u3051\u3067\u306f\u306a\u304f\u3066\u3001kafka\u3092\u4e0a\u6d41\u306b\u8a2d\u5b9a\u3057\u305f\u5834\u5408\u3082\u3001Equalum\u4ee5\u964d\u3067\u306f\u3001Exactly Once\u3092\u540c\u3058\u69d8\u306b\u30b5\u30dd\u30fc\u30c8\u51fa\u6765\u308b\u30fb\u30fb\u3068\u306e\u4e8b\u3067\u3057\u305f\u3002\u307e\u305f\u3001\u5e7e\u3064\u304b\u306e\u30d1\u30bf\u30fc\u30f3\u306b\u5206\u3051\u3066\u3053\u306e\u53ef\u80fd\u6027\u3092\u8003\u3048\u3066\u307f\u308b\u3068\u3001<\/p>\n<h3>\u6280\u8853\u7684\u306a\u30e6\u30fc\u30b9\u30b1\u30fc\u30b9\u306e\u89b3\u70b9\u304b\u3089\uff1a<\/h3>\n<p>Kafka-&gt; Equalum-&gt; RDBMS<br \/>\n\u3053\u306e\u30d1\u30bf\u30fc\u30f3\u306f\u901a\u5e38\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u7d71\u5408\u7b49\u306b\u4f7f\u7528\u3055\u308c\u308b\u30d1\u30bf\u30fc\u30f3\u3067\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u7279\u5b9a\u306e\u30a4\u30d9\u30f3\u30c8\u304cKafka\u3078\u306e\u66f8\u304d\u8fbc\u307f\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u3001Equalum\u304c\u3053\u306e\u30a4\u30d9\u30f3\u30c8\u3092\u8aad\u307f\u53d6\u3063\u3066\u5fc5\u8981\u306a\u5909\u63db\/\u30a8\u30f3\u30ea\u30c3\u30c1\u30e1\u30f3\u30c8\u306a\u3069\u3092\u884c\u3044\u3001\u305d\u306e\u30c7\u30fc\u30bf\u30922\u756a\u76ee\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u901f\u3084\u304b\u4e14\u3064\u78ba\u5b9f\u30d7\u30c3\u30b7\u30e5\u3059\u308b\u4e8b\u304c\u51fa\u6765\u307e\u3059\u3002<\/p>\n<p>Kafka-&gt; Equalum-&gt; Kafka<br \/>\n\u3053\u306e\u30d1\u30bf\u30fc\u30f3\u3082\u524d\u8ff0\u540c\u69d8\u306b\u3001\u304b\u306a\u308a\u306e\u983b\u5ea6\u3067\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u7d71\u5408\u306b\u4f7f\u7528\u3055\u308c\u3066\u304a\u308a\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u7279\u5b9a\u306e\u30a4\u30d9\u30f3\u30c8\u304cKafka\u3078\u306e\u66f8\u304d\u8fbc\u307f\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u3001Equalum\u306f\u3053\u306e\u30a4\u30d9\u30f3\u30c8\u3092\u8aad\u307f\u53d6\u3063\u3066\u3001\u524d\u8ff0\u540c\u69d8\u306b\u5fc5\u8981\u306a\u5909\u63db\/\u30a8\u30f3\u30ea\u30c3\u30c1\u30e1\u30f3\u30c8\u306a\u3069\u3092\u5b9f\u884c\uff08\u3053\u306e\u90e8\u5206\u306f\u3001Equalum\u306eGUI\u3067\u884c\u3044\u307e\u3059\u306e\u3067\u3001\u7686\u69d8\u304c\u65e2\u306b\u6697\u8a18\u3055\u308c\u3066\u3044\u308b\u300cNo\u30b3\u30fc\u30c9\u300d\u306e\u6069\u6075\u3092\u53d7\u3051\u308b\u4e8b\u304c\u53ef\u80fd\u3067\u3059\uff09\u3057\u3001\u5909\u63db\u3055\u308c\u305f\u30a4\u30d9\u30f3\u30c8\u3092\u5225\u306eKafka\u30c8\u30d4\u30c3\u30af\u306b\u30d7\u30c3\u30b7\u30e5\u3057\u3066\u3001\u4ed6\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3067\u3055\u3089\u306b\u51e6\u7406\u3092\u7d9a\u884c\u3059\u308b\u4e8b\u306b\u306a\u308a\u307e\u3059\u3002\uff08\u6226\u7565\u7684\u306bkafka\u306e\u9014\u4e2d\u51e6\u7406\u306b\u67d4\u8edf\u306a\u4ecb\u5165\u3092\u53ef\u80fd\u3068\u3059\u308b\u4e8b\u3067\u3001\u65b0\u3057\u3044kafka\u306e\u53ef\u80fd\u6027\u304c\u51fa\u3066\u304f\u308b\u4f7f\u3044\u65b9\u306b\u306a\u308b\u304b\u3068\uff09<\/p>\n<p>RDBMS-&gt; Equalum-&gt; Kafka<br \/>\n\u3053\u306e\u30d1\u30bf\u30fc\u30f3\u306f\u3001\u300c\u30a4\u30d9\u30f3\u30c8\u751f\u6210\u300d\u307e\u305f\u306f\u300c\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b7\u30f3\u30b0\u300d\u3068\u547c\u3070\u308c\u308b\u4f7f\u3044\u65b9\u3067\u3001Equalum\u306f\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u304b\u3089CDC\u30a4\u30d9\u30f3\u30c8\u3092\u8aad\u307f\u53d6\u308a\u3001\u5fc5\u8981\u306b\u5fdc\u3058\u3066\u30c7\u30fc\u30bf\u3092\u5909\u63db\u3057\u3001\u8ab0\u3067\u3082\u7c21\u5358\u306b\u5229\u7528\u3067\u304d\u308b\u3088\u3046\u306b\u524d\u6e96\u5099\u3092\u63d0\u4f9b\u3057\u3066\u304b\u3089\u3001\u5f53\u8a72\u30a4\u30d9\u30f3\u30c8\u3092Kafka\u30c8\u30d4\u30c3\u30af\u306b\u516c\u958b\u3057\u3001\u51e6\u7406\u3092\u7d99\u7d9a\u3057\u3066\u3044\u304d\u307e\u3059\u3002\u65e2\u5b58\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u60c5\u5831\u3092\u901f\u3084\u304b\uff06\u78ba\u5b9f\u306bkafka\u306e\u30d1\u30a4\u30d7\u306b\u63d0\u4f9b\u51fa\u6765\u307e\u3059\u306e\u3067\uff08FLOW\u306e\u90e8\u5206\u306f\u524d\u8ff0\u540c\u69d8\u306e\u300cNo\u30b3\u30fc\u30c9\u300d\u3067\uff09\u9762\u767d\u3044\u4f7f\u3044\u65b9\u304c\u53ef\u80fd\u306b\u306a\u308b\u304b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<p>\u7b49\u304c\u51fa\u3066\u304d\u307e\u3059\u306e\u3067\u3001\u6700\u8fd1\u826f\u304f\u8a71\u3092\u805e\u304f\u300cxxOps\u300d\u7684\u306a\u30b7\u30b9\u30c6\u30e0\u6d3b\u7528\u3092\u300c\u30c7\u30fc\u30bf\u6d41\u901a\u300d\u306e\u5074\u9762\u3067\u5927\u304d\u304f\u30b5\u30dd\u30fc\u30c8\u51fa\u6765\u308b\u53ef\u80fd\u6027\u304c\u6709\u308b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<h1>\u6b21\u56de\u306f\u30fb\u30fb\u30fb<\/h1>\n<p>\u6b21\u56de\u306f\u3001\u4eca\u56de\u306e\u74b0\u5883\u3092\u6d3b\u7528\u3057\u3066\u3044\u3088\u3044\u3088Equalum\u3092\u9593\u306b\u5165\u308c\u3066\u3001\u30bf\u30fc\u30b2\u30c3\u30c8\u30fb\u30c7\u30fc\u30bf\u30bd\u30fc\u30b9\u3068\u3057\u3066MySQL\u306b\u300cExactly Once\u300d\u3067\u7740\u5730\u3055\u305b\u3066\u307f\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n<h1>\u8b1d\u8f9e<\/h1>\n<p>\u672c\u691c\u8a3c\u306f\u3001Equalum\u793e\u306e\u6700\u65b0\u516c\u5f0f\u30d0\u30fc\u30b8\u30e7\u30f3\uff08V2.\uff124)\u3092\u5229\u7528\u3057\u3066\u5b9f\u65bd\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u306e\u8cb4\u91cd\u306a\u6a5f\u4f1a\u3092\u63d0\u4f9b\u3057\u3066\u9802\u3044\u305fEqualum\u793e\u306b\u5bfe\u3057\u3066\u611f\u8b1d\u306e\u610f\u3092\u8868\u3059\u308b\u3068\u5171\u306b\u3001\u672c\u5185\u5bb9\u3068Equalum\u793e\u306e\u516c\u5f0f\u30db\u30fc\u30e0\u30da\u30fc\u30b8\u3067\u516c\u958b\u3055\u308c\u3066\u3044\u308b\u5185\u5bb9\u7b49\u304c\u7570\u306a\u308b\u5834\u5408\u306f\u3001Equalum\u793e\u306e\u60c5\u5831\u304c\u512a\u5148\u3059\u308b\u4e8b\u3092\u3054\u4e86\u89e3\u304f\u3060\u3055\u3044\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u4ee5\u524d\u306b\u66f8\u3044\u305fEqualum\u691c\u8a3c\u306e\u7d9a\u304d\u30fb\u30fb\u30fb\u30fb \u524d\u306b\u6295\u7a3f\u3057\u305fEqualum\u306e\u691c\u8a3c\u3067\u3001kafka\u3092\u4e0a\u6d41\u5074\u30c7\u30fc\u30bf\u30bd\u30fc [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-46755","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"\u4ee5\u524d\u306b\u66f8\u3044\u305fEqualum\u691c\u8a3c\u306e\u7d9a\u304d\u30fb\u30fb\u30fb\u30fb \u524d\u306b\u6295\u7a3f\u3057\u305fEqualum\u306e\u691c\u8a3c\u3067\u3001kafka\u3092\u4e0a\u6d41\u5074\u30c7\u30fc\u30bf\u30bd\u30fc [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-01-05T06:36:48+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-29T06:27:51+00:00\" \/>\n<meta name=\"author\" content=\"\u79d1, \u96c5\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u79d1, \u96c5\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/\",\"name\":\"- Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-01-05T06:36:48+00:00\",\"dateModified\":\"2024-04-29T06:27:51+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a\",\"name\":\"\u79d1, \u96c5\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g\",\"caption\":\"\u79d1, \u96c5\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/keya\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/","og_locale":"zh_CN","og_type":"article","og_description":"\u4ee5\u524d\u306b\u66f8\u3044\u305fEqualum\u691c\u8a3c\u306e\u7d9a\u304d\u30fb\u30fb\u30fb\u30fb \u524d\u306b\u6295\u7a3f\u3057\u305fEqualum\u306e\u691c\u8a3c\u3067\u3001kafka\u3092\u4e0a\u6d41\u5074\u30c7\u30fc\u30bf\u30bd\u30fc [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-01-05T06:36:48+00:00","article_modified_time":"2024-04-29T06:27:51+00:00","author":"\u79d1, \u96c5","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u79d1, \u96c5","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"2 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/","name":"- Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-01-05T06:36:48+00:00","dateModified":"2024-04-29T06:27:51+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a","name":"\u79d1, \u96c5","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g","caption":"\u79d1, \u96c5"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/keya\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46755-2\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46755","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=46755"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46755\/revisions"}],"predecessor-version":[{"id":85820,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46755\/revisions\/85820"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=46755"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=46755"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=46755"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}