canal needs to write its own client program to push the data synchronized from the database.The following describes how to write the canal client program. Start canal Server First Reference: canal Beginner-Level (III): canal Installation Build maven <dependency> <groupId>com.alibaba.otter</groupId> <artifactId>canal.client</artifactId> <version>1.0.12</version> </dependency> sample code import java.net.InetSocketAddress; import java.util.List; import com.alibaba.otter.canal.client.CanalConnectors; import com.alibaba.otter.canal.client.CanalConnector; import com.alibaba.otter.canal.common.utils.AddressUtils; import com.alibaba.otter.canal.protocol.Message; import com.alibaba.otter.canal.protocol.CanalEntry.Column; import com.alibaba.otter.canal.protocol.CanalEntry.Entry; import com.alibaba.otter.canal.protocol.CanalEntry.EntryType; import com.alibaba.otter.canal.protocol.CanalEntry.EventType; import com.alibaba.otter.canal.protocol.CanalEntry.RowChange; import com.alibaba.otter.canal.protocol.CanalEntry.RowData; public class
canal Installation and Use
language: pure java development
Positioning: Based on database incremental log analysis, incremental data subscription & consumption is provided. Currently mysql is mainly supported
keywords: MySQL binlogparser/real-time/queue & topic
principle is relatively simple:
1.canal simulates mysql slave's interaction protocol, disguises itself as mysql slave, and sends dump protocol to mysql master
2.mysql master receives dump request and starts pushing binary log to slave (i.
Summary: The whole parse part of canal has been pulled out. It is mainly convenient for debugging and source code analysis of the machine in the future. Now it is put up. In fact, the canal has been completely disassembled and disassembled into tracker and parser. Later this version will be put up slowly and put here after the configuration service is written. Project Structure: the whole is divided into
Zero, Environmental Preparation 1, canal's principle is based on mysql binlog technology, so it is necessary to turn on mysql's binlog writing function here. It is recommended to configure binlog mode as row [mysqld] log-bin=mysql-bin #添加这一行就ok binlog-format=ROW #选择row模式 server_id=129 #配置mysql replacti
Basic Description canal 1.1.1 version, the default support will be canal server received binlog data directly delivered to MQ, currently the default support MQ system are: kafka: https://github.com/apache/kafka RocketMQ : https://github.com/apache/rocketmq Environment Version operating system: CentOS release 6.6 (Final) java Version: jdk1.8 canal Version: Please download the latest installation package. This article takes the current canal.deployer-1.1.1.tar.gz of v1.1.1 as an example MySQL Version: 5.7.18 Note: Shut down the Firewall of
Introduction canal provides incremental data subscription & consumption based on database incremental log analysis. mysql is currently mainly supported.Through canal, incremental log-based subscription & consumption support services can be realized: Database Mirroring database real-time backup Multi-level index (index of sellers and buyers separately) search build Service cache Refresh price changes and other important business news download github canal.deployer-1.1.2.tar.gz Configuration Details MySQL initialization canal's principle is based on mysql binlog technology,
Introduction: canal is an Alibaba product. It mainly simulates mysql's Slave sending requests to Master. When mysql has additions, deletions and changes, it will start to request to send data to canal service. canal will store the data in memory until the client program (canal server and client program are written by java, and the client logic is developed by us with the help of classes under com.alibaba.otter.canal toolkit) consumes the data in canal service through publish-subscribe mode.
This article is reproduced from HTTPS://blog.csdn.net/cry _ Laughter _ hat/article/details/79256190URL
Cainiao News Client is an information news client that imitates 36Kr official and captures 36Kr official website data in real time.
Includes related functional clients such as homepage news, details, discovery, activities, real-time data capture, sideslip effect, third-party login and sharing, and message push.
Project Source Code Download Address: https://github.com/yxs666/cniao5-news
A file transmission application imitating eggplant fast transmission involves Socket communication, including TCP and UDP communication
After watching "Smart Use of Gradle to Build Android Applications" over the weekend, I put the new knowledge in order for myself and those who need it to see it later. Gradle The construction process of gradle is actually to execute DAG(Directed Acyclic Graph), allowing you to define your own task and insert it into it.The Android DSL () portal when building the Android block build.gradle. dependent syntax //
Before reading this article, it is recommended to read this article. canal stand-alone mode: http://blog.csdn.net/hackerwin7/article/details/37923607 Machine Preparation: mysql:192.168.213.41:3306 canal server：192.168.213.42:11111 、192.168.213.43:11111 zoo