Linux Cache

Ubuntu16.04部署ethereum接口服务节点

更新仓库索引

root@localhost:~# apt update
Hit:1 http://mirrors.cloud.aliyuncs.com/ubuntu xenial InRelease
Hit:2 http://mirrors.cloud.aliyuncs.com/ubuntu xenial-updates InRelease
Hit:3 http://mirrors.cloud.aliyuncs.com/ubuntu xenial-security InRelease
Reading package lists... Done
Building dependency tree
Reading state information... Done
69 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@localhost:~#

安装软件管理工具

root@localhost:~# apt-get install software-properties-common
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
linux-headers-4.4.0-87 linux-headers-4.4.0-87-generic
linux-image-4.4.0-87-generic linux-image-extra-4.4.0-87-generic
Use 'apt autoremove' to remove them.
The following additional packages will be installed:
python3-pycurl python3-software-properties unattended-upgrades
Suggested packages:
libcurl4-gnutls-dev python-pycurl-doc python3-pycurl-dbg bsd-mailx
The following NEW packages will be installed:
python3-pycurl python3-software-properties software-properties-common
unattended-upgrades
0 upgraded, 4 newly installed, 0 to remove and 69 not upgraded.
Need to get 104 kB of archives.
After this operation, 799 kB of additional disk space will be used.
Do you want to continue? [Y/n]

添加软件源仓库

root@localhost:~# add-apt-repository ppa:ethereum/ethereum

More info: https://launchpad.net/~ethereum/+archive/ubuntu/ethereum
Press [ENTER] to continue or ctrl-c to cancel adding it

gpg: keyring `/tmp/tmpgbqt2ny9/secring.gpg' created
gpg: keyring `/tmp/tmpgbqt2ny9/pubring.gpg' created
gpg: requesting key 923F6CA9 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmpgbqt2ny9/trustdb.gpg: trustdb created
gpg: key 923F6CA9: public key "Launchpad PPA for Ethereum" imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
OK
root@localhost:~#

更新仓库索引

root@localhost:~# apt-get update
Hit:1 http://mirrors.cloud.aliyuncs.com/ubuntu xenial InRelease
Hit:2 http://mirrors.cloud.aliyuncs.com/ubuntu xenial-updates InRelease
Hit:3 http://mirrors.cloud.aliyuncs.com/ubuntu xenial-security InRelease
Get:4 http://ppa.launchpad.net/ethereum/ethereum/ubuntu xenial InRelease [17.5 kB]
Get:5 http://ppa.launchpad.net/ethereum/ethereum/ubuntu xenial/main amd64 Packages [5,944 B]
Get:6 http://ppa.launchpad.net/ethereum/ethereum/ubuntu xenial/main i386 Packages [5,956 B]
Get:7 http://ppa.launchpad.net/ethereum/ethereum/ubuntu xenial/main Translation-en [2,936 B]
Fetched 32.4 kB in 2s (12.3 kB/s)
Reading package lists... Done
root@localhost:~#

缺乏依赖 (跳过)

root@localhost:~# apt-get install cpp-ethereum
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
cpp-ethereum : Depends: alethzero but it is not going to be installed
Depends: mix-ide but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
root@localhost:~#

选用geth版本进行安装

root@localhost:~# apt-get install ethereum
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
linux-headers-4.4.0-87 linux-headers-4.4.0-87-generic
linux-image-4.4.0-87-generic linux-image-extra-4.4.0-87-generic
Use 'apt autoremove' to remove them.
The following additional packages will be installed:
abigen bootnode evm geth puppeth rlpdump swarm wnode
The following NEW packages will be installed:
abigen bootnode ethereum evm geth puppeth rlpdump swarm wnode
0 upgraded, 9 newly installed, 0 to remove and 69 not upgraded.
Need to get 22.8 MB of archives.
After this operation, 86.1 MB of additional disk space will be used.
Do you want to continue? [Y/n]

查看安装路径

root@localhost:~# dpkg -L geth
/.
/usr
/usr/bin
/usr/bin/geth
/usr/share
/usr/share/doc
/usr/share/doc/geth
/usr/share/doc/geth/changelog.gz
/usr/share/doc/geth/AUTHORS.gz
/usr/share/doc/geth/copyright
root@localhost:~#

geth用法参数

root@localhost:~# geth --help
NAME:
geth - the go-ethereum command line interface

Copyright 2013-2018 The go-ethereum Authors

USAGE:
geth [options] command [command options] [arguments...]

VERSION:
1.8.12-stable-37685930

COMMANDS:
account Manage accounts
attach Start an interactive JavaScript environment (connect to node)
bug opens a window to report a bug on the geth repo
console Start an interactive JavaScript environment
copydb Create a local chain from a target chaindata folder
dump Dump a specific block from storage
dumpconfig Show configuration values
export Export blockchain into file
export-preimages Export the preimage database into an RLP stream
import Import a blockchain file
import-preimages Import the preimage database from an RLP stream
init Bootstrap and initialize a new genesis block
js Execute the specified JavaScript files
license Display license information
makecache Generate ethash verification cache (for testing)
makedag Generate ethash mining DAG (for testing)
monitor Monitor and visualize node metrics
removedb Remove blockchain and state databases
version Print version numbers
wallet Manage Ethereum presale wallets
help, h Shows a list of commands or help for one command

ETHEREUM OPTIONS:
--config value TOML configuration file
--datadir "/root/.ethereum" Data directory for the databases and keystore
--keystore Directory for the keystore (default = inside the datadir)
--nousb Disables monitoring for and managing USB hardware wallets
--networkid value Network identifier (integer, 1=Frontier, 2=Morden (disused), 3=Ropsten, 4=Rinkeby) (default: 1)
--testnet Ropsten network: pre-configured proof-of-work test network
--rinkeby Rinkeby network: pre-configured proof-of-authority test network
--syncmode "fast" Blockchain sync mode ("fast", "full", or "light")
--gcmode value Blockchain garbage collection mode ("full", "archive") (default: "full")
--ethstats value Reporting URL of a ethstats service (nodename:secret@host:port)
--identity value Custom node name
--lightserv value Maximum percentage of time allowed for serving LES requests (0-90) (default: 0)
--lightpeers value Maximum number of LES client peers (default: 100)
--lightkdf Reduce key-derivation RAM & CPU usage at some expense of KDF strength

DEVELOPER CHAIN OPTIONS:
--dev Ephemeral proof-of-authority network with a pre-funded developer account, mining enabled
--dev.period value Block period to use in developer mode (0 = mine only if transaction pending) (default: 0)

ETHASH OPTIONS:
--ethash.cachedir Directory to store the ethash verification caches (default = inside the datadir)
--ethash.cachesinmem value Number of recent ethash caches to keep in memory (16MB each) (default: 2)
--ethash.cachesondisk value Number of recent ethash caches to keep on disk (16MB each) (default: 3)
--ethash.dagdir "/root/.ethash" Directory to store the ethash mining DAGs (default = inside home folder)
--ethash.dagsinmem value Number of recent ethash mining DAGs to keep in memory (1+GB each) (default: 1)
--ethash.dagsondisk value Number of recent ethash mining DAGs to keep on disk (1+GB each) (default: 2)

TRANSACTION POOL OPTIONS:
--txpool.nolocals Disables price exemptions for locally submitted transactions
--txpool.journal value Disk journal for local transaction to survive node restarts (default: "transactions.rlp")
--txpool.rejournal value Time interval to regenerate the local transaction journal (default: 1h0m0s)
--txpool.pricelimit value Minimum gas price limit to enforce for acceptance into the pool (default: 1)
--txpool.pricebump value Price bump percentage to replace an already existing transaction (default: 10)
--txpool.accountslots value Minimum number of executable transaction slots guaranteed per account (default: 16)
--txpool.globalslots value Maximum number of executable transaction slots for all accounts (default: 4096)
--txpool.accountqueue value Maximum number of non-executable transaction slots permitted per account (default: 64)
--txpool.globalqueue value Maximum number of non-executable transaction slots for all accounts (default: 1024)
--txpool.lifetime value Maximum amount of time non-executable transaction are queued (default: 3h0m0s)

PERFORMANCE TUNING OPTIONS:
--cache value Megabytes of memory allocated to internal caching (default: 1024)
--cache.database value Percentage of cache memory allowance to use for database io (default: 75)
--cache.gc value Percentage of cache memory allowance to use for trie pruning (default: 25)
--trie-cache-gens value Number of trie node generations to keep in memory (default: 120)

ACCOUNT OPTIONS:
--unlock value Comma separated list of accounts to unlock
--password value Password file to use for non-interactive password input

API AND CONSOLE OPTIONS:
--rpc Enable the HTTP-RPC server
--rpcaddr value HTTP-RPC server listening interface (default: "localhost")
--rpcport value HTTP-RPC server listening port (default: 8545)
--rpcapi value API's offered over the HTTP-RPC interface
--ws Enable the WS-RPC server
--wsaddr value WS-RPC server listening interface (default: "localhost")
--wsport value WS-RPC server listening port (default: 8546)
--wsapi value API's offered over the WS-RPC interface
--wsorigins value Origins from which to accept websockets requests
--ipcdisable Disable the IPC-RPC server
--ipcpath Filename for IPC socket/pipe within the datadir (explicit paths escape it)
--rpccorsdomain value Comma separated list of domains from which to accept cross origin requests (browser enforced)
--rpcvhosts value Comma separated list of virtual hostnames from which to accept requests (server enforced). Accepts '*' wildcard. (default: "localhost")
--jspath loadScript JavaScript root path for loadScript (default: ".")
--exec value Execute JavaScript statement
--preload value Comma separated list of JavaScript files to preload into the console

NETWORKING OPTIONS:
--bootnodes value Comma separated enode URLs for P2P discovery bootstrap (set v4+v5 instead for light servers)
--bootnodesv4 value Comma separated enode URLs for P2P v4 discovery bootstrap (light server, full nodes)
--bootnodesv5 value Comma separated enode URLs for P2P v5 discovery bootstrap (light server, light nodes)
--port value Network listening port (default: 30303)
--maxpeers value Maximum number of network peers (network disabled if set to 0) (default: 25)
--maxpendpeers value Maximum number of pending connection attempts (defaults used if set to 0) (default: 0)
--nat value NAT port mapping mechanism (any|none|upnp|pmp|extip:<IP>) (default: "any")
--nodiscover Disables the peer discovery mechanism (manual peer addition)
--v5disc Enables the experimental RLPx V5 (Topic Discovery) mechanism
--netrestrict value Restricts network communication to the given IP networks (CIDR masks)
--nodekey value P2P node key file
--nodekeyhex value P2P node key as hex (for testing)

MINER OPTIONS:
--mine Enable mining
--minerthreads value Number of CPU threads to use for mining (default: 2)
--etherbase value Public address for block mining rewards (default = first account created) (default: "0")
--targetgaslimit value Target gas limit sets the artificial target gas floor for the blocks to mine (default: 4712388)
--gasprice "18000000000" Minimal gas price to accept for mining a transactions
--extradata value Block extra data set by the miner (default = client version)

GAS PRICE ORACLE OPTIONS:
--gpoblocks value Number of recent blocks to check for gas prices (default: 20)
--gpopercentile value Suggested gas price is the given percentile of a set of recent transaction gas prices (default: 60)

VIRTUAL MACHINE OPTIONS:
--vmdebug Record information useful for VM and contract debugging

LOGGING AND DEBUGGING OPTIONS:
--fakepow Disables proof-of-work verification
--nocompaction Disables db compaction after import
--verbosity value Logging verbosity: 0=silent, 1=error, 2=warn, 3=info, 4=debug, 5=detail (default: 3)
--vmodule value Per-module verbosity: comma-separated list of <pattern>=<level> (e.g. eth/*=5,p2p=4)
--backtrace value Request a stack trace at a specific logging statement (e.g. "block.go:271")
--debug Prepends log messages with call-site location (file and line number)
--pprof Enable the pprof HTTP server
--pprofaddr value pprof HTTP server listening interface (default: "127.0.0.1")
--pprofport value pprof HTTP server listening port (default: 6060)
--memprofilerate value Turn on memory profiling with the given rate (default: 524288)
--blockprofilerate value Turn on block profiling with the given rate (default: 0)
--cpuprofile value Write CPU profile to the given file
--trace value Write execution trace to the given file

METRICS AND STATS OPTIONS:
--metrics Enable metrics collection and reporting
--metrics.influxdb Enable metrics export/push to an external InfluxDB database
--metrics.influxdb.endpoint value InfluxDB API endpoint to report metrics to (default: "http://localhost:8086")
--metrics.influxdb.database value InfluxDB database name to push reported metrics to (default: "geth")
--metrics.influxdb.username value Username to authorize access to the database (default: "test")
--metrics.influxdb.password value Password to authorize access to the database (default: "test")
--metrics.influxdb.host.tag host InfluxDB host tag attached to all measurements (default: "localhost")

WHISPER (EXPERIMENTAL) OPTIONS:
--shh Enable Whisper
--shh.maxmessagesize value Max message size accepted (default: 1048576)
--shh.pow value Minimum POW accepted (default: 0.2)

DEPRECATED OPTIONS:
--fast Enable fast syncing through state downloads (replaced by --syncmode)
--light Enable light client mode (replaced by --syncmode)

MISC OPTIONS:
--help, -h show help


COPYRIGHT:
Copyright 2013-2018 The go-ethereum Authors

root@localhost:~#

启动服务

tom@localhost:~$ nohup geth --datadir "/data/ethereum" --cache 1024 \
--port 30303 --syncmode "fast" \
--rpc --rpcaddr 10.20.30.40 --rpcport 8545 \
--rpcapi "db,eth,net,web3,personal" &

Ubuntu16.04安装NFS客户端并挂载NFS存储

安装NFS客户端组件

root@localhost:~# apt-get update
root@localhost:~# apt-get install nfs-common
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
linux-headers-4.4.0-87 linux-headers-4.4.0-87-generic
linux-image-4.4.0-87-generic linux-image-extra-4.4.0-87-generic
Use 'apt autoremove' to remove them.
The following additional packages will be installed:
keyutils libevent-2.0-5 libnfsidmap2 libtirpc1 rpcbind
Suggested packages:
open-iscsi watchdog
The following NEW packages will be installed:
keyutils libevent-2.0-5 libnfsidmap2 libtirpc1 nfs-common rpcbind
0 upgraded, 6 newly installed, 0 to remove and 80 not upgraded.
Need to get 493 kB of archives.
After this operation, 1,693 kB of additional disk space will be used.
Do you want to continue? [Y/n] Y

挂载NAS存储并查看挂载信息

root@localhost:~# mount -t nfs -o vers=4.0 9999f94a9b0-biz99.cn-hongkong.nas.aliyuncs.com:/ /data
root@localhost:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 2.0G 0 2.0G 0% /dev
tmpfs 396M 2.8M 393M 1% /run
/dev/vda1 99G 2.7G 91G 3% /
tmpfs 2.0G 0 2.0G 0% /dev/shm
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup
tmpfs 396M 0 396M 0% /run/user/0
9999f94a9b0-biz99.cn-hongkong.nas.aliyuncs.com:/ 1.0P 0 1.0P 0% /data
root@localhost:~#

设置NFS在系统启动时自动挂载

root@localhost:~# vi /etc/fstab
9999f94a9b0-biz99.cn-hongkong.nas.aliyuncs.com:/ /data nfs auto,nofail,noatime,nolock,intr,tcp,actimeo=1800 0 0

手动挂载和自动挂载mount输出的差异

9999f94a9b0-biz99.cn-hongkong.nas.aliyuncs.com:/ on /data type nfs4 (rw,relatime,vers=4.0,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=10.22.105.10,local_lock=none,addr=10.22.107.25)

9999f94a9b0-biz99.cn-hongkong.nas.aliyuncs.com:/ on /data type nfs4 (rw,noatime,vers=4.0,rsize=1048576,wsize=1048576,namlen=255,acregmin=1800,acregmax=1800,acdirmin=1800,acdirmax=1800,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=10.22.105.10,local_lock=none,addr=10.22.107.25)

NFS性能参数调优

root@localhost:~# cat /proc/sys/sunrpc/tcp_slot_table_entries
2
root@localhost:~#
root@localhost:~# echo "options sunrpc tcp_slot_table_entries=128" >> /etc/modprobe.d/sunrpc.conf
root@localhost:~# echo "options sunrpc tcp_max_slot_table_entries=128" >> /etc/modprobe.d/sunrpc.conf
root@localhost:~# sysctl -w sunrpc.tcp_slot_table_entries=128
sunrpc.tcp_slot_table_entries = 128
root@localhost:~# cat /proc/sys/sunrpc/tcp_slot_table_entries
128
root@localhost:~#

https://archive.apache.org/dist/zookeeper/

安装JDK环境

[root@zk1 ~]# yum -y install jdk-8u171-linux-x64.rpm

解压缩zookeeper安装包

[root@zk1 ~]# tar xzf zookeeper-3.4.12.tar.gz
[root@zk1 ~]# mv zookeeper-3.4.12 /usr/local/
[root@zk1 ~]# cd /usr/local/
[root@zk1 local]# ln -s zookeeper-3.4.12/ zookeeper
[root@zk1 local]#

添加环境变量

[root@zk1 conf]# vi /etc/profile
export PATH=/usr/local/zookeeper/bin/:$PATH
[root@zk1 conf]# source /etc/profile

查看默认配置文件

[root@zk1 ~]# cd /usr/local/zookeeper/conf/
[root@zk1 conf]# cat zoo_sample.cfg
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/tmp/zookeeper
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1

修改配置文件并新增集群节点配置

[root@zk1 conf]# cp zoo_sample.cfg zoo.cfg
[root@zk1 conf]# vi zoo.cfg
dataDir=/var/lib/zookeeper
dataLogDir=/var/log/zookeeper
server.1=192.168.137.130:2888:3888
server.2=192.168.137.129:2888:3888
server.3=192.168.137.128:2888:3888

创建集群节点ID文件

[root@zk1 ~]# echo "1" > /tmp/zookeeper/myid
[root@zk1 ~]# cat /tmp/zookeeper/myid
1
[root@zk1 ~]#

[root@zk2 ~]# echo "2" > /tmp/zookeeper/myid
[root@zk2 ~]# cat /tmp/zookeeper/myid
2
[root@zk2 ~]#

[root@zk3 ~]# echo "3" > /tmp/zookeeper/myid
[root@zk3 ~]# cat /tmp/zookeeper/myid
3
[root@zk3 ~]#

增加JVM内存配置文件

[root@zk1 ~]# vi /usr/local/zookeeper/conf/java.env
#!/bin/bash
export JVMFLAGS="-Xms1024m -Xmx1024m $JVMFLAGS"

添加环境变量

[root@zk1 ~]# export ZOOKEEPER_HOME=/usr/local/zookeeper/
[root@zk1 ~]# export PATH=$PATH:$ZOOKEEPER_HOME/bin

export ZOOKEEPER_HOME=/usr/local/zookeeper/
export PATH=$PATH:$ZOOKEEPER_HOME/bin

启动集群节点

[root@zk1 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@zk1 ~]#

[root@zk2 conf]# cd
[root@zk2 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@zk2 ~]#

[root@zk3 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@zk3 ~]#

查看服务进程ID信息

[root@zk1 ~]# jps
1877 QuorumPeerMain
2153 Jps
[root@zk1 ~]#

[root@zk2 ~]# jps
1296 QuorumPeerMain
1373 Jps
[root@zk2 ~]#

[root@zk3 ~]# jps
1287 QuorumPeerMain
1357 Jps
[root@zk3 ~]#

查看服务节点角色及端口监听

[root@zk1 ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Mode: follower
[root@zk1 ~]# netstat -lnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp6 0 0 192.168.137.130:3888 :::* LISTEN
tcp6 0 0 :::45749 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 ::1:25 :::* LISTEN
tcp6 0 0 :::2181 :::* LISTEN
[root@zk1 ~]#

[root@zk2 ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Mode: leader
[root@zk2 ~]# netstat -lnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp6 0 0 192.168.137.129:3888 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 ::1:25 :::* LISTEN
tcp6 0 0 :::41377 :::* LISTEN
tcp6 0 0 :::2181 :::* LISTEN
tcp6 0 0 192.168.137.129:2888 :::* LISTEN
[root@zk2 ~]#

[root@zk3 ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Mode: follower
[root@zk3 ~]# netstat -lnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp6 0 0 192.168.137.128:3888 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 ::1:25 :::* LISTEN
tcp6 0 0 :::44290 :::* LISTEN
tcp6 0 0 :::2181 :::* LISTEN
[root@zk3 ~]#

使用Portainer管理Docker Swarm集群

下载部署配置文件

https://portainer.io/download/portainer-agent-stack.yml

重命名配置文件

[root@swarm1 ~]# vi portainer-agent-stack.yml
version: '3'

services:
agent:
image: portainer/agent
environment:
# REQUIRED: Should be equal to the service name prefixed by "tasks." when
# deployed inside an overlay network
AGENT_CLUSTER_ADDR: tasks.agent
# AGENT_PORT: 9001
# LOG_LEVEL: debug
volumes:
- /var/run/docker.sock:/var/run/docker.sock
networks:
- agent_network
deploy:
mode: global

portainer:
image: portainer/portainer
command: -H tcp://tasks.agent:9001 --tlsskipverify
ports:
- "9000:9000"
volumes:
- portainer_data:/data
networks:
- agent_network
deploy:
mode: replicated
replicas: 1
placement:
constraints: [node.role == manager]

networks:
agent_network:
driver: overlay

volumes:
portainer_data:

部署服务

[root@swarm1 ~]# docker stack deploy --compose-file=portainer-agent-stack.yml portainer
Creating network portainer_agent_network
Creating service portainer_agent
Creating service portainer_portainer
[root@swarm1 ~]#

查看部署状态和服务状态

Docker Swarm创建集群和加入集群

配置所有节点的hosts文件

[root@swarm1 ~]# vi /etc/hosts
192.168.50.246 swarm1
192.168.50.247 swarm2
192.168.50.248 swarm3
192.168.50.249 swarm4

管理节点初始化swarm集群

[root@swarm1 ~]# docker swarm init --advertise-addr 192.168.50.246
Swarm initialized: current node (rlle6k39z3xk82f1wqmjpd4m4) is now a manager.

To add a worker to this swarm, run the following command:

docker swarm join --token SWMTKN-1-2q9wi5wome3llyxy32n9ojusn7sl6peppdk8hqzvz5ofj89ze6-azmitpoe6vsb4q90vdat0b82l 192.168.50.246:2377

To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.

[root@swarm1 ~]#

查看监听

[root@swarm1 ~]# netstat -lnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp6 0 0 :::2377 :::* LISTEN
tcp6 0 0 :::7946 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 ::1:25 :::* LISTEN
[root@swarm1 ~]#

设置防火墙规则，允许节点间通信

[root@swarm1 ~]# iptables -I INPUT -p tcp --dport 2377 -j ACCEPT
[root@swarm1 ~]# iptables -I INPUT -p tcp --dport 7946 -j ACCEPT
[root@swarm1 ~]# service iptables save
iptables: Saving firewall rules to /etc/sysconfig/iptables:[ OK ]
[root@swarm1 ~]#

其他节点加入集群

[root@swarm2 ~]# docker swarm join --token SWMTKN-1-2q9wi5wome3llyxy32n9ojusn7sl6peppdk8hqzvz5ofj89ze6-azmitpoe6vsb4q90vdat0b82l 192.168.50.246:2377
This node joined a swarm as a worker.
[root@swarm2 ~]#

[root@swarm3 ~]# docker swarm join --token SWMTKN-1-2q9wi5wome3llyxy32n9ojusn7sl6peppdk8hqzvz5ofj89ze6-azmitpoe6vsb4q90vdat0b82l 192.168.50.246:2377
This node joined a swarm as a worker.
[root@swarm3 ~]#

[root@swarm4 ~]# docker swarm join --token SWMTKN-1-2q9wi5wome3llyxy32n9ojusn7sl6peppdk8hqzvz5ofj89ze6-azmitpoe6vsb4q90vdat0b82l 192.168.50.246:2377
This node joined a swarm as a worker.
[root@swarm4 ~]#

查看swarm集群信息

[root@swarm1 ~]# docker info
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 0
Server Version: 18.03.1-ce
Storage Driver: overlay2
Backing Filesystem: xfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: active
NodeID: rlle6k39z3xk82f1wqmjpd4m4
Is Manager: true
ClusterID: fys0dd2rq6v2j8ifxbnyp81oc
Managers: 1
Nodes: 4
Orchestration:
Task History Retention Limit: 5
Raft:
Snapshot Interval: 10000
Number of Old Snapshots to Retain: 0
Heartbeat Tick: 1
Election Tick: 10
Dispatcher:
Heartbeat Period: 5 seconds
CA Configuration:
Expiry Duration: 3 months
Force Rotate: 0
Autolock Managers: false
Root Rotation In Progress: false
Node Address: 192.168.50.246
Manager Addresses:
192.168.50.246:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 773c489c9c1b21a6d78b5c538cd395416ec50f88
runc version: 4fc53a81fb7c994640722ac585fa9ca548971871
init version: 949e6fa
Security Options:
seccomp
Profile: default
Kernel Version: 3.10.0-862.el7.x86_64
Operating System: CentOS Linux 7 (Core)
OSType: linux
Architecture: x86_64
CPUs: 2
Total Memory: 3.849GiB
Name: swarm1
ID: PO2J:RTY3:ZX3Q:EFG2:M6HI:UYRI:HGL4:G2IP:NFQ4:EXIL:K6CQ:Y47I
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
192.168.50.216:5000
127.0.0.0/8
Registry Mirrors:
https://docker.mirrors.ustc.edu.cn/
Live Restore Enabled: false

[root@swarm1 ~]#

在管理节点上查看集群状态

[root@swarm1 ~]# docker node ls
ID HOSTNAME STATUS AVAILABILITY MANAGER STATUS ENGINE VERSION
rlle6k39z3xk82f1wqmjpd4m4 * swarm1 Ready Active Leader 18.03.1-ce
fzi0eoey60bd25cklvt5qg6p5 swarm2 Ready Active 18.03.1-ce
59optctp5n9zvv3lvaifel7bx swarm3 Ready Active 18.03.1-ce
ixqldqaby2jrgfqx7ckjpg0zs swarm4 Ready Active 18.03.1-ce
[root@swarm1 ~]#