这篇文章主要讲解了“在Cassandra集群中表的数据清理与恢复”，文中的讲解内容简单清晰，易于学习与理解，下面请大家跟着小编的思路慢慢深入，一起来研究和学习“在Cassandra集群中表的数据清理与恢复”吧！
目的：项目组需要对线上cassandra集群中某张表数据进行清理，通过实验验证truncate是否可行。
1.环境准备
阿里云环境搭建三节点集群，副本数为2
172.26.99.152
172.26.99.153
172.26.99.154
安装java jdk：
如果有遗留的旧版本，需要先删除
(1)、查看系统自带jdk是否已安装：
yum list installed |grep java
若有自带安装的jdk，如何卸载系统自带java环境：
yum -y remove java-1.7.0-openjdk*
yum -y remove tzdata-java.noarch
(2)、查看yum库中的java安装包
yum -y list java*
(3)、使用yum安装java环境（这里是安装的jdk-1.8.0,如果安装1.7，后面cassandra启动时会报错）
yum install java-1.8.0
(4)、查看刚安装的java版本信息：
java -version
mkdir /CAS
cd /CAS
tar xzvf apache-cassandra-3.11.1-bin.tar.gz
mv apache-cassandra-3.11.1 cassandra
useradd cassandra
passwd cassandra
chown -R cassandra.cassandra /CAS
chmod 755 -R /CAS/cassandra
su - cassandra
cd /CAS/cassandra/conf
$vi cassandra.yaml
- seeds: "192.26.99.152" --这一行由127.0.0.1改为集群中一个或多个节点的IP，不建议所有IP。因为种子节点损坏时修复方法相对复杂
listen_address: 192.168.73.104 --这一行改为当前IP
rpc_address: 192.168.73.104 --改为当前节点的IP
$ vi cassandra-env.sh
cassandra-env.sh 文件需要修改的参数：
JVM_OPTS="$JVM_OPTS -Djava.rmi.server.hostname=192.168.73.104" --此行默认是注释的，需要去掉注释，并将hostname改为当前IP
配置$JAVA_HOME（java环境变量 ）和$CASSANDRA_HOME（cassandra环境变量）
一般来讲通过yum安装的jdk路径应该在/usr/lib/jvm/下（例如我这里的/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.111-0.b15.el6_8.x86_64）
(1)、打开环境变量配置文件,添加内容：
cat >> /etc/profile <<EOF
#java path
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el7_8.x86_64/jre
export JRE_HOME=$JAVA_HOME
export CLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
#cassandra path
CASSANDRA_HOME=/CAS/cassandra
export CASSANDRA_HOME
EOF
(2)、使配置生效：
source /etc/profile
上面操作参考：https://blog.csdn.net/dengjiexian123/article/details/53033119
不过java_home的设置不太一样
启动：
su - cassandra
cd /CAS/cassandra/bin
./cassandra
如果java版本低或未安装成功，此处会报错Cassandra 3.0 and later require Java 8u40 or later.
如果报错Unable to find java executable. Check JAVA_HOME and PATH environment variables.重点检查JAVA_HOME是否正确，方法是执行$JAVA_HOME/bin/java -version
[cassandra@node2 bin]$ ./cqlsh --request-timeout=9000 $HOSTNAME
Connected to Test Cluster at node2:9042.
[cqlsh 5.0.1 | Cassandra 3.11.1 | CQL spec 3.4.4 | Native protocol v4]
Use HELP for help.
cqlsh> desc keyspaces;
system_traces system_schema system_auth system system_distributed
cqlsh> SELECT * FROM system_schema.keyspaces;
keyspace_name | durable_writes | replication
--------------------+----------------+-------------------------------------------------------------------------------------
system_auth | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '1'}
system_schema | True | {'class': 'org.apache.cassandra.locator.LocalStrategy'}
system_distributed | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '3'}
system | True | {'class': 'org.apache.cassandra.locator.LocalStrategy'}
system_traces | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '2'}
(5 rows)
cqlsh>
cqlsh> create keyspace dbrsk WITH replication = {'class':'NetworkTopologyStrategy','datacenter1':2};
cqlsh> SELECT * FROM system_schema.keyspaces;
keyspace_name | durable_writes | replication
--------------------+----------------+---------------------------------------------------------------------------------------
system_auth | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '1'}
system_schema | True | {'class': 'org.apache.cassandra.locator.LocalStrategy'}
system_distributed | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '3'}
system | True | {'class': 'org.apache.cassandra.locator.LocalStrategy'}
dbrsk | True | {'class': 'org.apache.cassandra.locator.NetworkTopologyStrategy', 'datacenter1': '2'}
system_traces | True | {'class': 'org.apache.cassandra.locator.SimpleStrategy', 'replication_factor': '2'}
(6 rows)
从源库查看待测试的表结构，并导出数据：
cqlsh:dbrsk> desc t_card_info;
CREATE TABLE dbrsk.t_card_info (
bankcard text PRIMARY KEY,
bankname text,
cardname text,
cardtype text,
city text,
province text,
updatetime bigint
) WITH bloom_filter_fp_chance = 0.00075
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = '卡信息'
AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.0
AND dclocal_read_repair_chance = 0.0
AND default_time_to_live = 0
AND gc_grace_seconds = 86400
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
cqlsh:dbrsk> copy t_card_info to '/tmp/t_card_info.csv';
Using 16 child processes
Starting copy of dbrsk.t_card_info with columns [bankcard, bankname, cardname, cardtype, city, province, updatetime].
Processed: 2726962 rows; Rate: 5524 rows/s; Avg. rate: 57918 rows/s
2726962 rows exported to 1 files in 47.165 seconds.
当前库建表并导入数据：
cqlsh> use dbrsk;
cqlsh:dbrsk> copy t_card_info from '/tmp/t_card_info.csv';
Using 1 child processes
Starting copy of dbrsk.t_card_info with columns [bankcard, bankname, cardname, cardtype, city, province, updatetime].
Processed: 690000 rows; Rate: 10883 rows/s; Avg. rate: 11617 rows/s
Processed: 1410000 rows; Rate: 13012 rows/s; Avg. rate: 11813 rows/s
Processed: 2115000 rows; Rate: 10324 rows/s; Avg. rate: 11783 rows/s
Processed: 2726962 rows; Rate: 5305 rows/s; Avg. rate: 11893 rows/s
2726962 rows imported from 1 files in 3 minutes and 49.299 seconds (0 skipped).
导入数据前：
[root@node2 data]# du -sh *
408K commitlog
1.4M data
4.0K hints
4.0K saved_caches
导入数据后：
[root@node2 data]# du -sh *
155M commitlog
98M data
4.0K hints
4.0K saved_caches
执行truncate操作并查看效果：
cqlsh:dbrsk> truncate table t_card_info;
[root@node2 dbrsk]# cd t_card_info-9e129520c31c11eab89c515b68839f7c/
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# ls
backups snapshots
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# du -sh *
4.0K backups
103M snapshots
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# cd snapshots/
[root@node2 snapshots]# ls
truncated-1594434747140-t_card_info
[root@node2 snapshots]# cd truncated-1594434747140-t_card_info/
[root@node2 truncated-1594434747140-t_card_info]# ls
manifest.json mc-10-big-Statistics.db mc-11-big-Filter.db mc-12-big-Data.db mc-12-big-TOC.txt mc-9-big-Statistics.db
mc-10-big-CompressionInfo.db mc-10-big-Summary.db mc-11-big-Index.db mc-12-big-Digest.crc32 mc-9-big-CompressionInfo.db mc-9-big-Summary.db
mc-10-big-Data.db mc-10-big-TOC.txt mc-11-big-Statistics.db mc-12-big-Filter.db mc-9-big-Data.db mc-9-big-TOC.txt
mc-10-big-Digest.crc32 mc-11-big-CompressionInfo.db mc-11-big-Summary.db mc-12-big-Index.db mc-9-big-Digest.crc32 schema.cql
mc-10-big-Filter.db mc-11-big-Data.db mc-11-big-TOC.txt mc-12-big-Statistics.db mc-9-big-Filter.db
mc-10-big-Index.db mc-11-big-Digest.crc32 mc-12-big-CompressionInfo.db mc-12-big-Summary.db mc-9-big-Index.db
在其他节点上，空间占用一致：
[cassandra@node3 t_card_info-9e129520c31c11eab89c515b68839f7c]$ du -sh *
4.0K backups
101M snapshots
数据被移动到snapshots文件夹中
执行repair命令，snapshots中的数据不会被清理
./nodetool repair dbrsk
尝试从操作系统中删除snapshots文件夹。删除后数据库可以正常使用。
重新导入数据，并进行表删除操作：
cqlsh:dbrsk> drop table t_card_info ;
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# du -sh *
4.0K backups
103M snapshots
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# ls
backups snapshots
[root@node2 t_card_info-9e129520c31c11eab89c515b68839f7c]# cd snapshots/
[root@node2 snapshots]# ls
dropped-1594435864327-t_card_info
可以看到，drop和truncte表后，数据分别会被放入该表下的snapshots/droppedxxxxxx snapshots/truncatedxxxxxx中。
那么如何恢复呢？
[cassandra@node2 bin]$ ./sstableloader -d 172.26.99.152 /tmp/dbrsk/t_card_info
WARN 11:04:46,472 Only 31.813GiB free across all data volumes. Consider adding more capacity to your cluster or removing obsolete snapshots
Established connection to initial hosts
Opening sstables and calculating sections to stream
Skipping file mc-21-big-Data.db: table dbrsk.t_card_info doesn't exist
Skipping file mc-22-big-Data.db: table dbrsk.t_card_info doesn't exist
Skipping file mc-23-big-Data.db: table dbrsk.t_card_info doesn't exist
Skipping file mc-24-big-Data.db: table dbrsk.t_card_info doesn't exist
Summary statistics:
Connections per host : 1
Total files transferred : 0
Total bytes transferred : 0.000KiB
Total duration : 2934 ms
Average transfer rate : 0.000KiB/s
Peak transfer rate : 0.000KiB/s
直接使用sstableloader时如果表不存在，会报错。需要手工建表：
[cassandra@node2 bin]$ ./cqlsh --request-timeout=90000 $HOSTNAME
Connected to Test Cluster at node2:9042.
[cqlsh 5.0.1 | Cassandra 3.11.1 | CQL spec 3.4.4 | Native protocol v4]
Use HELP for help.
cqlsh> use dbrsk;
cqlsh:dbrsk> CREATE TABLE dbrsk.t_card_info (
... bankcard text PRIMARY KEY,
... bankname text,
... cardname text,
... cardtype text,
... city text,
... province text,
... updatetime bigint
... ) WITH bloom_filter_fp_chance = 0.00075
... AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
... AND comment = '银行卡信息数据'
... AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
... AND compression = {'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
... AND crc_check_chance = 0.0
... AND dclocal_read_repair_chance = 0.0
... AND default_time_to_live = 0
... AND gc_grace_seconds = 86400
... AND max_index_interval = 2048
... AND memtable_flush_period_in_ms = 0
... AND min_index_interval = 128
... AND read_repair_chance = 0.0
... AND speculative_retry = '99PERCENTILE';
cqlsh:dbrsk> exit
[cassandra@node2 bin]$ ./sstableloader -d 172.26.99.152 /tmp/dbrsk/t_card_info
WARN 11:05:57,753 Only 31.813GiB free across all data volumes. Consider adding more capacity to your cluster or removing obsolete snapshots
Established connection to initial hosts
Opening sstables and calculating sections to stream
Streaming relevant part of /tmp/dbrsk/t_card_info/mc-21-big-Data.db /tmp/dbrsk/t_card_info/mc-22-big-Data.db /tmp/dbrsk/t_card_info/mc-23-big-Data.db /tmp/dbrsk/t_card_info/mc-24-big-Data.db to [/172.26.99.154, /172.26.99.152, /172.26.99.153]
progress: [/172.26.99.154]0:0/4 0 % [/172.26.99.152]0:1/4 6 % total: 4% 1.172MiB/s (avg: 1.172MiB/s)
progress: [/172.26.99.154]0:0/4 0 % [/172.26.99.152]0:1/4 6 % [/172.26.99.153]0:0/4 0 % total: 3% 65.484MiB/s (avg: 1.257MiB/s)
progress: [/172.26.99.154]0:0/4 0 % [/172.26.99.152]0:1/4 6 % [/172.26.99.153]0:0/4 0 % total: 3% 2.578MiB/s (avg: 1.260MiB/s)
……
progress: [/172.26.99.154]0:0/4 48 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 24% 245.959MiB/s (avg: 8.540MiB/s)
progress: [/172.26.99.154]0:0/4 49 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 24% 1012.976MiB/s (avg: 8.651MiB/s)
progress: [/172.26.99.154]0:0/4 51 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 25% 1.454GiB/s (avg: 8.803MiB/s)
progress: [/172.26.99.154]0:0/4 54 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 25% 161.665MiB/s (avg: 9.091MiB/s)
progress: [/172.26.99.154]0:0/4 56 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 26% 1.643GiB/s (avg: 9.249MiB/s)
progress: [/172.26.99.154]0:0/4 56 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 26% 134.745MiB/s (avg: 9.254MiB/s)
progress: [/172.26.99.154]0:0/4 58 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 26% 1.702GiB/s (avg: 9.371MiB/s)
progress: [/172.26.99.154]0:0/4 58 % [/172.26.99.152]0:2/4 16 % [/172.26.99.153]0:1/4 13 % total: 26% 23.592MiB/s (avg: 9.406MiB/s)
……
progress: [/172.26.99.154]0:4/4 100% [/172.26.99.152]0:4/4 100% [/172.26.99.153]0:4/4 100% total: 100% 0.000KiB/s (avg: 10.816MiB/s)
Summary statistics:
Connections per host : 1
Total files transferred : 8
Total bytes transferred : 133.156MiB
Total duration : 12314 ms
Average transfer rate : 10.813MiB/s
Peak transfer rate : 17.530MiB/s
结论：truncate操作可行，且出现问题可以恢复，不过恢复的时间较长。
cassandra的truncate table与drop table都不会释放空间，而是将其放入snapshot文件夹下。
感谢各位的阅读，以上就是“在Cassandra集群中表的数据清理与恢复”的内容了，经过本文的学习后，相信大家对在Cassandra集群中表的数据清理与恢复这一问题有了更深刻的体会，具体使用情况还需要大家实践验证。这里是亿速云，小编将为大家推送更多相关知识点的文章，欢迎关注！
