(先看看是不是真的报,是阈值问题)经DataX智能分析,该任务最可能的错误原因是:[AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[Framework-14], Description:[DataX传输脏数据超过用户预期,该错误通常是由于源端数据存在较多业务脏数据导致,请仔细检查DataX汇报的脏数据日志信息, 或者您可以适当调大脏数据阈值 .]. - 脏数据条数检查不通过,限制是[0]条,但实际上捕获了[528]条.解决方案: sqlserver-mysql数据迁移,保证迁移两张表的字段(是否是主键,长度,类型); 单纯调试DataX脏数据阈值: 这个参数:“record ”
{ "job": { "setting": { "speed": { "channel": 3, "byte": 1048576 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "content": [ { "reader": { "name": "", "parameter": { "username": "", "password": "", "splitPk": "", "connection": [ { "querySql": [ "" ], "jdbcUrl": [ "" ] } ] } }, "writer": { "name": "", "parameter": { "username": "", "password": "", "column": [ ], "connection": [ { "table": [ ], } ] } } } ] }}
来源地址:https://blog.csdn.net/weixin_48133875/article/details/127558316