由粗到精和特征筛选的精确回归预测方法及其在二语习得中的应用

兰州理工大学学报 ›› 2020, Vol. 46 ›› Issue (6): 104-111.

• 自动化技术与计算机技术 • 上一篇下一篇

由粗到精和特征筛选的精确回归预测方法及其在二语习得中的应用

林玉萍¹, 龙红², 宋盼盼², 李小棉¹

1.西安交通大学外国语学院, 陕西西安 710049;
2.西安交通大学软件学院, 陕西西安 710049

收稿日期:2020-07-14 出版日期:2020-12-28 发布日期:2021-01-07
作者简介:林玉萍(1977-),女,黑龙江勃利县人,副教授
基金资助:
陕西省教育科学“十三五”规划2017年度课题(SGH17H003)

Precise regression prediction method based on coarse-to-fine and feature selection and its application in second language acquisition

LIN Yu-ping¹, LONG Hong², SONG Pan-pan², LI Xiao-mian¹

1. School of Foreign Studies, Xi'an Jiaotong University, Xi'an 710049, China;
2. School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China

Received:2020-07-14 Online:2020-12-28 Published:2021-01-07

摘要/Abstract

摘要： 针对数据分布不均匀且因素多而容易造成预测不精确的问题,提出一种结合由粗到精与特征筛选的精确回归预测方法.首先,由于数据分布不均匀且预测区间大,直接预测难以精确地拟合,提出一种由粗到精的预测方法,并使用决策树进行粗分类,预测目标所在的子区间,然后在子区间内实现精确的回归预测.其次,如果数据量少且特征因素多会引起过拟合,而且部分冗余特征会影响模型的预测精度,因此,提出一种基于特征筛选的回归预测方法以提高预测精度.在大学生的英语成绩与其人格因素数据集上进行相关实验,结果证明了由粗到精和特征筛选方法与传统回归模型相比精度更高且稳定性更好.通过提出的人格因素与英语成绩回归预测模型,可以制定合理的培养方案弥补学生人格因素中的短板,提升学生的自身竞争能力,从而更好地推动中国的英语教育.

关键词: 决策树, 由粗到精, 特征筛选, 回归预测方法

Abstract: To deal with the problem of uneven data distribution and the situation that many factors easily cause inaccurate prediction, this paper proposes an accurate regression prediction method combining coarse to fine and feature selection. First of all, this paper puts forward a prediction method from coarse-to-fine, which uses decision trees to roughly classify the sub-intervals of the prediction target for overcoming the problem that direct prediction may be difficult to accurately fit due to uneven data distribution and large prediction intervals. Next, taking into account of the small amount of data and the circumstance that many feature factors may cause over-fitting and some redundant features may affect the prediction accuracy of the model, this paper proposes a regression prediction method based on feature selection to improve the prediction accuracy. Compared with the traditional regression model, the experimental results on the data set of English achievement of college students and their personality factors have proved that the method from coarse-to-fine and feature selection proposed in this paper has higher precision and better stability. More flexible and feasible syllabus based on proposed method could be laid out to tackle students’ personality traits problem to enhance their competition capability and thus impel English education in China in the future.

Key words: decision trees, coarse-to-fine, feature selection, regression prediction method

中图分类号:

TP391

林玉萍, 龙红, 宋盼盼, 李小棉. 由粗到精和特征筛选的精确回归预测方法及其在二语习得中的应用[J]. 兰州理工大学学报, 2020, 46(6): 104-111.

LIN Yu-ping, LONG Hong, SONG Pan-pan, LI Xiao-mian. Precise regression prediction method based on coarse-to-fine and feature selection and its application in second language acquisition[J]. Journal of Lanzhou University of Technology, 2020, 46(6): 104-111.

参考文献

[1] LI X,CHEN Y,ZENG K.Integration of machine learning and human learning for training optimization in robust linear regression [C]//2016 IEEE International Conference on Acoustics,Speech and Signal Processing.Shanghai:[s.n.],2016: 2613-2617.
[2] COCHRANE D,ORCUTT G H.Application of least squares regression to relationships containing auto-correlated error terms [J].Journal of the American Statistical Association,1949,44(245):32-61.
[3] NOLLER P,LAW H,COMREY AL.Cattell,Comrey,and Eysenck personality factors compared:more evidence for the five robust factors [J].Journal of Personality and Social Psychology,1987,53(4):775-782.
[4] 王士虎,吕纪荣,冯波.基于数据挖掘的英语四级成绩分析与预测 [J].电脑知识与技术,2014,10(3):452-454.
[5] O’HAGAN A,MURPHY T B,GORMLEY I C,et al.Clustering with the multivariate normal inverse Gaussian distribution [J].Computational Statistics & Data Analysis,2016,93(1):18-30.
[6] YONG Z,LIU B,JI X,HUANG D.Classification of EEG signals based on autoregressive model and wavelet packet decomposition [J].Neural Processing Letters,2017,45:1-14.
[7] HALL A.Extremes of integer-valued moving average models with regularly varyingtails [J].Extremes,2001,4(3):219-239.
[8] 范存欣,马绍斌,林汉生,等.大学生心理健康状况及其影响因素的逐步回归分析 [J].中国学校卫生,2001(3):215-216.
[9] ZHANG Z.Variable selection with stepwise and best subset approaches [J].Annals of Translational Medicine,2016,4(7):136-143.
[10] CHINEA-RIOS M,SANCHIS-TRILLES G,CASACUBERTA F.Discriminative ridge regression algorithm for adaptation in statistical machine translation [J].Pattern Analysis & Applications,2018(1):1-13.
[11] REID S,TIBSHIRANI R,FRIEDMAN J.A study of error variance estimation in lasso regression [J].Statistica Sinica,2016,26(1):35-67.
[12] SAFAVIAN S R,LANDGREBE D.A survey of decision tree classifier methodology [J].IEEE Transactions on Systems,Man,and Cybernetics,1991,21(3):660-674.
[13] SHARMILI K C,CHILAMBUCHELVAN A.A hybridization approach for optimal feature subset selection in high dimensional data[J].International Journal of Uncertainty,Fuzziness and Knowledge-Based Systems,2018,26(6):949-970.
[14] ZHOU X,LUO D,YI Y.Improved incremental support vector machine with hybrid feature selection for network intrusion detection [C]//International Conference on Information & Network Security.Beijing:[s.n.],2013:1-6.
[15] MENG Q,LI K,ZHAO C.An improved particle filtering algorithm using different correlation coefficients for nonlinear system state estimation [J].Big Data,2019,7(2):114-120.
[16] 赵光,王栓宏,孙珩.大学英语四级考试成绩预测模型构建与实证分析 [J].中国西部科技,2015(4):94-95.
[17] XIN W.The improvement of CET4 test [J].International English Education Research,2014(9):54-56.
[18] HUI MING D.On the structural model of factors affecting CET4 scores of non-english majors [J].Psychological Science,2007,30(3):676-679.
[19] BLICK G.Personality traits,learning strategies and performance [J].European Journal of Personality,1996,10(4):337-352.
[20] SUNG K Y.Novice learners’ Chinese-character learning strategies and performance [J].Electronic Journal of Foreign Language Teaching,2014,11(1):38-51.
[21] CATTELL R B,EBER H W,TATSUOKA M M.Handbook for the sixteen personality factor questionnaire (16PF) [M].Champaign:Institute for Personality and Ability Testing,1970.
[22] YANG C K,CHOE B M,BAITY M,et al.SCL-90-R and 16PF profiles of senior high school students with excessive internet use [J].Canadian Journal of Psychiatry,2005,50(7):407-414.
[23] MIKHNENKO G,ABSALIAMOVA Y.The formation of intellectual mobility of engineering students through integration of foreign language education and professional training [J].Advanced Education,2018,9:33-38.

由粗到精和特征筛选的精确回归预测方法及其在二语习得中的应用

Precise regression prediction method based on coarse-to-fine and feature selection and its application in second language acquisition

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 14

编辑推荐

Metrics

本文评价

[1]	王星, 晏榕璟. 深度可分卷积结合多通道注意力的垃圾图像快速分类模型[J]. 兰州理工大学学报, 2023, 49(3): 88-93.
[2]	谢楠, 马振国, 唐兵, 黄煜铭, 张柯琪, 曹丹怡. 继电保护设备剩余寿命预测的智能算法研究[J]. 兰州理工大学学报, 2023, 49(2): 83-87.
[3]	苏昀暄, 涂正, 王绪安, 林川. 一种基于CKKS同态加密与神经网络的安全人脸识别方案[J]. 兰州理工大学学报, 2023, 49(2): 103-109.
[4]	王燕, 赵妮妮, 范林. 基于图神经网络特征交叉的协同过滤算法[J]. 兰州理工大学学报, 2023, 49(1): 94-102.
[5]	赵荣珍, 赵楠. 结合扰动集成RBF的故障识别方法[J]. 兰州理工大学学报, 2022, 48(6): 40-45.
[6]	冯笑, 杨雅婷, 董瑞, 艾孜麦提·艾尼瓦尔, 马博. 基于回译和集成学习的维汉神经机器翻译方法[J]. 兰州理工大学学报, 2022, 48(5): 99-106.
[7]	郭润兰, 史方青, 范雅琼, 何智. 基于卷积神经网络的壁面清洗机器人障碍物检测识别算法[J]. 兰州理工大学学报, 2022, 48(4): 83-89.
[8]	赵小强, 蒋红梅. 基于可调节判别器的领域适应[J]. 兰州理工大学学报, 2022, 48(1): 85-90.
[9]	朱昶胜,田慧星,冯文芳. 基于Adaboost算法结合DEGWO-SVM的财务困境预测[J]. 兰州理工大学学报, 2021, 47(6): 100-107.
[10]	赵荣珍, 马森财, 吴耀春. 云模型和集成极限学习机相结合的滚动轴承故障诊断方法[J]. 兰州理工大学学报, 2021, 47(4): 33-39.
[11]	王洪申, 王道俊, 曹玉法. 产品MBD数据集三维标注中工艺面的形成与校验[J]. 兰州理工大学学报, 2021, 47(3): 45-49.
[12]	王洪申, 王道俊. 产品MBD数据集三维标注的自动校验与实现[J]. 兰州理工大学学报, 2021, 47(2): 48-53.
[13]	包广斌, 杨旭鹏, 康宏. 基于改进的高斯混合模型牙齿图像分割研究[J]. 兰州理工大学学报, 2020, 46(3): 100-104.
[14]	张云, 李岚. 基于级联卷积神经网络的人脸特征点识别算法实现[J]. 兰州理工大学学报, 2020, 46(3): 105-109.