Research and Implementation of Algorithm Based on Data Fusion Technology
- https://doi.org/10.2991/masta-19.2019.60How to use a DOI?
- Data fusion, Python, web crawler, PageRank algorithm, NDC algorithm, Student evaluation of teaching
As the growing amount of data stored on the Internet, the work of searching for information becomes complicated. The traditional collection method cannot achieve a certain effect, it is cumbersome and time-consuming. Using natural language processing technology and web crawler technology to collect and analyze data about student evaluation, the purpose is to obtain the key factors affecting teachers' comprehensive evaluation results and propose the methods to solve the problems. For the traditional Web crawler technology, there is a lack of certain intelligence, initiative, etc. the design of the best priority crawler framework has improved and optimized its structure. And the improved PageRank value, user demand correlation degree, and NDC algorithm denoising are added, it can effectively solve a series of problems such as long retrieval time, overlapping information, incomplete information, and improve the accuracy of information collection.
- © 2019, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Yu-zi Dou AU - Xi-wei Feng AU - Rui Zhu AU - Tian-zhu Gao AU - Yan-bing Wu AU - Lei Ma PY - 2019/07 DA - 2019/07 TI - Research and Implementation of Algorithm Based on Data Fusion Technology BT - Proceedings of the 2019 International Conference on Modeling, Analysis, Simulation Technologies and Applications (MASTA 2019) PB - Atlantis Press SP - 359 EP - 364 SN - 1951-6851 UR - https://doi.org/10.2991/masta-19.2019.60 DO - https://doi.org/10.2991/masta-19.2019.60 ID - Dou2019/07 ER -