Research and Implementation of Algorithm Based on Data Fusion Technology

DOI

10.2991/masta-19.2019.60How to use a DOI?

Keywords

Data fusion, Python, web crawler, PageRank algorithm, NDC algorithm, Student evaluation of teaching

Abstract

As the growing amount of data stored on the Internet, the work of searching for information becomes complicated. The traditional collection method cannot achieve a certain effect, it is cumbersome and time-consuming. Using natural language processing technology and web crawler technology to collect and analyze data about student evaluation, the purpose is to obtain the key factors affecting teachers' comprehensive evaluation results and propose the methods to solve the problems. For the traditional Web crawler technology, there is a lack of certain intelligence, initiative, etc. the design of the best priority crawler framework has improved and optimized its structure. And the improved PageRank value, user demand correlation degree, and NDC algorithm denoising are added, it can effectively solve a series of problems such as long retrieval time, overlapping information, incomplete information, and improve the accuracy of information collection.

Copyright

© 2019, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yu-zi Dou
AU  - Xi-wei Feng
AU  - Rui Zhu
AU  - Tian-zhu Gao
AU  - Yan-bing Wu
AU  - Lei Ma
PY  - 2019/07
DA  - 2019/07
TI  - Research and Implementation of Algorithm Based on Data Fusion Technology
BT  - Proceedings of the 2019 International Conference on Modeling, Analysis, Simulation Technologies and Applications (MASTA 2019)
PB  - Atlantis Press
SP  - 359
EP  - 364
SN  - 1951-6851
UR  - https://doi.org/10.2991/masta-19.2019.60
DO  - 10.2991/masta-19.2019.60
ID  - Dou2019/07
ER  -