Analyzing the evolutionary trajectory of technological themes based on the BERTopic model: A case study in the field of artificial intelligence

As the wave of technological innovation propels national development into the future, technological advancement has emerged as a crucial pillar for enhancing international competitiveness. Unraveling the evolutionary trajectory of technologies and their associated themes provides a solid theoretical foundation for strategic decision-making in fostering future industrial technological upgrades, thereby aiding in seizing the initiative in technological innovation. This study, adopts a multi-source data perspective, employing the life cycle theory to delineate temporal windows. We use the BERTopic model to extract technological themes and construct a co-occurrence network of theme keywords. Three network centrality indices are computed to filter key theme terms, and the Word2Vec model is leveraged to calculate cosine similarities. Ultimately, we map out the evolutionary pathway of technological themes using Sankey diagrams. Taking the field of artificial intelligence as an example, the study found that the proposed method could effectively identify 48 technical theme keywords and analyze the technological evolution paths of these keywords in areas such as scenario applications, network services, human-computer interaction, intelligent detection, and natural language processing. Furthermore, all evaluation metrics of the model outperformed those of comparable topic models. The rationality of the empirical results was validated through examination against national policies and market application scenarios.