Skip to main navigation Skip to search Skip to main content

Building AI Competency Knowledge Graphs with LLMs: From Job Market Analysis to Educational Guidance

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the rapid advancement of artificial intelligence, the demand for AI talent is constantly evolving. Traditional expert-driven competency modeling approaches suffer from slow update cycles, hindering their ability to provide timely educational guidance. This study proposes an AI competency knowledge graph constructed using large language models (LLMs), enabling the transformation of unstructured recruitment texts into structured educational knowledge through an end-to-end automated framework. A total of 1,142 industry job postings were collected, and competency entities were extracted using few-shot prompt engineering. A two-stage strategy combining semantic embedding and LLM-assisted validation was employed for entity alignment and standardization. The method achieved a micro F1 score of 72.5% on a validation set of 120 samples, resulting in a knowledge graph containing 5,793 standardized competency entities. Application cases such as core skill identification and personalized career planning demonstrate the graph's applicability in curriculum design, career guidance, and learning support. This research establishes a data-driven approach for translating dynamic labor market demands into structured educational knowledge, providing a digital foundation for AI education.

Original languageEnglish
Title of host publicationTALE 2025 - 2025 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331598419
DOIs
Publication statusPublished - 2025
Event14th International Conference on Teaching, Assessment, and Learning for Engineering, TALE 2025 - Macao, China
Duration: 4 Dec 20257 Dec 2025

Publication series

NameTALE 2025 - 2025 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, Proceedings

Conference

Conference14th International Conference on Teaching, Assessment, and Learning for Engineering, TALE 2025
Country/TerritoryChina
CityMacao
Period4/12/257/12/25

Keywords

  • Competency
  • Educational Technology
  • Entity Extraction
  • Knowledge Graph
  • Large Language Model

Fingerprint

Dive into the research topics of 'Building AI Competency Knowledge Graphs with LLMs: From Job Market Analysis to Educational Guidance'. Together they form a unique fingerprint.

Cite this