MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models
Abstract
MindMap prompting enhances LLMs by integrating knowledge graphs to improve knowledge incorporation, reduce hallucinations, and provide transparent reasoning pathways.
LLMs usually exhibit limitations in their ability to incorporate new knowledge, the generation of hallucinations, and the transparency of their decision-making process. In this paper, we explore how to prompt LLMs with knowledge graphs (KG), working as a remedy to engage LLMs with up-to-date knowledge and elicit the reasoning pathways from LLMs. Specifically, we build a prompting pipeline that endows LLMs with the capability of comprehending KG inputs and inferring with a combined implicit knowledge and the retrieved external knowledge. In addition, we investigate eliciting the mind map on which LLMs perform the reasoning and generate the answers. It is identified that the produced mind map exhibits the reasoning pathways of LLMs grounded on the ontology of knowledge, hence bringing the prospects of probing and gauging LLM inference in production. The experiments on three question & answering datasets also show that MindMap prompting leads to a striking empirical gain. For instance, prompting a GPT-3.5 with MindMap yields an overwhelming performance over GPT-4 consistently. We also demonstrate that with structured facts retrieved from KG, MindMap can outperform a series of prompting-with-document-retrieval methods, benefiting from more accurate, concise, and comprehensive knowledge from KGs. To reproduce our results and extend the framework further, we make our codebase available at https://github.com/wyl.willing/MindMap.
Community
a einstein
mindmap
  root((Preanesthetic Visit and Assessment))
    PreoperativeAssessment
      HistoryTaking
        Cardiovascular
          IschemicHeartDisease
          Angina
          MyocardialInfarction
          Hypertension
          HeartFailure
          Dysrhythmia
          PeripheralVascularDisease
          DeepVeinThrombosis
          PulmonaryEmbolism
        Respiratory
          COPD
          Asthma
          RespiratoryInfections
        Gastrointestinal
          PepticUlcerDisease
          GastroesophagealReflux
        LiverDisease
        Genitourinary
          UTI
          RenalDysfunction
        Neurological
          Epilepsy
          CVA
          TIA
          PsychiatricDisorders
        EndocrineMetabolic
          Diabetes
          ThyroidDysfunction
        Locomotor
          Osteoarthritis
          InflammatoryArthropathy
        Other
          HIV
          Hepatitis
          Tuberculosis
          Malignancy
          Allergy
        PreviousSurgery
          FamilyHistory
      Examination
        General
        SurgeryRelated
        Systemic
        Specific
      Investigations
        RoutineInvestigations
        FBC
        UreaElectrolytes
        ECG
        ClottingScreen
        ChestXRay
        Urinalysis
        HCG
        BloodGlucose
        ArterialBloodGases
        LiverFunctionTests
      PreoperativeManagement
        Cardiovascular
          Dysrhythmias
          Anemia
        Respiratory
          COPD
          Asthma
        Gastrointestinal
          NilByMouth
        LiverDisease
        Genitourinary
          ChronicRenalFailure
        Malnutrition
        Obesity
        DiabetesMellitus
        Neurological
          StrokeHistory
        RiskFactorsForThrombosis
        Musculoskeletal
        AirwayAssessment
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
 
					 
					 
					 
					 
					