Investigating Transformer-Guided Chaining for Interpretable Natural Logic Reasoning

Page view(s)
144
Checked on Oct 12, 2024
Investigating Transformer-Guided Chaining for Interpretable Natural Logic Reasoning
Title:
Investigating Transformer-Guided Chaining for Interpretable Natural Logic Reasoning
Journal Title:
Findings of the Association for Computational Linguistics: ACL 2023
DOI:
Publication Date:
12 July 2023
Citation:
Kanagasabai Rajaraman, Saravanan Rajamanickam, and Wei Shi. 2023. Investigating Transformer-Guided Chaining for Interpretable Natural Logic Reasoning. In Findings of the Association for Computational Linguistics: ACL 2023, pages 9240–9253, Toronto, Canada. Association for Computational Linguistics.
Abstract:
Natural logic reasoning has received increasing attention lately, with several datasets and neural models proposed, though with limited success. More recently, a new class of works have emerged adopting a Neuro-Symbolic approach, called transformer guided chaining, whereby the idea is to iteratively perform 1-step neural inferences and chain together the results to generate a multi-step reasoning trace. Several works have adapted variants of this central idea and reported significantly high accuracies compared to vanilla LLM’s. In this paper, we perform a critical empirical investigation of the chaining approach on a multi-hop First-Order Logic (FOL) reasoning benchmark. In particular, we develop a reference implementation, called Chainformer, and conduct several experiments to analyze the accuracy, generalization, interpretability, and performance over FOLs. Our findings highlight key strengths and possible current limitations and suggest potential areas for future research in logic reasoning.
License type:
Attribution 4.0 International (CC BY 4.0)
Funding Info:
This research is supported by core funding from: I2R
Grant Reference no. : CR-2021-001
Description:
ISBN:
NA