The University of Southampton
University of Southampton Institutional Repository

HGE: embedding temporal knowledge graphs in a product space of heterogeneous geometric subspaces

HGE: embedding temporal knowledge graphs in a product space of heterogeneous geometric subspaces
HGE: embedding temporal knowledge graphs in a product space of heterogeneous geometric subspaces
Temporal knowledge graphs represent temporal facts (s,p,o,τ) relating a subject s and an object o via a relation label p at time τ, where τ could be a time point or time interval. Temporal knowledge graphs may exhibit static temporal patterns at distinct points in time and dynamic temporal patterns between different timestamps. In order to learn a rich set of static and dynamic temporal patterns and apply them for inference, several embedding approaches have been suggested in the literature. However, as most of them resort to single underlying embedding spaces, their capability to model all kinds of temporal patterns was severely limited by having to adhere to the geometric property of their one embedding space. We lift this limitation by an embedding approach that maps temporal facts into a product space of several heterogeneous geometric subspaces with distinct geometric properties, i.e.\ Complex, Dual, and Split-complex spaces. In addition, we propose a temporal-geometric attention mechanism to integrate information from different geometric subspaces conveniently according to the captured relational and temporal information. Experimental results on standard temporal benchmark datasets favorably evaluate our approach against state-of-the-art models.
Pan, Jiaxin
b9d70726-a4ee-4bc3-b334-5af55068c7be
Nayyeri, Mojtaba
476e5009-e6fc-45e6-ac7f-c07fe0898632
Li, Yinan
d43db65a-c075-427f-9830-30599072ef6e
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49
Pan, Jiaxin
b9d70726-a4ee-4bc3-b334-5af55068c7be
Nayyeri, Mojtaba
476e5009-e6fc-45e6-ac7f-c07fe0898632
Li, Yinan
d43db65a-c075-427f-9830-30599072ef6e
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49

Pan, Jiaxin, Nayyeri, Mojtaba, Li, Yinan and Staab, Steffen (2024) HGE: embedding temporal knowledge graphs in a product space of heterogeneous geometric subspaces. The 38th Annual AAAI Conference on Artificial Intelligence, Vancouver Convention Centre, Vancouver, Canada. 20 - 27 Feb 2024. 13 pp . (doi:10.48550/arXiv.2312.13680).

Record type: Conference or Workshop Item (Paper)

Abstract

Temporal knowledge graphs represent temporal facts (s,p,o,τ) relating a subject s and an object o via a relation label p at time τ, where τ could be a time point or time interval. Temporal knowledge graphs may exhibit static temporal patterns at distinct points in time and dynamic temporal patterns between different timestamps. In order to learn a rich set of static and dynamic temporal patterns and apply them for inference, several embedding approaches have been suggested in the literature. However, as most of them resort to single underlying embedding spaces, their capability to model all kinds of temporal patterns was severely limited by having to adhere to the geometric property of their one embedding space. We lift this limitation by an embedding approach that maps temporal facts into a product space of several heterogeneous geometric subspaces with distinct geometric properties, i.e.\ Complex, Dual, and Split-complex spaces. In addition, we propose a temporal-geometric attention mechanism to integrate information from different geometric subspaces conveniently according to the captured relational and temporal information. Experimental results on standard temporal benchmark datasets favorably evaluate our approach against state-of-the-art models.

Text
2312.13680 - Accepted Manuscript
Download (5MB)

More information

Published date: 20 February 2024
Venue - Dates: The 38th Annual AAAI Conference on Artificial Intelligence, Vancouver Convention Centre, Vancouver, Canada, 2024-02-20 - 2024-02-27

Identifiers

Local EPrints ID: 485891
URI: http://eprints.soton.ac.uk/id/eprint/485891
PURE UUID: 243c313d-e532-439e-9160-983233c3effc
ORCID for Steffen Staab: ORCID iD orcid.org/0000-0002-0780-4154

Catalogue record

Date deposited: 03 Jan 2024 20:19
Last modified: 18 Mar 2024 03:32

Export record

Altmetrics

Contributors

Author: Jiaxin Pan
Author: Mojtaba Nayyeri
Author: Yinan Li
Author: Steffen Staab ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×