The University of Southampton
University of Southampton Institutional Repository

Detection of material property errors in handbooks and databases using artificial neural networks with hidden correlations

Detection of material property errors in handbooks and databases using artificial neural networks with hidden correlations
Detection of material property errors in handbooks and databases using artificial neural networks with hidden correlations
The authors have discovered a systematic, intelligent and potentially automatic method to detect errors in handbooks and stop their transmission using unrecognised relationships between materials properties. The scientific community relies on the veracity of scientific data in handbooks and databases, some of which have a long pedigree covering several decades. Although various outlier-detection procedures are employed to detect and, where appropriate, remove contaminated data, errors, which had not been discovered by established methods, were easily detected by our artificial neural network in tables of properties of the elements. We started using neural networks to discover unrecognised relationships between materials properties and quickly found that they were very good at finding inconsistencies in groups of data. They reveal variations from 10 to 900% in tables of property data for the elements and point out those that are most probably correct. Compared with the statistical method adopted by Ashby and co-workers [Proc. R. Soc. Lond. Ser. A 454 (1998) p. 1301, 1323], this method locates more inconsistencies and could be embedded in database software for automatic self-checking. We anticipate that our suggestion will be a starting point to deal with this basic problem that affects researchers in every field. The authors believe it may eventually moderate the current expectation that data field error rates will persist at between 1 and 5%.
neural networks, databases, error detection, outlier detection, properties correlations
1478-6435
4453-4474
Zhang, Y.M.
fcc93306-15b2-4fba-963b-579bba27bde3
Evans, J.R.G.
6f6c8a4c-24ac-4144-a555-51438e4d40e0
Yang, S.F.
e0018adf-8123-4a54-b8dd-306c10ca48f1
Zhang, Y.M.
fcc93306-15b2-4fba-963b-579bba27bde3
Evans, J.R.G.
6f6c8a4c-24ac-4144-a555-51438e4d40e0
Yang, S.F.
e0018adf-8123-4a54-b8dd-306c10ca48f1

Zhang, Y.M., Evans, J.R.G. and Yang, S.F. (2010) Detection of material property errors in handbooks and databases using artificial neural networks with hidden correlations. Philosophical Magazine, 90 (33), 4453-4474. (doi:10.1080/14786435.2010.510452).

Record type: Article

Abstract

The authors have discovered a systematic, intelligent and potentially automatic method to detect errors in handbooks and stop their transmission using unrecognised relationships between materials properties. The scientific community relies on the veracity of scientific data in handbooks and databases, some of which have a long pedigree covering several decades. Although various outlier-detection procedures are employed to detect and, where appropriate, remove contaminated data, errors, which had not been discovered by established methods, were easily detected by our artificial neural network in tables of properties of the elements. We started using neural networks to discover unrecognised relationships between materials properties and quickly found that they were very good at finding inconsistencies in groups of data. They reveal variations from 10 to 900% in tables of property data for the elements and point out those that are most probably correct. Compared with the statistical method adopted by Ashby and co-workers [Proc. R. Soc. Lond. Ser. A 454 (1998) p. 1301, 1323], this method locates more inconsistencies and could be embedded in database software for automatic self-checking. We anticipate that our suggestion will be a starting point to deal with this basic problem that affects researchers in every field. The authors believe it may eventually moderate the current expectation that data field error rates will persist at between 1 and 5%.

Text
published.pdf - Version of Record
Restricted to Repository staff only
Request a copy

More information

Published date: November 2010
Keywords: neural networks, databases, error detection, outlier detection, properties correlations
Organisations: Engineering Mats & Surface Engineerg Gp

Identifiers

Local EPrints ID: 165913
URI: http://eprints.soton.ac.uk/id/eprint/165913
ISSN: 1478-6435
PURE UUID: 5365aca4-fc20-4962-a448-01f9b3175c2f
ORCID for S.F. Yang: ORCID iD orcid.org/0000-0002-3888-3211

Catalogue record

Date deposited: 20 Oct 2010 08:08
Last modified: 14 Mar 2024 02:12

Export record

Altmetrics

Contributors

Author: Y.M. Zhang
Author: J.R.G. Evans
Author: S.F. Yang ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×