Reliable audiovisual archiving using unreliable storage technology and services
Reliable audiovisual archiving using unreliable storage technology and services
The drive for online access to archive content within ‘tapeless’ workflows means that mass-storage technology is an inevitable part of modern archive solutions, either in-house or provided as services by third-parties. But are these solutions safe? Can they assure the data integrity needed for long-term preservation of Petabyte volumes of data? The answer is no. Field studies reveal data corruption can take place silently without detection or correction, including in 'enterprise class' systems explicitly designed to prevent data loss. The reality is that data loss is inevitable to some degree or another from hardware failures, software bugs, and human errors. This paper presents ongoing work in the UK AVATAR-m project and in the recently started EC PrestoPrime project on a framework for storing large audiovisual files on heterogeneous and distributed storage infrastructures that allows various strategies for content replication, integrity monitoring and repair to be developed and tested.
Addis, Matthew
76a7ad46-0adc-44f3-894c-4b2ecbb1131e
Lowe, Richard
d597842e-560d-44a0-bade-dee08ce57677
Salvo, Nicola
fffb5e10-cad1-4dba-aa65-a7546557b2c2
Middleton, Lee
f165a2fa-1a66-4d84-9c58-0cdaa8e73272
September 2009
Addis, Matthew
76a7ad46-0adc-44f3-894c-4b2ecbb1131e
Lowe, Richard
d597842e-560d-44a0-bade-dee08ce57677
Salvo, Nicola
fffb5e10-cad1-4dba-aa65-a7546557b2c2
Middleton, Lee
f165a2fa-1a66-4d84-9c58-0cdaa8e73272
Addis, Matthew, Lowe, Richard, Salvo, Nicola and Middleton, Lee
(2009)
Reliable audiovisual archiving using unreliable storage technology and services.
Conference of the International Broadcasting Convention (IBC 2009), Amsterdam, Netherlands.
Record type:
Conference or Workshop Item
(Paper)
Abstract
The drive for online access to archive content within ‘tapeless’ workflows means that mass-storage technology is an inevitable part of modern archive solutions, either in-house or provided as services by third-parties. But are these solutions safe? Can they assure the data integrity needed for long-term preservation of Petabyte volumes of data? The answer is no. Field studies reveal data corruption can take place silently without detection or correction, including in 'enterprise class' systems explicitly designed to prevent data loss. The reality is that data loss is inevitable to some degree or another from hardware failures, software bugs, and human errors. This paper presents ongoing work in the UK AVATAR-m project and in the recently started EC PrestoPrime project on a framework for storing large audiovisual files on heterogeneous and distributed storage infrastructures that allows various strategies for content replication, integrity monitoring and repair to be developed and tested.
Text
AddisIBC2009PaperID379.pdf
- Version of Record
More information
Published date: September 2009
Additional Information:
Event Dates: September 2009
Venue - Dates:
Conference of the International Broadcasting Convention (IBC 2009), Amsterdam, Netherlands, 2009-09-01
Organisations:
Electronics & Computer Science, IT Innovation
Identifiers
Local EPrints ID: 271066
URI: http://eprints.soton.ac.uk/id/eprint/271066
PURE UUID: e43728d6-127b-429e-b6e6-c7529a05a8f9
Catalogue record
Date deposited: 13 May 2010 11:40
Last modified: 14 Mar 2024 09:21
Export record
Contributors
Author:
Matthew Addis
Author:
Richard Lowe
Author:
Nicola Salvo
Author:
Lee Middleton
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics