The University of Southampton
University of Southampton Institutional Repository

Reliable audiovisual archiving using unreliable storage technology and services

Reliable audiovisual archiving using unreliable storage technology and services
Reliable audiovisual archiving using unreliable storage technology and services
The drive for online access to archive content within ‘tapeless’ workflows means that mass-storage technology is an inevitable part of modern archive solutions, either in-house or provided as services by third-parties. But are these solutions safe? Can they assure the data integrity needed for long-term preservation of Petabyte volumes of data? The answer is no. Field studies reveal data corruption can take place silently without detection or correction, including in 'enterprise class' systems explicitly designed to prevent data loss. The reality is that data loss is inevitable to some degree or another from hardware failures, software bugs, and human errors. This paper presents ongoing work in the UK AVATAR-m project and in the recently started EC PrestoPrime project on a framework for storing large audiovisual files on heterogeneous and distributed storage infrastructures that allows various strategies for content replication, integrity monitoring and repair to be developed and tested.
Addis, Matthew
76a7ad46-0adc-44f3-894c-4b2ecbb1131e
Lowe, Richard
d597842e-560d-44a0-bade-dee08ce57677
Salvo, Nicola
fffb5e10-cad1-4dba-aa65-a7546557b2c2
Middleton, Lee
f165a2fa-1a66-4d84-9c58-0cdaa8e73272
Addis, Matthew
76a7ad46-0adc-44f3-894c-4b2ecbb1131e
Lowe, Richard
d597842e-560d-44a0-bade-dee08ce57677
Salvo, Nicola
fffb5e10-cad1-4dba-aa65-a7546557b2c2
Middleton, Lee
f165a2fa-1a66-4d84-9c58-0cdaa8e73272

Addis, Matthew, Lowe, Richard, Salvo, Nicola and Middleton, Lee (2009) Reliable audiovisual archiving using unreliable storage technology and services. Conference of the International Broadcasting Convention (IBC 2009), Netherlands.

Record type: Conference or Workshop Item (Paper)

Abstract

The drive for online access to archive content within ‘tapeless’ workflows means that mass-storage technology is an inevitable part of modern archive solutions, either in-house or provided as services by third-parties. But are these solutions safe? Can they assure the data integrity needed for long-term preservation of Petabyte volumes of data? The answer is no. Field studies reveal data corruption can take place silently without detection or correction, including in 'enterprise class' systems explicitly designed to prevent data loss. The reality is that data loss is inevitable to some degree or another from hardware failures, software bugs, and human errors. This paper presents ongoing work in the UK AVATAR-m project and in the recently started EC PrestoPrime project on a framework for storing large audiovisual files on heterogeneous and distributed storage infrastructures that allows various strategies for content replication, integrity monitoring and repair to be developed and tested.

PDF
AddisIBC2009PaperID379.pdf - Version of Record
Download (594kB)

More information

Published date: September 2009
Additional Information: Event Dates: September 2009
Venue - Dates: Conference of the International Broadcasting Convention (IBC 2009), Netherlands, 2009-09-01
Organisations: Electronics & Computer Science, IT Innovation

Identifiers

Local EPrints ID: 271066
URI: https://eprints.soton.ac.uk/id/eprint/271066
PURE UUID: e43728d6-127b-429e-b6e6-c7529a05a8f9

Catalogue record

Date deposited: 13 May 2010 11:40
Last modified: 18 Jul 2017 06:48

Export record

Contributors

Author: Matthew Addis
Author: Richard Lowe
Author: Nicola Salvo
Author: Lee Middleton

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of https://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×