The OM  team will demonstrate how The MatrixStore can protect content from ingest to archive:

- Guaranteed ingest with metadata harvesting (Panasonic P2)

- Secure Ingest Vaults (Lock down from accidental deletion)

- Production/Project parking to a Nearline Vault in AVID and Final Cut Workflows (one click operation)

- Archiving Legacy assets to an online Library Vault using DropSpot, Final Cut Server and CatDV

Implementing a tapeless or file based workflow has been highlighted as one of the top challenges facing creative organisations in 2010. With no tape to put on the shelf broadcasters, post-production facilities and creative agencies are looking for a solution to keep their assets secure and more importantly available throughout the production process. A single MatrixStore cluster acts as pre-production, nearline or local archive allowing content to move seamlessly through any digital workflow from ingest to delivery.

The View From OM

We are very much looking forward to the show so come along and see us on stand C10!

One sweet spot for MatrixStore technology is in the creative space. Creative organisations are increasingly being subjected to change driven by external forces such as changes in the way content is captured and our insatiable appetite for HD or 3D content (see The Big Broadcast Survey published in 2009). The industry is one that is used to adapting to whatever is thrown at it but it also relies on solutions that just work.

Below is a quick summary of the challenges they currently face and how MatrixStore is positioned to help. I will elaborate on each point in later posts :

1. File Based/Tapeless Ingest - Some call it pre-production archiving, some call it prechiving, the problem is the same, more and more content is being captured on disk or flash. There is no tape to put on the shelf. Protecting content that enters the building in an audited manner is a key area where MatrixStore is helping. Integration into Final Cut and Avid workflows, digital fingerprints on ingest, locked vaults to protect from deletion and metadata harvesting from P2, SxS etc are some of the benefits.

2. Parking/Nearline – Production disk, the online, the SAN should be kept lean and mean. Some projects can take years to complete so content needs to be moved off and onto the expensive disk repeatedly over a prolonged period. Tape based technologies do not cut the mustard. Organisations are also looking to ‘rightsize’ their expensive disk by offloading older or less-used content that should not sit clogging up the SAN to a more appropriate tier of storage. Seamless one touch capacity expansion, DropSpot (metadata support/search) and performance make MatrixStore a natural choice.

3. Legacy/Local Archive – organisations who own content need to protect their content or they will not be able to re-use or monetise that content. The two maxims come into their own here. Integration with DAM/MAMs, Self-Management,  redundancy of data, retention policies (prevent change or deletion), metadata and search goodness are key here.

4. Content Manipulation/Distribution Repository - If you own the content and have it protected and available on disk then what can you do with that data? Clustered/Grid architecture, high availability, metadata and search again key.

5. Regulations - More and more financial institutions are using video in the way they communicate with staff or shareholders, that video needs to be protected and stored for a pre-determined period in accordance with global regulations. MatrixStore has built in characteristics that satisfy these compliance requirements.

The View From OM

Even medium to large creative organisations will not have dedicated I.T staff to work on the video side of the business so they need solutions that just work and do not take them out of their comfort zone. The MatrixStore is the storage geek so they don’t need one.

Cardiff, UK – Object Matrix, a developer of secure asset archive and retrieval software, has
today supplied Cardiff based post-production facility Mwnci with its pre-production rushes archive and nearline archive solution, The MatrixStore. The multi-purpose data management
solution provides a secure archive for client owned content that enters the facility and also acts as a secure parking location for ongoing projects.

Rich Moss, Managing Director of Mwnci stated, “More and more of the projects coming into Mwnci are file based and as such we need to ensure we have the best infrastructure in place to cope with not only the incredible amount of content but also the wide variety of the content formats that come into the facility. The DropSpot software from Object Matrix understands the Panasonic P2 and Sony SxS formats allowing metadata entered on the camera to be harvested and attached to the content in our MatrixStore cluster. We made a decision to keep our production SAN at an optimal size for both performance and throughput whilst moving older content that still needs to be accessed to a more appropriate platform.

The MatrixStore fits perfectly as both the pre-production and the nearline archive in our Avid based workflow.”

Mwnci uses mostly Avid technology in the post production of television programming for clients such as the BBC and S4C.

More here….

The View From OM:
For more information on the use of MatrixStore in an AVID workflow go here..

Happy Days. A great end to 2009. Merry Christmas and wishing you a prosperous new year!

Adding to our proven Apple Final Cut Server and CatDV workflows we’ve made some recent improvements to using MatrixStore as both a Pre-Production Archive (ingest location) and a Nearline Archive in Avid workflows.

The workflow shown in this blog post uses Avid AMA and Avid Unity together with MatrixStore at a post-production house here in the UK.

The Phase 1 setup below was fully tested during whilst the items in phase 2 were left to be tested at a later stage (although they are assumed to be working and will be tested as required).

Phase 1 Usage

• Footage and metadata were ingested from P2 cards and local disks
• Windows clients (Vista 64 bit, XP 32-bit)
  
• 3-node MatrixStore Nearline cluster accessed from clients on a Gigabit network
• Avid AMA clients on Windows Vista 64-bit machines
• DropSpot (MatrixStore Client data browser application on Windows and Mac)
• Avid Unity on a FC network

Phase 2 (not tested but to be tested when required)

• Sony SxS cards
• Avid AMA Mac clients
• Panasonic P2 Viewer updating to MatrixStore
• Avid AMA building sequences to MatrixStore
• LTO tape writers running off MatrixStore via MXFS

The following diagram shows the above set-up:

Commentary and Results

The MatrixStore cluster and clients were installed, physically connected to the network and were usable within 3 hours of arriving onsite, with the main delay being working out which clients to use for which stages of the workflow.

Ingest media from P2 or disk was imported via the DropSpot application using the following steps:

1. Data folders to move the footage to were created in DropSpot.
2. Data was imported via DropSpot to the MatrixStore.
3. Multiple clients could Ingest in parallel.

During the Ingest of data, the metadata from the P2 cards was examined and added to the footage itself. This allows the footage to be searched for and also means that the metadata will be kept securely with the footage for as long the footage is kept in the MatrixStore Pre-Production/Nearline archive.

DropSpot runs on Mac, Windows and Linux, and MatrixStore was also found to be useful as a shared storage location between clients.

The resulting data movement occurred as fast as the data could be read. In the case where P2 cards were used this was approximately 50MB/s to 60MB/s, and in a test where data was read from a fast direct attached storage device, data moved at the full network card interface speed available.  Sony SxS cards are expected to ingest at a slower rate where they are using USB technology.

For Edition, Avid AMA clients were set-up on Windows Vista 64bit and XP 32 bit machines and used the MatrixStore “MXFS” virtual filesystem to view and update ingested data as if it were on an attached SAN device. This was achieved in two stages:

1. The folders of Ingested data were scanned by selecting the Avid AMA import volume option. Scanning a folder takes around 20-30 seconds per P2 card whilst Avid software browsed and created stubs.
2. Avid AMA was then to consolidate the data onto the Unity platform. Where consolidating didn’t transcode the data moved from the MatrixStore to Unity at full speed with the client CPU utilized seen to be approximately 10%. Where consolidation was involved transcoding the data moved at 25-30MB/s and the 8 cores of CPU were at 90%+ (ie the bandwidth was limited by the transcoding CPU speed).

Multiple clients can consolidate/send data to Unity in parallel.

One typical usage scenario of the MatrixStore Nearline used was that prior to ingest of data, the user would open up one to three data streams in an Avid AMA client to view the content. So long as the client could cope with the streams (e.g., the graphics card could cope) this worked very well.

Conclusion

• The set-up of the Nearline archive and clients was straightforward and resulted in the Nearline archive being ready to be used on the day that it arrived, validating the Object Matrix “plug and play” analogy.
• The main bottle-necks in the workflow were the speed of the cards being read from and the time taken to transcode data (the users were very happy to see their dual quad core clients being used to their capacity!).
• The new MatrixStore MXFS connection from Windows and Mac was straightforward to set-up and provided up to full bandwidth across the network.
• MatrixStore acted as a first class Nearline archive keeping data safe, secure and available throughout.

Future plans for Object Matrix include forthcoming direct support for Avid Interplay and further support for metadata extraction and handling, but if you’d like to know more about our reference sites and plans for future workflow support let us know!

INGEST:  The Space Box receives and delivers high speed content.

PRODUCTION MEDIA MANAGER:  CatDV catalogues the media allowing you to add and search for metadata

ADOBE NATIVE FILE BASED WORKFLOW: Without Rewrapping  or transcoding Red, P2, XDCAM & AVCHD files

ADOBE PROJECT CREATION & OUTPUT: Speech search, Effects, XML exchange with Avid & FCP

OUTPUT: Blu-Ray authoring with Encore and P2 Archiving with Rimage.

ARCHIVE: MatrixStore – pre-production and nearline storage for tapeless workflows

View Invites

• Cardiff (6pm 17th Nov 2009): adobe-cardiff-seminar
• Bristol (6pm 18th Nov 2009): 0909-qls-adobe-seminar-bristol

Come along and say hello!

Broadcast Engineering Article on Tapeless Digital Workflow

http://broadcastengineering.com/automation/what-digital-workflow-mean-creative-industry-1028/

Article on Data Centre Inefficiencies.

http://www.bcs.org/server.php?show=conWebDoc.32449 (BCS – Chartered Institute for IT)

http://www.businesscomputingworld.co.uk/?tag=energy-consumption (Business Computing World)

Cloud Computing Opinion Piece

http://www.launchlab.co.uk/article/Business-tech/What-is-Cloud-Computing-and-what-are-the-benefits/892

TV-Bay article on Panasonic P2 Live Centre and also piece on MatrixStore as pre-production and nearline archive.

http://www.tv-bay.com/imag/issue_034/pageflip.htm

That DAM Show (Audio Clip)

http://www.thatdamshow.com/latest/?currentPage=6

Digital Production Buzz

http://www.digitalproductionbuzz.com/Archives/buzz_09_05_14.m4a

The reason is nothing to do with the cloud in itself (though using a cloud vendor as your sole repository for content does, possibly, leave your data held to ransom) it is the ability, or lack of, to move large files to and from the cloud. Companies operating in the creative industries are often crippled by the inability to quickly send/share content with clients or collaborators. The vast majority of this creative community are small to medium businesses 80-90% of who cannot afford fibre connections to their premises and their broadband connections just do not cut the mustard. Its like pushing a 16LB bowling ball through 1/4 inch copper pipes..

The Creation and post-production of video and audio content is a collaborative affair often involving geographically separated teams. Whilst work can and is carried out on proxies there is often the need to share content in its native format. Life would be so much easier if the content could get there that much quicker.

We at Object Matrix would welcome an open forum on calculating TCO with other Vendors but realistically that is not going to happen. Martin also rightly pointed out that defining what should be included in a TCO model will be a challenge so I have decided to bullet point the core elements of a TCO model that I will use and I would ask others to conribute..

TCO Model Traditional Elements

• The Analysis period (should include time to ingest and exit not just time content sat on media @ianhf)
• Initial storage requirements
• Annual growth requirements
• Base hardware and software costs (RRP or Discounted @timothyburton)
• Capacity % utilised of storage media
• Capacity upgrade Unit Size and frequency (@ianhf)
• Annual predicted % change in cost of media
• Media Rotation costs (tape and spindles) @thesharmanator
• Verification of written data costs / proof of ongoing authenticity
• Replication cost (comms link vs manual actions)
• Networking costs/Bandwidth utilisation (LAN/SAN etc). Network hog for minimal gain? (@ianhf)
• Employees required / costs / % annual change
• License costs/transferable? (@ianhf)
• Training/Certification costs of operational/support staff (from @Hugh_Waters)
• Energy usage / energy cost rises / better future energy efficiency % changes
• Servicing costs / employee training
• Failover facilities
• Floorspace (from @storagebod)

The very same is happening to PPC and early Intel based Xserves. Out with the old, in with the new.

The re-use opportunity lies in that these are still very reliable, durable units that could be re-purposed within organisations for nearline or archive storage rather than ending up as doorstops (albeit very pretty ones) or fodder for Ebay.

One organisation who decided to take that route is AMV BBDO, no less than the UKs largest advertising agency.

The LAB at AMV BBDO is an Apple based post production facility (read more here about The LAB) that has recently upgraded its XSAN from 1.4 to 2.0, whilst also replacing their trusty, loved Xserve RAIDs with the more powerful (though pugly) RAID subsystems from Promise and introducing the lightening fast Nehalem Xserves into the mix. This much needed upgrade would ordinarily leave 6 Xserve RAIDs and 3 PPC Xserves on the shelf but the guys at The LAB wanted to re-use their kit by using it to add storage capacity to their MatrixStore cluster.

“Our Apple XRAIDs had served us well for 5 years, and when we upgraded our SAN it seemed a shame to consign them to the scrap heap. Redeploying them directly into our MatrixStore made commercial sense, and the process was disarmingly straightforward and uncomplicated.” Alex Buchannan, Tech Manager, The LAB.

Using the Mac OS version of the MatrixStore software an archive cluster node can be created using one Xserve connected to one Xserve RAID (see here for brief explanation).

The spare kit at The LAB allowed them to instantly add 3 Xserves and 3 Xserve RAIDs to their existing MatrixStore cluster providing an 20TB raw storage. The remaining Xserve RAIDs will be added at a later date.

The LAB at AMV BBDO have been an Object Matrix customer since 2006. Once the dust has settled on them, they archive projects from their XSAN into the MatrixStore. From the MatrixStore they quickly retrieve assets on demand. The nature of AMV BBDO’s business means that elements of past adverts (lower thirds etc) may be needed for current or future bids or work. They need data elements to hand but do not want them cluttering up the XSAN.

AMV BBDO have a fully automated, integrated Final Cut Server workflow utilising the MatrixStore plugin for Final Cut Server to archive all assets and selected metadata from a production with a single click (see here for more info).

If you are considering rolling out your Xserve RAIDs and would like to implement a MatrixStore cluster then do get in touch. The current free software license offer to manage up to 15TB of data will only be available for a short period of time, after which a 5TB free license will available.

• File based/Tapeless workflows (P2, Sony, JVC)
• Automated Digital Asset Management (Final Cut Server, CatDV etc)
• Digital Preservation
• Disk based archiving
• Pre & post production archiving
• Rugby (Nick)
• Fooseball (Jon)

So pop over and say hello : Video Rescue Stand (6.C28d)

Cheers

N