Comments on: Big Fat Pipes to the Cloud http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/ Protect your digital archive forever Mon, 05 Jul 2010 18:56:04 +0100 hourly 1 http://wordpress.org/?v=3.0 By: Bhavik Vyas http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-715 Bhavik Vyas Fri, 15 Jan 2010 22:13:07 +0000 http://www.matrixstore.net/?p=747#comment-715 This is a shameless company plug - but there are very elegant solutions that allow users & enterprises to use the b/w they have to push large content. We at Aspera are doing this on a daily basis for Media & Entertainment customers, allowing them to fully utilize their b/w for moving content, over any distance. We recently launched a digital import/export product for Amazon Web Services, Aspera On-Demand, which lowers the bar to cloud adoption... This is a shameless company plug – but there are very elegant solutions that allow users & enterprises to use the b/w they have to push large content. We at Aspera are doing this on a daily basis for Media & Entertainment customers, allowing them to fully utilize their b/w for moving content, over any distance. We recently launched a digital import/export product for Amazon Web Services, Aspera On-Demand, which lowers the bar to cloud adoption…

]]> By: NPT http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-634 NPT Fri, 23 Oct 2009 13:19:18 +0000 http://www.matrixstore.net/?p=747#comment-634 Polprav, Gladly. Polprav,

Gladly.

]]> By: Polprav http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-620 Polprav Fri, 16 Oct 2009 15:00:12 +0000 http://www.matrixstore.net/?p=747#comment-620 Hello from Russia! Can I quote a post in your blog with the link to you? Hello from Russia!
Can I quote a post in your blog with the link to you?

]]> By: Glenn Hall http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-576 Glenn Hall Mon, 21 Sep 2009 12:32:14 +0000 http://www.matrixstore.net/?p=747#comment-576 A useful topic to debate. Lets move past Fat-Pipes towards services in the cloud(s). I think we are a little stuck in "we've always done everything at 100%realtime and engineered some (ingest) faster, 4x or better" How long is it since we examined the value of fatpipe in an economic context viewed a cross the whole production requirement? I don't think we need, or can afford fatpipe all the time. What cloud can bring us is many services, that can be delivered with an asymmetric (fat/thin/medium, partial/lumpy/donkey)link,.. AND still be valuable. Storage in the cloud:-Absolutely YES, but with an asymmetric approach based on an economic utility. Sometimes we need more than we can afford, but not for long. Indexing and other services could then be cloudsourced (ouch, sorry)affording a wide offering, to many. Perhaps in the case of a storage system such as OM, there could be many new possibilities, such as putting object indexes in the cloud, and then rebuilding async content elsewhere, whilst routing transforms, and renders in a market approach. So, I have a Yes vote for cloud, and a plea for more forward-thinking. Lets not just re-engineer the world we have today (which does after all have a economic challenge or two) in a version "in the cloud". reThink, this is full, really full of new opportunity. (and for reference I was lucky enough to spend a fair few years in HP Labs doing large scale media compute infrastructure, running server farms for media transforms (4K units in 3 continents with fat & thin pipes) Cloud as a genre hadn't quite become common parlance, even 2 years ago, except in rarefied research circles. Now, at least its (on the way to being) understood far more widely. A useful topic to debate. Lets move past Fat-Pipes towards services in the cloud(s).
I think we are a little stuck in “we’ve always done everything at 100%realtime and engineered some (ingest) faster, 4x or better”
How long is it since we examined the value of fatpipe in an economic context viewed a cross the whole production requirement?
I don’t think we need, or can afford fatpipe all the time.
What cloud can bring us is many services, that can be delivered with an asymmetric (fat/thin/medium, partial/lumpy/donkey)link,..
AND still be valuable.
Storage in the cloud:-Absolutely YES, but with an asymmetric approach based on an economic utility. Sometimes we need more than we can afford, but not for long.
Indexing and other services could then be cloudsourced (ouch, sorry)affording a wide offering, to many.
Perhaps in the case of a storage system such as OM, there could be many new possibilities, such as putting object indexes in the cloud, and then rebuilding async content elsewhere, whilst routing transforms, and renders in a market approach.
So, I have a Yes vote for cloud, and a plea for more forward-thinking. Lets not just re-engineer the world we have today (which does after all have a economic challenge or two) in a version “in the cloud”.
reThink, this is full, really full of new opportunity.

(and for reference I was lucky enough to spend a fair few years in HP Labs doing large scale media compute infrastructure, running server farms for media transforms (4K units in 3 continents with fat & thin pipes) Cloud as a genre hadn’t quite become common parlance, even 2 years ago, except in rarefied research circles. Now, at least its (on the way to being) understood far more widely.

]]> By: Nick Lambert http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-575 Nick Lambert Mon, 21 Sep 2009 11:27:22 +0000 http://www.matrixstore.net/?p=747#comment-575 As an outsource company we rely on moving large files around the globe. Rather than look at the cloud as back-up, we see it as a repository. DropBox works pretty well for this. But the fact remains that very few have access to a fast connection as you stated. Having been around since the baud days of the internet things have improved. We just need a giant step forward, but with BT still owning the exchanges I'll have to wait for ours to be upgraded. No hope of fibre where I live & work!. Having to budget time for download & upload of files is something we will all have to live with for a while. As an outsource company we rely on moving large files around the globe. Rather than look at the cloud as back-up, we see it as a repository. DropBox works pretty well for this.
But the fact remains that very few have access to a fast connection as you stated. Having been around since the baud days of the internet things have improved. We just need a giant step forward, but with BT still owning the exchanges I’ll have to wait for ours to be upgraded. No hope of fibre where I live & work!.
Having to budget time for download & upload of files is something we will all have to live with for a while.

]]> By: Steve Sharman http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-574 Steve Sharman Mon, 21 Sep 2009 11:03:14 +0000 http://www.matrixstore.net/?p=747#comment-574 @NPT - You're right of course, my thought was only that there is an fairly major difference between the size of pipe necessary for effective collaboration on full-res audio to that required for effective collaboration on full-res video. Great post from Hugh - but we should also bear in mind that better exploitation of small or even medium pipes is equally valid for success in the global economy at least in the medium term - there are many countries that are years from having even what we have, but want to push forward regardless - see the success of mobile-based payment and trading platforms in Africa, or Facebook slimming down to be attractive to bandwidth-limited places. It feels like the danger for the UK is as much about failing to innovate and compete with what we have as it is about not building out that new infrastructure that we do need. Given our long tradition of people in sheds coming up with great inventions that overcome or build on limitations, we surely should be able to do both. @NPT – You’re right of course, my thought was only that there is an fairly major difference between the size of pipe necessary for effective collaboration on full-res audio to that required for effective collaboration on full-res video.

Great post from Hugh – but we should also bear in mind that better exploitation of small or even medium pipes is equally valid for success in the global economy at least in the medium term – there are many countries that are years from having even what we have, but want to push forward regardless – see the success of mobile-based payment and trading platforms in Africa, or Facebook slimming down to be attractive to bandwidth-limited places.

It feels like the danger for the UK is as much about failing to innovate and compete with what we have as it is about not building out that new infrastructure that we do need. Given our long tradition of people in sheds coming up with great inventions that overcome or build on limitations, we surely should be able to do both.

]]> By: Hugh http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-573 Hugh Mon, 21 Sep 2009 10:32:51 +0000 http://www.matrixstore.net/?p=747#comment-573 We need fat pipes. It isn't a question of whether we can get away without them them today, but, like the country's road, rail, airports, legal & financial systems, without real, fast & affordable data connections our country will not be able to develop 'fat pipe stuff' & will struggle to innovate, invent & compete globally. The technology exists - others will exploit it, with or without us. On the cloud storage point, well I'm still very uncomfortable about putting my data somewhere out of reach of eye, hand, or law but having seen how often production companies simply lose interest in their material after the edit (our libraries at both Molinare & Tele-Cine were stuffed with footage people wouldn't take away) perhaps it isn't one of their big worries. We need fat pipes. It isn’t a question of whether we can get away without them them today, but, like the country’s road, rail, airports, legal & financial systems, without real, fast & affordable data connections our country will not be able to develop ‘fat pipe stuff’ & will struggle to innovate, invent & compete globally.

The technology exists – others will exploit it, with or without us.

On the cloud storage point, well I’m still very uncomfortable about putting my data somewhere out of reach of eye, hand, or law but having seen how often production companies simply lose interest in their material after the edit (our libraries at both Molinare & Tele-Cine were stuffed with footage people wouldn’t take away) perhaps it isn’t one of their big worries.

]]> By: NPT http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-572 NPT Mon, 21 Sep 2009 09:56:13 +0000 http://www.matrixstore.net/?p=747#comment-572 "Slight correction as well - even uncompressed audio doesn’t really need big fat pipes" Tell that to the guys working with multi track pro-tools sessions needing to collaborate with remote engineers, artists or clients. It's Digi-Delivery, FTP or nothing.. I agree that the collaborative piece being pushed to the cloud would bring benefit. Shared workspaces etc. But then we are thinking of amending ways of working to solve an underlying lack of infrastructure. We all need big fat pipes. Ideally. “Slight correction as well – even uncompressed audio doesn’t really need big fat pipes”

Tell that to the guys working with multi track pro-tools sessions needing to collaborate with remote engineers, artists or clients. It’s Digi-Delivery, FTP or nothing..

I agree that the collaborative piece being pushed to the cloud would bring benefit. Shared workspaces etc. But then we are thinking of amending ways of working to solve an underlying lack of infrastructure.

We all need big fat pipes. Ideally.

]]> By: Steve Sharman http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-570 Steve Sharman Mon, 21 Sep 2009 09:49:33 +0000 http://www.matrixstore.net/?p=747#comment-570 But for many applications, there may be little advantage to the cloud - so put metadata, control, collaboration, communication etc, into the cloud - but leave the video where it is. Chances are it doesn't need to go into the cloud - if it needs to go somewhere, there, then it can go point to point, with the cloud tracking it. I may be wrong about that, but it's an interesting point for debate, I think. Slight correction as well - even uncompressed audio doesn't really need big fat pipes. But for many applications, there may be little advantage to the cloud – so put metadata, control, collaboration, communication etc, into the cloud – but leave the video where it is. Chances are it doesn’t need to go into the cloud – if it needs to go somewhere, there, then it can go point to point, with the cloud tracking it. I may be wrong about that, but it’s an interesting point for debate, I think.

Slight correction as well – even uncompressed audio doesn’t really need big fat pipes.

]]> By: Kashaan http://www.matrixstore.net/2009/09/21/big-fat-pipes-to-the-cloud/comment-page-1/#comment-569 Kashaan Mon, 21 Sep 2009 09:43:04 +0000 http://www.matrixstore.net/?p=747#comment-569 Totally agree. Connectivity needs to improve a great deal before some of these cloud services show real benefit. We're working on it. Totally agree. Connectivity needs to improve a great deal before some of these cloud services show real benefit. We’re working on it.

]]>