4
Cloud Storage

“It’s not the having, it’s the getting.”

—Elizabeth Taylor

At its most basic, Cloud Storage is just a copy of a file on the Internet somewhere, but that can be accessed from anywhere. The most familiar form of this is a photograph, a single copy of which may be uploaded to a social networking site, instantly available for others to see without the fuss of having to send emails or thumb drives, but the same concept extends to any type of digital file.

Cloud Storage is probably the most familiar part of the Cloud for most people. The concept of a file is easy for most people to grasp—whether this means a song from an album, a digital photograph, or a document of some type. Traditionally such files were stored on “local storage”—a person’s own computer (or a disk attached to that computer), but since the early days of Cloud Computing there has been some form of Cloud Storage, whether in the form of attachments in webmail, documents in Google Docs, or images in Flickr.

Before long, two things became clear: first that there were unexpected side-effects of saving these kinds of documents in the Cloud (both positive and negative), and second that people wanted to be able to do more of the things that would typically be relegated to a computer desktop such as organising, copying, and deleting.

Figure 4.1 Cloud Storage

Figure 4.1 Cloud Storage

Recipe for Cloud Storage

What You Need
  • ▸ Several megabytes (or more!) of electronic documents, saved on a computer or mobile device;
  • ▸ A Cloud Storage service account. For speedy preparation, this service should come with an app specifically for your computer or mobile device;
  • ▸ An Internet connection.
What to Do—from a Desktop Computer
  1. If you haven’t already, connect to the Internet;
  2. Open the File Browser;
  3. Transfer (copy or move) the documents, files, and folders that you want stored in the Cloud to your Cloud Storage folder;
  4. Let the files upload for a little while, and then they’re ready to serve.
What to Do—from a Mobile Device
  1. Make sure you’re on WiFi (or on a data network if your cellular plan allows);
  2. Open the app with the document ready to share;
  3. Tap the share button lightly, and be sure to pick your Cloud Storage app;
  4. Watch the document completely upload, and it’s ready to serve.
fig0001

Box 4.1 The Nuts & Bolts of Cloud Storage

Part 1—Transfer

In some ways the easiest part of running a Cloud Storage service is transferring files to (and from) the service in the first place. Much of the Internet itself is founded on the systems of file transfer, and as such, many technologies such as Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), and the like already exist and can be leveraged by service providers without much effort if needed. That said, many service providers actually build their own transfer protocols to get around existing limitations or provide some other benefit, such as synchronisation or enhanced security.

As a result, different Cloud Storage services will have different features and limitations when it comes to the process of merely getting the files onto the Cloud in the first place, before you even consider what’s possible once they’re there.

Part 2—Storage

What’s interesting (or perhaps confusing, depending on your perspective) about Cloud Storage is that the files and folders saved on the Cloud actually exist on physical disks somewhere, in much the same way as they would if you kept them locally. Technically they’re just bits and bytes of data saved to digital storage devices and subject to the exact same risks and problems as if you’d saved them onto your laptop’s hard drive, including accidental deletion, data corruption, and even theft.

In reality, though, Cloud Storage providers are able to make use of greater redundancy and superior hardware to maintain the data stored, especially when you consider it’s in their best interest to make sure their clients’ data remain intact.

Part 3—Sync

The original, and perhaps still most useful, feature of Cloud Storage is the ability to synchronise files between devices. Though this has been possible on desktop computers in a number of ways prior to the advent of Cloud Storage, doing so often required a needlessly complicated system of networking and backup software that made simply using thumb drives a preferable situation for most people.

Then Dropbox came along and gave users a single folder on their computer. Whatever anyone put in that folder would automatically get copied to any other computer that had Dropbox installed. If they then changed the file on another computer, the original file would be updated too.

Many of Dropbox’s first users had no idea what the Cloud even was, just that they now had a simple, understandable way to get the same files on each of their computers. Naturally this service evolved in a number of ways, but this core functionality remains a strong selling point (and still remains the only relevant feature for many users) and is included as standard in most Cloud Storage services.

Part 4—Management

So you’ve stored some documents in the Cloud. Now what? Depending upon the particular Cloud Storage provider, there are many options for managing those documents, from downloading them later, to organising them into folder structures, synchronising them to multiple devices, searching them, sharing them with others (and setting various permissions for doing so), or even inviting collaborators to edit them directly.

Almost all of these options have analogues to a traditional desktop computer file browser, but the nature of using a web page to do these things allows for a number of affordances that makes each of these processes easier for users to understand. There are even features that work much better than a desktop counterpart could, such as the real-time collaborative editing of a Google Spreadsheet.

That said, there are still plenty of areas where you can’t beat working with a file on a computer. It’s unlikely a consumer Cloud Storage service would ever have the ability to play back a DPX image sequence, or be able to directly edit a Final Draft screenplay, but it’s trivial to do such things on a desktop computer, given the right software.

Benefits of Cloud Storage

Ease

Cloud Storage can actually be easier to use than, say, a removable drive. You don’t have to worry about which types of computers it will work with, there’s a constant reminder of how much space is available and, strictly speaking, you don’t even need to organise files—you can just use Cloud Storage as a dumping ground and rely on search functions to find files when you need them.

Access

One of the most obvious benefits to Cloud Storage is the ability to access files from anywhere (anywhere with an Internet connection, at least). Put your location stills in Cloud Storage somewhere, and you’ve got access to them at hotels; make sure a copy of your release forms are saved to the Cloud somewhere, and you need never worry that you don’t have them next time you need them.

In addition to the desktop and mobile software that can be used to organ-ise and access files in Cloud Storage, most providers also offer the means to organise and access files through a web portal as well. Not only does this provide a convenient way for users to access their files when the mobile or desktop software is unavailable (such as when using someone else’s computer, for example), but it also allows for additional management and configuration for files. For example, the web interface for Box has comprehensive file and folder sharing options, as well as the ability to add notes, features that are not directly available when browsing the same files on the desktop.

Synchronisation

Many Cloud Storage services include synchronisation of files between devices in some way. Not only does this ensure a particular file exists on each of your devices, but it also means that updating one of them automatically updates the others. Add some records to a FileMaker database on your desktop computer that’s synchronised to a Cloud Storage provider, and the next time you open it on your laptop those records will be there, without needing to use a dedicated server.

Collaboration

As with much of the Cloud, if Cloud Storage is about anything it’s about connecting with others. Most Cloud Storage providers provide a way to share your files with others (most of them offer a way to do so securely as well as conveniently), but some even go as far as allowing you to work collaboratively, letting others make changes to your files, or providing the means to make remarks on them. Some providers also have an Application Programming Interface (API), allowing users to build their own software to interact with their data in some way.

Cost-Effectiveness

When you can buy a terabyte of external storage for less than a hundred dollars, it raises the question of why you’d want to spend (typically) significantly more for a Cloud Storage solution for a prolonged period of time. However, it’s important to remember that in many cases you’re actually paying for all the other benefits Cloud Storage gives you, beyond the simple case of just having somewhere to store some files. Storing files is cheap but maintaining them is expensive.

Security & Reliability

One of the benefits of using a Cloud Storage provider as opposed to relying on just keeping the same files in a folder on your desktop computer is that you get the benefits of the providers’ (hopefully) greater IT expertise and resources. Cloud Storage providers typically have an extremely high level of data redundancy that mitigates the likelihood of any particular file becoming lost (or corrupted), even if they were to simultaneously lose multiple data drives. Many also couple this with data encryption (at the point of transfer and when the files themselves are stored) and other digital and physical measures to prevent your data being accessible by the wrong people.

It might seem counter-intuitive to protect the confidentiality of your data by giving it to someone else, but in doing so, you potentially get an army of IT technicians working round the clock to protect your files, in a way that would be difficult for even a blockbuster-budget production to be able to replicate.

Versioning

Many providers have begun to include versioning features as part of their service. Any changes made to a file (including if the file itself is deleted) are stored as a version of that file, and older versions can be accessed later as needed (although some providers only store such versions for a limited period of time).

fig0001

Box 4.2 Data Storage and Redundancy

A myriad of things can go wrong with files stored on traditional disk drives, and any of these issues can lead to some corruption of a single file in the least severe instance to the entire contents being lost for good. This has been a problem for anyone using digital storage since before Cloud Storage even existed, and as such there were several ways to minimise the potential damage a disk failure could incur. These came in many different forms, such as having a solid backup system, or spreading data across multiple linked drives, but they all boil down to one thing: redundancy, or having multiple copies of your data.

The concept of redundancy is easy enough to understand when it applies to a backup system—if you lose a disk full of camera reports that you’ve previously copied to a second disk then your data are still safe (assuming, of course, that second disk is fine). The same principle applies to Redundant Array of Independent Disks (RAID), except that instead of two or more complete copies being stored on separate disks, each file is split across multiple disks, along with some extra data that allows the files to be re-created in case of a problem.

If a single disk in a RAID is lost, for example, it’s not a big deal (other than replacing the faulty disk), because there’s enough data stored on all the other disks to re-create the data on the disk that was lost. There are different configurations of RAID that allow for files to be safe even if two (or more) disks are lost simultaneously, each with trade-offs of requiring more storage space, more physical disks, or just more time to recover from failure.

Most Cloud Storage providers are in a position to offer data redundancy across not just multiple disks but multiple facilities. In theory, one of Amazon S3’s data centers could be hit by an atom bomb and its clients’ data would still be intact.

Drawbacks of Cloud Storage

Online Requirement

One of the biggest strengths of Cloud Storage is also one of its biggest drawbacks: its dependence on the Internet. Find yourself without an Internet connection, and you’ll find yourself without access to your files. This is less of an issue for those providers that also offer some sort of synchronisation option, because then at least you still have the local copy of your files when you can’t get to the Internet, but there’s a point where this becomes self-defeating—you don’t necessarily want to have all your video dailies saved to local storage all the time because it’s a waste of disk space most of the time.

Speed

For most real-world uses of Cloud Storage on any production, speed is going to be one of the primary legitimate concerns for most people. You can transfer files only as fast as your Internet connection allows, and if you’re planning to regularly transfer lots of large files (like camera footage) back and forth, you’re going to experience limitations and frustrating delays no matter how fast that connection is.

The concept of making a “copy” in terms of Cloud Storage actually involves what could be considered two time-consuming processes: first the files must be uploaded to the Cloud and then downloaded elsewhere (although at least such uploads normally only ever have to be made once).

Capacity

Cloud Storage, like local storage, tends to be cost-effective in terms of how much data you store up until a specific point. For local storage, it’s pretty common to buy disks to a total of around 10 terabytes (TB) or so before things start getting expensive and you have to think about getting specialised hardware or keeping a stack of disks on a shelf somewhere; for Cloud Storage there tends to be a limit of around a terabyte or so until the cost goes up steeply (many providers simply offer a maximum storage plan with no option get more), although conversely many will also offer a plan that gives you around 5 gigabytes (GB) or so for free.

Although it’s likely Cloud Storage limits will continue to increase over time, this will likely coincide with a corresponding increase in capacity per disk of local storage, which will remain more affordable for higher volumes of data.

In terms of the amount of data a typical production might generate from pre-production to post-production, 5 GB might well be enough to store pertinent spreadsheets and text documents, but once you start including reference images and photos you could find yourself running into that tera-byte limit before the film is done. If you were to start thinking about storing camera footage as well, you’d need something in the order of hundreds of terabytes of storage for a typical feature film (and a very fast Internet connection to get it there).

Trust

In handing data to a third-party, you are placing a degree of trust in them, not only in terms of security and reliability, but also in terms of the privacy and confidentiality of your data. The terms of service of most of the popular Cloud Storage providers, from Google to Dropbox, can be so vague as to defy any guarantee that anyone working within those companies will not implicitly have access to your files as they please. Whilst there’s never any question that “your content remains your content”, there are also significant concessions to allow the companies to look inside your files, with possible reasons for doing so ranging from serving targeted advertisements to preventing piracy.

One possible (if not necessarily practical) way around this is to encrypt the data yourself before sending it to the Cloud. Doing so will ensure no-one else will be able to access any data you send, but in doing so you forfeit some of the benefits of using Cloud Storage in the first place, such as the ability to view or collaborate on documents online.

fig0001

Box 4.3 Doing More with Files in the Cloud

It’s no coincidence that Cloud Storage services are starting to look more like social media services than the file browsers they originally emulated. For some, such as the photography-oriented Flickr, this is unsurprising, as sharing and giving feedback on each other’s submissions is a key part of the service; but even more traditional file management services like Microsoft OneDrive feature the ability to create photo albums that are abstracted from the file/folder hierarchy and can be shared with others.

Roll Your Own Cloud Storage

Somewhat ironically, there are several options to turn local storage into Cloud Storage. Western Digital’s “My Cloud”, for example, gives you the ability to access the contents of a local drive across the Internet, but without the subscription cost associated with Cloud Storage providers (and without the associated security and reliability benefits). Similarly, free software such as OwnCloud Server can be installed to your own web server to provide Cloud Storage that you control directly.

Cloud Storage Business Models

One of the unexpected side-effects of Cloud Storage was that people were willing to pay for it. In an era where even Internet behemoths like Facebook were struggling to create web-based services that people would pay real money to use, companies like Microsoft and Apple found that they could successfully create tiered plans for different levels of storage at different price points, and then create the services to help people fill them up, rather than the other way round.

Perhaps most notably, in 2013, Microsoft launched its Office 365 desktop software as part of a package that included 1 TB of Cloud Storage space, at a price point that directly competed with the ubiquitous Dropbox. Essentially, they matched Dropbox’s storage plan, and threw in their entire software suite with it. Similarly, in 2014, Apple launched its iCloud Photo Library service, a way to automatically store a user’s entire photo collection in the Cloud, with a similarly tiered price plan to Dropbox. Dropbox itself launched Carousel in 2014, a mobile app that would help you fill your Cloud Storage quota by automatically uploading your photos and videos, whilst providing the added benefit of freeing up space on your mobile device.

Password Protection

In 2014, there were reports of Cloud Storage service Dropbox having been hacked, with unauthorised people having been able to get access to several million accounts. A similar, albeit smaller-scale incident was reported later the same year with Apple’s iCloud service. The sad truth was that in both cases, access to the accounts in question was obtained indirectly, in one case by attempting to match a list of previously known email and password combinations from other sites, and in the other by exploiting known facts about the users in question to successfully reset their passwords. In both cases, these breaches could have been avoided entirely had the users signed up for two-factor authentication, which registers the account to a specific cellphone number in addition to the standard username and password.

Popular Cloud Storage Services

Dropbox (dropbox.com)

Cost: free (feature-limited), $100/year (Pro), $180/user/year (Business)

Availability: desktop, mobile, web

Capacity: 2 GB (Free), 1 TB (Pro), Unlimited (Business)

Security/Privacy: username/password, two-factor authentication, encrypted storage, remote wipe (Pro, Business)

Access: desktop sync folder, web portal, mobile apps, API

Management: files can be organised into folders and subfolders; individual files or entire folders can be shared with others, selectively synced to devices, deleted, copied, moved, renamed, and downloaded; versions of each file are tracked; photos and videos can be organised into “albums”; certain file types can be viewed directly

Undoubtedly one of the most popular Cloud Storage services, Dropbox has been around since 2007 and boasts 300 million users. Not only is it very simple to use, but it’s also extremely reliable for syncing files across a number of different platforms, and has a number of powerful features hidden away, such as fine-grained sharing settings, and integration with a large number of third-party applications.

Box (box.com)

Cost: free (Personal), $5/month (Starter), $15/user/year (Business)

Availability: desktop, mobile, web

Capacity: 10 GB, 250 MB/file (Free); 100 GB, 2 GB/file (Starter); Unlimited, 5 GB/file (Business)

Security/Privacy: username/password, two-factor authentication, encrypted storage

Access: desktop sync folder, web portal, mobile apps, API

Management: files can be organised into folders and subfolders; individual files or entire folders can be shared with others, selectively synced to desktop devices, deleted, copied, moved, renamed, and downloaded; versions of each file are tracked; certain file types can be viewed directly; collaborators can edit folder contents

Box is more targeted to businesses than individual users. As such there’s an emphasis on permission control and the ability to collaborate with others within folders. It features a robust search function and generally solid feature set.

Apple iCloud (icloud.com)

Cost: free–$20/month

Availability: desktop, mobile, web

Capacity: 5 GB (Free), 20 GB ($1/month), 200 GB ($4/month), 500 GB ($10/month), 1 TB ($20/month)

Security/Privacy: username/password, two-factor authentication, encrypted storage

Access: desktop sync folder, web portal, mobile apps

Management: files can be organised into folders and subfolders; individual files can be emailed to others, deleted, and downloaded; photos and videos can be organised into “albums” and shared with others; some file types can be viewed directly; some file types can be edited directly; built-in applications for storing notes, passwords, contacts, email, reminders, and calendars

Apple’s contribution to Cloud Storage gets better the more Apple products you connect to it. Though both Mac and Windows desktop computers are supported, on the mobile front, only Apple devices are supported. Although the service as a whole handles a number of different types of data elegantly, from notes to video, these work best with Apple’s own desktop software, and in fact its actual file storage system is rather lacklustre.

Google Drive (drive.google.com)

Cost: free–$300/month

Availability: desktop, mobile, web

Capacity: 15 GB (Free), 100 GB ($2/month), 1 TB ($10/month), 10 TB ($100/month), 20 TB ($200/month), 30 TB ($300/month)

Security/Privacy: username/password, two-factor authentication, encrypted storage

Access: desktop sync folder, web portal, mobile apps, API

Management: files can be organised into folders and subfolders; individual files or entire folders can be shared with others, selectively synced to devices, trashed, deleted, copied, moved, renamed, and downloaded; versions of each file are tracked; photos and videos can be organised into “albums”; some file types can be viewed directly; some file types can be edited directly; built-in applications for storing contacts, email, and calendars

Google’s offering provides much of the same functionality as iCloud, although it features access from a greater variety of devices and platforms, as well as a vastly superior interface for manipulating and sharing files. It also uses a trashcan metaphor, in that files that are deleted are not immediately removed from the storage, but instead go into a special folder from which they can be recovered later or permanently removed.

Amazon Cloud Drive (amazon.com/clouddrive)

Cost: $12/year (Unlimited Photos), $60/year (Unlimited Everything)

Availability: desktop, mobile, web

Capacity: photos + 5 GB (Unlimited Photos), unlimited (Unlimited Everything)

Security/Privacy: username/password, encrypted storage

Access: desktop upload, web portal

Management: files can be organised into folders and subfolders; individual files or entire folders can be trashed, deleted, copied, moved, renamed, and downloaded; photos and videos can be organised into “albums”; some file types can be viewed directly

Although Amazon’s Cloud Drive service offers excellent value for money in terms of its storage plans, its limited desktop integration means you have to specifically send individual files and folders to the service as opposed to the sync folder option that other services use. In terms of security it’s a bit of a slouch too, protected only via a login and password with no possibility to enable two-factor authentication. There’s also no possibility to share files with others.

Microsoft OneDrive (onedrive.live.com)

Cost: free–$4/month, $5/month–$20/month (Office 365)

Availability: desktop, mobile, web

Capacity: 15 GB (Free), 100 GB ($2/month), 200 GB ($4/month), 1 TB (Office 365)

Security/Privacy: username/password, two-factor authentication, encrypted storage

Access: desktop sync folder, web portal, mobile apps, API

Management: files can be organised into folders and subfolders; individual files or entire folders can be shared with others, selectively synced to devices, trashed, deleted, moved, renamed, and downloaded; versions of each file are tracked; photos and videos can be organised into “albums”; some file types can be viewed directly; some file types can be edited directly; built-in applications for storing notes, email, and calendars

Microsoft’s Cloud Storage service has a similar feature set as most of the other services, but specific features depend on which one of the 10 available plans you opt for. Compared to the other services which offer encrypted storage as standard, only the business or enterprise plans offer this feature on OneDrive. Perhaps the biggest selling point for the service is that the Office 365 plans bundle Microsoft’s Office suite of desktop, web, and mobile applications.

Amazon S3 (aws.amazon.com/s3)

Cost: based on usage

Availability: web

Capacity: unlimited

Security/Privacy: encryption key, encrypted storage

Access: web, API

Management: files can be organised into folders and subfolders; individual files or entire folders can be shared with others, deleted, moved, copied, renamed, and downloaded

Amazon S3 is designed to be used in conjunction with other software. It has a rudimentary web-based interface, but unless you plan on using it for a very small number of files (and very large files at that), you’ll find other options that have a much lower barrier to entry. If you intend to make use of its comprehensive API (or make use of some application that uses it), there’s a lot to like, and it can be cost-effective for a high volume of data. The service is priced for both storage and transfer of data, and the rates depend on the volume of data stored and transferred, meaning it can be difficult to determine exactly how much the service would cost to use. There are three tiers of storage pricing: “standard”, “reduced redundancy” (whereby the integrity of data is not assured in the long-term, but the cost is lower), and “glacier” (the cheapest option, but more suited to long-term archive, as retrieval can be comparatively slow).

Google Cloud Storage (cloud.google.com/storage)

Cost: based on usage

Availability: web

Capacity: unlimited

Security/Privacy: encryption key, encrypted storage

Access: web portal, API

Management: files can be organised into folders and subfolders; individual files can be shared with others, deleted, and downloaded

Similar in almost every respect to Amazon S3, but with a more comprehensible pricing structure, Google’s Cloud Storage is more for developers than end-users and features a similar three-tier pricing scheme (and charged separately for transfer and storage of data): “standard”, “durable reduced availability” (the integrity of data is assured, but the retrieval time is reduced), and “nearline” (for data that does not need to be retrieved quickly or often).

Flickr (flickr.com)

Cost: free (ad-supported), $50/year (ad-free)

Availability: mobile, web

Capacity: 1 TB, 200 MB per photo, video and photo files only

Security/Privacy: username/password, two-factor authentication, per-file privacy settings

Access: web portal, mobile apps, API

Management: individual images and videos can be edited, tagged with keywords, annotated, shared, downloaded, and organised into “albums”; individual albums can be organised into “collections”

Flickr is a bit of a standout compared to other Cloud Services, as it’s for videos and photos only. There’s a huge amount of metadata associated with each file, both from the camera (in the form of location and EXIF data) and from the site itself (in the form of annotation, comments, and usage rights). There’s an abundance of sharing options (including comprehensive permissions and the ability to send files to groups) and a full-featured web-based photo editor. Everything is automatically included in a “photostream” and located on a map where possible.

Bibliography

2014 Celebrity Photo Hack http://en.wikipedia.org/wiki/2014_celebrity_photo_hack

Amazon S3 FAQs http://aws.amazon.com/s3/faqs/

Cloud Storage Providers: Comparison of Features and Prices http://www.tomshardware.co.uk/cloud-storage-provider-comparison.review-33060.html

Dropbox Wasn’t Hacked https://blogs.dropbox.com/dropbox/2014/10/dropbox-wasnt-hacked/

iCloud Security and Privacy Overview https://support.apple.com/en-gb/HT202303

Is Google Drive Worse for Privacy Than iCloud, Skydrive, and Dropbox? http://www.theverge.com/2012/4/25/2973849/google-drive-terms-privacy-data-skydrive-dropbox-icloud

OwnCloud Server https://owncloud.org/

Some Home Truths about Storage, or Why Is Enterprise Storage So F-Ing Expensive? http://serverfault.com/a/2493/160124

Western Digital My Cloud http://www.wdc.com/en/products/products.aspx?id=1140

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset