At Cloudware, we offer Cloud infrastructure as a service that provides reliable, high-performance and flexible virtual servers, accessible and manageable over the Internet. As a part of a specialized cloud platform Cloudware combines powerful technology, intuitive software and world-class services built for any business scenario, especially high-potential, high-risk workloads.
We cover the technical details so that you put focus on the strategic initiatives that matter most to your organization.
All main operations at Coudware are fully automated and get completed in a very short time. Reduce the time needed to start or expand your business – Cloudware saves days, weeks and months.
Manage your systems anywhere in the world via all internet connected devices – smartphone, laptop, tablet. Eucalyptus is an open source cloud platform that enables organisations to create private clouds inside their data centres using existing virtualised infrastructure.
Eucalyptus enables IT organisations to build Amazon Web Services (AWS)-compatible private clouds that can pool together existing virtualised IT resources and provide them to its customers in a flexible, on-demand, pay-as-you-go basis. Cloud controller (CLC): The cloud controller is essentially a Web-based interface between Eucalyptus and the outside world. Walrus: Walrus provides persistent storage capabilities to all of the virtual machines in the Eucalyptus cloud.
Cluster controller (CC): A typical Eucalyptus cloud set-up can comprise multiple nodes, which are actually hypervisors on which virtual machines are provisioned. Storage controller (SC): The storage controller provides persistent block-level storage for virtual machines that are launched within a Eucalyptus cloud. Node controller (NC): Node controllers or nodes are hypervisor-based virtualised servers that host virtual machines which are provisioned by the Eucalyptus cloud.
Auto-scaling: Mirrored on the concept of auto-scaling by AWS, Eucalyptus too provides similar APIs that help cloud administrators set rules and policies that enable applications running on virtual machines to scale-up and scale-down dynamically, based on fluctuating workloads.
Elastic load balancing: This is basically a service that provides better availability and scalability for applications running atop the Eucalyptus cloud.
CloudWatch: This provides monitoring for virtual machines and applications hosted on the Eucalyptus cloud.
Resource tagging: This allows users and cloud administrators to assign meaningful metadata to cloud resources.
Maintenance mode: This feature enables cloud administrators to perform maintenance activities on the Eucalyptus cloud without any potential downtime. In this guide, let’s set up a simple Eucalyptus cloud on a set of two machines, one acting as the management server containing the cloud controller, Walrus, the cluster controller and the storage controller, and the other as the node controller running atop a KVM hypervisor. Note: It is recommended that you install the node controllers first so that it becomes easier to add them to the cloud controller once they are all up and ready. Note: Follow the above mentioned steps for each of the node controllers that you wish to use for your cloud. 1)     Create a security group: A security group is similar to a firewall that protects your instance against network-related attacks. Once your group is created, open the necessary ports such as SSH port 22 to obtain access to the instance. 2)    Create a key pair: A key pair acts as an authentication token between the users and their instances.
3)     Launch the instance: An instance is launched from a machine image (in this case, EMI). The backblaze pod is essentially a stripped down 4U storage server with internal space for 45 internal disk drives (and a single OS disk). Anyone familiar with the cost of 100TB+ storage arrays from Tier 1 or Tier 2 storage vendors will realize what a shockingly low price this is.
This section is meant to be tongue-in-cheek since it should be clear by now that we have actually gone out and built one of these things (and had a blast doing it, pictures to follow …). An HPC vendor who has been called in more than once to clean up after backblaze-related disasters. The backblaze storage pod was designed for a very specific use case that is not a great fit for more generic usage. Short answer: They solve all reliability, availability and operational concerns by operating a bunch of pods simultaneously with a proprietary cloud software layer that handles data movement and multi-pod data replication.


In our next few blog posts we’ll talk about why we DID decide to build one of these pods and what our experiences were. So far our client is very happy with it and it’s been online and operating for a while now. I’ve seen SAN storage controllers breaking, so if here a main board cracks thats the same to me. Its not the same hardware level but i agree with your comment about off the shelf hardware versus proprietary. 2) Generel error handling — hard drives vary a lot in the their firmware and the way they process errors. Jacob – the design of the backblaze pod includes vibration rubber footings to help handle the vibration of the drives.
The fundamental failing of the Backblaze for vibration reduction (and almost all other JBOD chassis for that matter) is the lineup of the drives.
Other things of note – this is really meant to be filled up with disks upon building.
Overall this is a great project if, as others have stated, you have the right use case for it. We offer cloud storage service to our customer using a modified version of the pods and it’s been working very well for us so far. The system uses a single disk for hosting the operating system : True the original concept was designed with a single HD for the OS. The system requires 2 power supplies to operate, both must be active and there is no redundancy, spare or failover unit : Yes, there is room for two power supplies in the pod.
If you build this yourself totally DIY you will be required to create custom wiring harnesses : Yes. Any monitoring or health status reporting tools will have to be built, installed and configured by hand : We developed that within a month.
Ok so if you build two of these boxes and then sign up for the backblaze I have a feeling I would be fairly safe – or ? Our servers are highly configurable and designed for rapid implementation with reduced system downtime and risk. Add more servers quickly and easily, whenever you need or remove some of them when you don’t need. Learn about the Eucalyptus private cloud platform and then go on to install, configure and work with it. It provides cloud administrators an interface with which they can configure and manage the cloud’s underlying compute, storage and network resources. It is basically a large storage container where users can upload data from any file type using simple HTTP put-get queries. These nodes can be collectively grouped and managed by using the cluster controller, which primarily looks after the inter-node communications and Service Level Agreements (SLAs) of each cluster.
The SC interfaces with a wide variety of storage systems including local file systems, NFS, SAN and even iSCSI. Eucalyptus additionally provides an optional add-in component that even supports VMware ESXi hypervisor as a node, called a VMware broker. It automatically senses and distributes incoming application traffic and service calls across multiple running instances, thus improving the performance and uptime of the application. Using CloudWatch, users can programmatically track, collect and analyse metrics, set alarms to troubleshoot performance issues and take automated action as well, based on the state of the cloud environment.
This helps in tracking, as well as eases management and monitoring of specific resource collections used across the cloud. This helps make sure that the applications hosted on the cloud are always running and that they meet the required SLA levels as well. In this scenario, we are using two simple desktop machines, each equipped with 4 GB RAM, a 500 GB hard drive and a VT-enabled (Virtualisation Technology) processor on-board. The first way is to download the required RPMs onto your machine, install each of them and then manually configure the cloud as per your needs. A few scripts run automatically at this time to set the node controller’s networking configurations. Once the cloud controller reboots, it will start executing a lot of configuration scripts that will set Walrus, the cluster controller and the storage controller with a few default parameters.


You need to note down the instance IP address either from the terminal or by using the Eucalyptus cloud user console. An important benefit of Cloud Server is that you can access what you need and when you need, provides you full flexibility to work. Even at $12,000 for 135TB the cost is low enough that the system deserves (and has gained) significant attention from the community. You also need to mount this unit on extremely heavy-duty rack rails OR put it on a shelf and leave about 12 inches of top clearance free if you want to easily be able to pop the top cover off to get at the drives. It carries a far higher operational and administrative burden than storage arrays traditionally sold into the enterprise. My main goal with this blog post is to ensure that readers considering this approach are fully aware of the potential risks. To them, a storage pod is a single FRU (field replaceable unit) and they don’t really need to spend significant amount of time and attention on any single pod. Via their custom software and use of many pods at once Backblaze has built an infrastructure that requires very little effort in the datacenter. If you are considering trying something like this it is essential to do your own research and due diligence.
There’s a reason why Nexsan has been doing that in their big drawers for more than a decade. We just built one of these (by built I mean bought from Protocase and filled it with drives) because the cost of enterprise SAN storage is ridiculous. One thing to note about Openfiler though is that the Intel e1000e NIC drivers included with the rPath Linux install need to be upgraded or they simply won’t work.
Reading your article to the very end (even if it’s not complete yet), you seem to realize that it works as advertised. It also handles high-level user authentication, quota management along with a few basic accounting and reporting mechanisms. The second way is much faster and will get your Eucalyptus cloud up and running in a matter of minutes. These public IPs will be mapped to individual Eucalyptus instances (virtual machines) once they are launched in the cloud.
Backblaze says their hardware costs are a little over $7,000 for this configuration but as we will show in a future post this is not exactly realistic for others who wish to follow in their footsteps.
For comparison the cost to build 4 of these filled with drives is still less than the chassis alone with some other vendors (not named on purpose) before you even get into drives and licensing. Also as mentioned you will probably want to add another NIC in the chassis for link aggregation or at the very least to separate management from storage interfaces. In business production I would want at least redundant power supplies and accessible drive bays. I can’t tell my users that their data will be offline until I can get the replacement drives in and do a restore. We’ve done the same exercise as you guys and not only found that it works but it is a viable solution.
One is enough to power 45 green HDs if you tweak the power up sequence (a little electrical engineering required). However, you can follow the same steps even if you have more machines with better compute capacity between them. As a low-volume customer, our actual cost for building a single 135TB pod was roughly $12,000 USD. Backblaze does not have to dink around trying to debug single-drive failures within individual pods. They have 3x spare drives sitting on a shelf and I believe they have an order out for a spare power supply as well. This is primarily a CentOS-based ISO with all the necessary Eucalyptus components embedded in it. A self-explanatory wizard guides you through the install process and sets up your Eucalyptus cloud for you.



Ensuring the data integrity in cloud data storage wars
Free cloud sync services download
Google cloud print for windows 7 gratis


Comments

  1. 27.02.2014 at 10:25:28


    Which it does well - with additional storage with.

    Author: mambo
  2. 27.02.2014 at 17:12:45


    Drive service - an online storage site that competes with store, back up and share documents quickly.

    Author: Roni_013
  3. 27.02.2014 at 14:20:22


    Have given consumers a cause for that are not required.

    Author: Sheyla
  4. 27.02.2014 at 15:33:28


    Version stored in the cloud small print.

    Author: fghfg
  5. 27.02.2014 at 15:29:42


    Until the end of January 2016 to opt-in 15GB camera roll.

    Author: INSPEKTOR