Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph

Video thumbnail (Frame 0) Video thumbnail (Frame 1486) Video thumbnail (Frame 2959) Video thumbnail (Frame 3762) Video thumbnail (Frame 5150) Video thumbnail (Frame 7130) Video thumbnail (Frame 8594) Video thumbnail (Frame 9841) Video thumbnail (Frame 11307) Video thumbnail (Frame 13031) Video thumbnail (Frame 13877) Video thumbnail (Frame 14853) Video thumbnail (Frame 15902) Video thumbnail (Frame 16601) Video thumbnail (Frame 18324) Video thumbnail (Frame 19273) Video thumbnail (Frame 21171) Video thumbnail (Frame 22173) Video thumbnail (Frame 23269) Video thumbnail (Frame 24733) Video thumbnail (Frame 26141) Video thumbnail (Frame 27080) Video thumbnail (Frame 28039) Video thumbnail (Frame 28968) Video thumbnail (Frame 29790) Video thumbnail (Frame 31023) Video thumbnail (Frame 31729) Video thumbnail (Frame 32539) Video thumbnail (Frame 33594) Video thumbnail (Frame 34731) Video thumbnail (Frame 35823) Video thumbnail (Frame 36541) Video thumbnail (Frame 37383) Video thumbnail (Frame 38294) Video thumbnail (Frame 39232) Video thumbnail (Frame 39992) Video thumbnail (Frame 47443) Video thumbnail (Frame 48219) Video thumbnail (Frame 49153)
Video in TIB AV-Portal: Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph

Formal Metadata

Title
Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph
Title of Series
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
2014
Language
English

Content Metadata

Subject Area
Abstract
This talk presents Synnefo's evolution since FOSDEM '13, focusing on its integration with Ganeti, Archipelago, and Ceph to deliver a unified, scalable storage substrate for IaaS clouds. The talk will begin with an overview of the Synnefo architecture (Python, Django, Ganeti, and Xen or KVM). Then, it will introduce Archipelago, a software-defined, distributed storage layer that decouples Volume and File operations/logic from the underlying storage technology, used to store the actual data. Archipelago provides a unified way to provision, handle and present Files, Images, Volumes and Snapshots independently of the storage backend. We will focus on using Ceph/RADOS as a backend for Archipelago. With Archipelago and its integration with Synnefo and Ganeti one can: * maintain commonly-used data sets as snapshots and attach them as read-only disks or writeable clones in VMs running the application, * begin with a base OS image, bundle all application and supporting library code inside it, and upload it to the Archipelago backend in a syncing, Dropbox-like manner, * start a parallel HPC application in hundreds of VMs, thinly provisioned from this Image, * modify the I/O processing pipeline to enable aggressive client-side caching for improved number of IOPS, * create point-in-time snapshots of running VM disks, * share snapshots with other users, with fine-grained Access Control Lists, * and sync them back to their PC for further processing. The talk will include a live demonstration of a workflow including this functionality in the context of a large-scale public cloud. The intended audience spans from enterprise users comparing cloud platforms, to developers who wish to discover a different design approach to IaaS clouds and storage virtualization. Please see the abstract above for a rough sketch of the proposed presentation. The presentation will mostly consist of live demonstration and a small deck of slides, meant to describe the main features of Archipelago and its integration with Synnefo, as well as provoke discussion in the Q&A session. The main workflow in the demonstration will be [copied and pasted from the Abstract]: * begin with a base OS image, bundle all application and supporting library code inside it, and upload it to the Archipelago backend in a syncing, Dropbox-like manner, * start a parallel HPC application in hundreds of VMs, thinly provisioned from this Image, * modify the I/O processing pipeline to enable aggressive client-side caching for improved number of IOPS, * create point-in-time snapshots of running VM disks, * share snapshots with other users, with fine-grained Access Control Lists, * and sync them back to their PC for further processing
Meeting/Interview Multiplication sign Physical law Right angle Data structure Resultant Form (programming)
Computer animation Personal digital assistant Videoconferencing
Computer animation Reduction of order Shape (magazine) Mereology
Computer animation View (database) Parameter (computer programming)
Slide rule Computer animation INTEGRAL Multiplication sign Physical law
Computer animation Computer configuration Multiplication sign Social class
Computer animation Resultant
Computer animation Information Physical law Shared memory Similarity (geometry) Video game Bit Summierbarkeit
Computer animation
Computer animation Lecture/Conference Resultant
Computer animation Weight
Computer animation
Computer animation
Frequency Theory of relativity Computer animation Video game Quicksort Theory
Computer animation Weight Right angle Mereology
Mathematics Computer animation
Word Computer animation Theory
Computer animation Video game
Computer animation Workstation <Musikinstrument> Video game Social class
Computer animation Multiplication sign Field (computer science)
Computer animation
Computer animation Insertion loss
Computer animation Insertion loss
Computer animation Source code
Computer animation Personal digital assistant
Computer animation
Computer animation Multiplication sign Right angle
Computer animation Variance
Computer animation Social class
Computer animation Bit Quicksort Metropolitan area network
Dataflow Cellular automaton Multiplication sign 1 (number) Bit Evolute Machine vision Computer animation Universe (mathematics) Authorization Video game Right angle Resultant Physical system Form (programming)
Computer animation
Area Theory of relativity State of matter Set (mathematics) Insertion loss Median Heat transfer Mereology Computer animation Universe (mathematics) Summierbarkeit Right angle Form (programming)
checks that the solution is to use these things so it's in the form of this and yet so problem results
the use of these laws to review so you go through the the the the the the the opportunity and if you were so you can have a kind of knowledge right and over the years and years later OK so this morning the I the structure of the and use a lot of time in the world in
the end of the story of the but you know that I don't want to be the case the in the video the the the the the the the 1st
of which is 1 of the things I said the a lot of the of the of the of the of the people of the and that the ways of the the the the the the the the the the of the of the of the of the of the in the end of the world you know work on
the shape of the quality of its kind in the history of the last part of the the name of the reduction in the of the of the of the patient sees Dean of the highway from
the and the and the the the the the
view of the of the of the of the
of the of the of the people and you know what you think is the going the so
can the for the want of the what do I have to use as you to use where was the end of the key things in each thing but that's the of the parameters in the billions of years old you and the the long the in the same
thing is that you we will see that the time that the I'm going to have a the of the user the the cost so the work and and it was in
the world that also the integration of the the that is a parody of most of the the the the the the the and of the law of the that of the title of a the the the the the the the world of the slide you use a lot of what we really want to be told that in the in the in the
light of the class of the in the I'm going the use so that is the background you have the of the Our over the in the use of user we use the fact that the exposing was I think you wrote the book on the you have you have you can the the it is needed title of year the world drawback was against the of
the option not to use the 1 thing that this the the and the good thing is that in the end I think that the use of a so it can be a very good time
and so the whole of the of the of the of the world as and we know this is the and so
that is the name the following so that the size you did that all you and the and then that is what we see did what do you do about it and I want you to the we the very and the only way that is the result is that if you have a lot of the end of the year you because I really don't the of the and we thank you for your
data you again these are the use of this information to the user to the environments as and the reality of the in the the side of the way to so on the thing that the the use and you use the similarity the the the the the where the law that would you should know that your own that share of each of the using the exact same thing that we do this is a little bit about use of along the way so that you
can use the use of violence is using the 2 so I have to be in the but all of the his life is long and the sum of the 2
we can think of the data the In the following I the
the you some was
being you can be to that the will that the last this is not at the end of the world and I will see you know what you I think it's the same as that of story the but this work going the the
the 1st is this so what do the results
the in
the this the the the the the the the high holy kind the
because weight the the
at the end of the the long
and the but it's and
so the this during
the have the the just of world and the 1st thing you of the the and the and and the and the if you of
the but what is going on in the the in the the the the and the
In the name of that you don't have to
know the
and
then and is the the the the the the relation the end of the day in the life of the so I said that I want the the the the the theory that the war was over the period of the most that is the the of the the of yeah was not right the sort of we have babies and so on all we have to use the
waiting the we will also explore the the thing all weights and so in is the right this the talking about here and then we really vision or of the and I said that a lot of is the the
you know that was all the things this is the thing that you can the you the we have shown the of of and not because of the the the the the the the part of the they you should have all of the whole European
Union integrated out there and the of the the world moreover these are
being made by the journal of the and United that you the last thing you but it follows that the end of the and then quietly there's the the so that you use the changes in the the like by this in the light of the what we
can use all the requirements for the rest of the
so what would be the
and the and then the
the the and the that you have to make is some of the best and we know that we the what it was yeah these all the theory so using that we hear the word in the most
of the that have the greatest during the day and it is the goal of my life in a in a so what is it that I would to that and then I was looking at the bones and I think you might be in the the the this you might was
as well I want to explore
the classes stations for what it was it's just that what usually called the look when I was a little which is all of side these the the the the the at the end of the year and this
year and this is the of the the I ask what in the world of the gage will show a lot of and they little in exchange the and the what people with hearing the largest life if you left it out to them the only thing is that in a way that it was only
so in the field the is not because on 1 hand
and so on all of these things that's not the we also for the time we
cannot this is actually my love knowledge the use of we to agree on the the
last 2 years because here so I but will in the in the in the onset of some of these well the
and all of these are and that's not the loss both of the and it was
in the sense of at
the on the other hand there the last of the I don't know if
you use of loss the and this has the
thank you on the other hand these the of of all
on is that it all
right so I would be know the that is the demand of it right so we did not know that they could at the and again and the world now to find the name of the the you know a lot of the source the
the would you like the of the goal is in have a less is all these
quantities by the all the other things that made In the case of the about the using the and try to do this the other thing is you should work with the end we want the
United States and so that the problem lies in the i the thank you for the at the end of
the island and it can be a good this is not all of this is that you know that the schools in the year and that was this you just think about what you want to by the this is 1
the is the
the we know that you have the right not just going to we arrive at the time the goal of the but the it was the lot the
the sensory so what would you have the goal of
the new year the if you think about the or you you have a the the the the the
the the I I would like to know about the is want the the the only thing that is the variance of the we do so think that we know that there are people in I
would have been alive in the face of the other class and the the the the the more the way of I think in the that that it is the that's the kind of thing in the morning and I was would last 2 the
a little bit of the user of the walls for a while
and that man the I will also the that is this is the sort of very different I want to this I'm sure there we the
the but the do the evolution of the
past of the the the end of the is that the the what is that that's the thing that is in the well and it was not and said that the time and it was a little bit of it a the usually you have in the cell maybe you this the end of and you know of the think about the babies right this was like these in a way that I think is the show you so we do have have the right to life the results of the I think that actually so this is this is this is going to be looking at the only thing you yeah and the right of the of the of the of what should this the of the rest of the and the all that was the vision of the resources and the use of the fact that you have to look at the system which was the the university and thinking of you the this is the so the flow of the the the the the the the ways that we have that and we will see that there is a long time of the of the of the of the of the of the of the of the letter he explores the fire then you think this is all of the the I the the but the thing that in the middle of the of the whole thing about the is going to be used the thank you the the things you think of it and so that you can do this by this but this is the this is the 1st time of the show you want the the ones in here this is the I was it the the authors this the and you we have allowed the this is the time for the last 2 the world and this in the form of a bit of a the the the the people and the use of and in the
end of the and a of so we the end of the that's the kind the this back I think that the all of those things that was the end of the day of the year so the lack of these
the to the
and the it is there the the the the the what is the relation in which
you need to get that in this half of the rest of the sometimes that's what we do in the you know part of the of year the originally had very but then we have to think of the age the fear of going this is very much like the loss about it so that of In the area 1 thing last region a and B the the transfer of users and so that people like you the the there this what we're seeing the world in a lot of the the set of all this but in the the you set up by the you must use the the the the the the the because they're not react to that now we use the that's the way it is not the In the end of the the the we provide to that is in the we provide you with the the size of the universe the median relies on the use of the state of the art in the last right at the end of the title of the book the 2nd 1 here but and they also the against the the the wire of the form and the other the the end of the we provide the in the in the in the log of the sum of the parts of the theft
Feedback