Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph
Add to Watchlist
Video in TIB AV-Portal:
Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph
Formal Metadata
| Title |
Unified Cloud Storage with Synnefo + Ganeti + Archipelago + Ceph
|
| Title of Series | |
| Author |
|
| License |
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. |
| Identifiers |
|
| Publisher |
|
| Release Date |
2014
|
| Language |
English
|
Content Metadata
| Subject Area | |
| Abstract |
This talk presents Synnefo's evolution since FOSDEM '13, focusing on its integration with Ganeti, Archipelago, and Ceph to deliver a unified, scalable storage substrate for IaaS clouds. The talk will begin with an overview of the Synnefo architecture (Python, Django, Ganeti, and Xen or KVM). Then, it will introduce Archipelago, a software-defined, distributed storage layer that decouples Volume and File operations/logic from the underlying storage technology, used to store the actual data. Archipelago provides a unified way to provision, handle and present Files, Images, Volumes and Snapshots independently of the storage backend. We will focus on using Ceph/RADOS as a backend for Archipelago. With Archipelago and its integration with Synnefo and Ganeti one can: * maintain commonly-used data sets as snapshots and attach them as read-only disks or writeable clones in VMs running the application, * begin with a base OS image, bundle all application and supporting library code inside it, and upload it to the Archipelago backend in a syncing, Dropbox-like manner, * start a parallel HPC application in hundreds of VMs, thinly provisioned from this Image, * modify the I/O processing pipeline to enable aggressive client-side caching for improved number of IOPS, * create point-in-time snapshots of running VM disks, * share snapshots with other users, with fine-grained Access Control Lists, * and sync them back to their PC for further processing. The talk will include a live demonstration of a workflow including this functionality in the context of a large-scale public cloud. The intended audience spans from enterprise users comparing cloud platforms, to developers who wish to discover a different design approach to IaaS clouds and storage virtualization. Please see the abstract above for a rough sketch of the proposed presentation. The presentation will mostly consist of live demonstration and a small deck of slides, meant to describe the main features of Archipelago and its integration with Synnefo, as well as provoke discussion in the Q&A session. The main workflow in the demonstration will be [copied and pasted from the Abstract]: * begin with a base OS image, bundle all application and supporting library code inside it, and upload it to the Archipelago backend in a syncing, Dropbox-like manner, * start a parallel HPC application in hundreds of VMs, thinly provisioned from this Image, * modify the I/O processing pipeline to enable aggressive client-side caching for improved number of IOPS, * create point-in-time snapshots of running VM disks, * share snapshots with other users, with fine-grained Access Control Lists, * and sync them back to their PC for further processing
|
00:00
Meeting/Interview
Multiplication sign
Physical law
Right angle
Data structure
Resultant
Form (programming)
00:59
Computer animation
Personal digital assistant
Videoconferencing
01:58
Computer animation
Reduction of order
Shape (magazine)
Mereology
02:30
Computer animation
View (database)
Parameter (computer programming)
03:26
Slide rule
Computer animation
INTEGRAL
Multiplication sign
Physical law
04:45
Computer animation
Computer configuration
Multiplication sign
Social class
06:09
Computer animation
Resultant
07:32
Computer animation
Information
Physical law
Shared memory
Similarity (geometry)
Video game
Bit
Summierbarkeit
09:00
Computer animation
09:54
Computer animation
Lecture/Conference
Resultant
10:36
Computer animation
Weight
11:04
Computer animation
12:13
Computer animation
12:56
Frequency
Theory of relativity
Computer animation
Video game
Quicksort
Theory
14:07
Computer animation
Weight
Right angle
Mereology
15:31
Mathematics
Computer animation
16:29
Word
Computer animation
Theory
17:26
Computer animation
Video game
18:07
Computer animation
Workstation <Musikinstrument>
Video game
Social class
19:19
Computer animation
Multiplication sign
Field (computer science)
19:52
Computer animation
20:41
Computer animation
Insertion loss
21:09
Computer animation
Insertion loss
21:42
Computer animation
Source code
22:36
Computer animation
Personal digital assistant
23:27
Computer animation
23:59
Computer animation
Multiplication sign
Right angle
24:30
Computer animation
Variance
25:32
Computer animation
Social class
26:12
Computer animation
Bit
Quicksort
Metropolitan area network
26:40
Dataflow
Cellular automaton
Multiplication sign
1 (number)
Bit
Evolute
Machine vision
Computer animation
Universe (mathematics)
Authorization
Video game
Right angle
Resultant
Physical system
Form (programming)
31:38
Computer animation
32:13
Area
Theory of relativity
State of matter
Set (mathematics)
Insertion loss
Median
Heat transfer
Mereology
Computer animation
Universe (mathematics)
Summierbarkeit
Right angle
Form (programming)
00:00
checks that the solution is to use these things so it's in the form of this and yet so problem results
00:18
the use of these laws to review so you go through the the the the the the the opportunity and if you were so you can have a kind of knowledge right and over the years and years later OK so this morning the I the structure of the and use a lot of time in the world in
01:01
the end of the story of the but you know that I don't want to be the case the in the video the the the the the the the 1st
01:22
of which is 1 of the things I said the a lot of the of the of the of the of the people of the and that the ways of the the the the the the the the the the of the of the of the of the of the in the end of the world you know work on
02:01
the shape of the quality of its kind in the history of the last part of the the name of the reduction in the of the of the of the patient sees Dean of the highway from
02:25
the and the and the the the the the
02:32
view of the of the of the of the
02:40
of the of the of the people and you know what you think is the going the so
02:52
can the for the want of the what do I have to use as you to use where was the end of the key things in each thing but that's the of the parameters in the billions of years old you and the the long the in the same
03:30
thing is that you we will see that the time that the I'm going to have a the of the user the the cost so the work and and it was in
03:56
the world that also the integration of the the that is a parody of most of the the the the the the the and of the law of the that of the title of a the the the the the the the world of the slide you use a lot of what we really want to be told that in the in the in the
04:48
light of the class of the in the I'm going the use so that is the background you have the of the Our over the in the use of user we use the fact that the exposing was I think you wrote the book on the you have you have you can the the it is needed title of year the world drawback was against the of
05:45
the option not to use the 1 thing that this the the and the good thing is that in the end I think that the use of a so it can be a very good time
06:10
and so the whole of the of the of the of the world as and we know this is the and so
06:34
that is the name the following so that the size you did that all you and the and then that is what we see did what do you do about it and I want you to the we the very and the only way that is the result is that if you have a lot of the end of the year you because I really don't the of the and we thank you for your
07:37
data you again these are the use of this information to the user to the environments as and the reality of the in the the side of the way to so on the thing that the the use and you use the similarity the the the the the where the law that would you should know that your own that share of each of the using the exact same thing that we do this is a little bit about use of along the way so that you
08:42
can use the use of violence is using the 2 so I have to be in the but all of the his life is long and the sum of the 2
09:02
we can think of the data the In the following I the
09:13
the you some was
09:19
being you can be to that the will that the last this is not at the end of the world and I will see you know what you I think it's the same as that of story the but this work going the the
09:58
the 1st is this so what do the results
10:11
the in
10:20
the this the the the the the the the high holy kind the
10:36
because weight the the
10:49
at the end of the the long
10:58
and the but it's and
11:09
so the this during
11:23
the have the the just of world and the 1st thing you of the the and the and and the and the if you of
12:14
the but what is going on in the the in the the the the and the
12:53
In the name of that you don't have to
12:59
know the
13:03
and
13:06
then and is the the the the the the relation the end of the day in the life of the so I said that I want the the the the the theory that the war was over the period of the most that is the the of the the of yeah was not right the sort of we have babies and so on all we have to use the
14:10
waiting the we will also explore the the thing all weights and so in is the right this the talking about here and then we really vision or of the and I said that a lot of is the the
14:47
you know that was all the things this is the thing that you can the you the we have shown the of of and not because of the the the the the the the part of the they you should have all of the whole European
15:33
Union integrated out there and the of the the world moreover these are
15:53
being made by the journal of the and United that you the last thing you but it follows that the end of the and then quietly there's the the so that you use the changes in the the like by this in the light of the what we
16:32
can use all the requirements for the rest of the
16:45
so what would be the
16:49
and the and then the
16:58
the the and the that you have to make is some of the best and we know that we the what it was yeah these all the theory so using that we hear the word in the most
17:27
of the that have the greatest during the day and it is the goal of my life in a in a so what is it that I would to that and then I was looking at the bones and I think you might be in the the the this you might was
18:04
as well I want to explore
18:09
the classes stations for what it was it's just that what usually called the look when I was a little which is all of side these the the the the the at the end of the year and this
18:43
year and this is the of the the I ask what in the world of the gage will show a lot of and they little in exchange the and the what people with hearing the largest life if you left it out to them the only thing is that in a way that it was only
19:23
so in the field the is not because on 1 hand
19:38
and so on all of these things that's not the we also for the time we
19:56
cannot this is actually my love knowledge the use of we to agree on the the
20:13
last 2 years because here so I but will in the in the in the onset of some of these well the
20:41
and all of these are and that's not the loss both of the and it was
20:54
in the sense of at
21:02
the on the other hand there the last of the I don't know if
21:11
you use of loss the and this has the
21:23
thank you on the other hand these the of of all
21:36
on is that it all
21:47
right so I would be know the that is the demand of it right so we did not know that they could at the and again and the world now to find the name of the the you know a lot of the source the
22:25
the would you like the of the goal is in have a less is all these
22:40
quantities by the all the other things that made In the case of the about the using the and try to do this the other thing is you should work with the end we want the
23:13
United States and so that the problem lies in the i the thank you for the at the end of
23:29
the island and it can be a good this is not all of this is that you know that the schools in the year and that was this you just think about what you want to by the this is 1
23:58
the is the
24:03
the we know that you have the right not just going to we arrive at the time the goal of the but the it was the lot the
24:23
the sensory so what would you have the goal of
24:34
the new year the if you think about the or you you have a the the the the the
24:57
the the I I would like to know about the is want the the the only thing that is the variance of the we do so think that we know that there are people in I
25:33
would have been alive in the face of the other class and the the the the the more the way of I think in the that that it is the that's the kind of thing in the morning and I was would last 2 the
26:12
a little bit of the user of the walls for a while
26:22
and that man the I will also the that is this is the sort of very different I want to this I'm sure there we the
26:46
the but the do the evolution of the
26:56
past of the the the end of the is that the the what is that that's the thing that is in the well and it was not and said that the time and it was a little bit of it a the usually you have in the cell maybe you this the end of and you know of the think about the babies right this was like these in a way that I think is the show you so we do have have the right to life the results of the I think that actually so this is this is this is going to be looking at the only thing you yeah and the right of the of the of the of what should this the of the rest of the and the all that was the vision of the resources and the use of the fact that you have to look at the system which was the the university and thinking of you the this is the so the flow of the the the the the the the ways that we have that and we will see that there is a long time of the of the of the of the of the of the of the of the letter he explores the fire then you think this is all of the the I the the but the thing that in the middle of the of the whole thing about the is going to be used the thank you the the things you think of it and so that you can do this by this but this is the this is the 1st time of the show you want the the ones in here this is the I was it the the authors this the and you we have allowed the this is the time for the last 2 the world and this in the form of a bit of a the the the the people and the use of and in the
31:41
end of the and a of so we the end of the that's the kind the this back I think that the all of those things that was the end of the day of the year so the lack of these
32:12
the to the
32:26
and the it is there the the the the the what is the relation in which
32:49
you need to get that in this half of the rest of the sometimes that's what we do in the you know part of the of year the originally had very but then we have to think of the age the fear of going this is very much like the loss about it so that of In the area 1 thing last region a and B the the transfer of users and so that people like you the the there this what we're seeing the world in a lot of the the set of all this but in the the you set up by the you must use the the the the the the the because they're not react to that now we use the that's the way it is not the In the end of the the the we provide to that is in the we provide you with the the size of the universe the median relies on the use of the state of the art in the last right at the end of the title of the book the 2nd 1 here but and they also the against the the the wire of the form and the other the the end of the we provide the in the in the in the log of the sum of the parts of the theft
