RestFS: the Next Generation Cloud Storage
Formal Metadata
Title |
RestFS: the Next Generation Cloud Storage
|
Title of Series | |
Author |
|
License |
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. |
Identifiers |
|
Publisher |
|
Release Date |
2014
|
Language |
English
|
Content Metadata
Subject Area | |
Abstract |
RestFS is an experimental project to develop an open-source distributed filesystem for large environments. It is designed to scale up from a single server to thousand of nodes and delivering a high-availability storage system with special features for high i/o performance and network optimisation for work better in WAN environment. The Project is on the beginning stage, with some technology previews released. The Restfs is pure-python, but several of the libraries that it depends upon use C extensions (sometimes for speed, sometimes to interface to pre-existing C libraries). The main characteristics of the RestFS are : * Scalability, no limits on storage and clients size * High availability, no single point of failure and data replication * Adaptive, load balancing and uniform distribution * High Performance, parallel transfer, local cache consistency , data transfer by difference * Flexible, S3 compatibility interface, dedicated library for integration in web server and application layer This talk describes the architecture, internals of RestFS and comparison among different free software solutions. The session will discuss our experience in this development and detailed information on performance and scalability
|

00:00
Computer animation
Multiplication sign
Moment (mathematics)
Mereology
00:33
Computer animation
Number
00:57
Computer animation
Video game
Software testing
01:25
Trail
Computer animation
Telecommunication
Multiplication sign
Video game
Cycle (graph theory)
Streaming media
Mereology
02:05
Multiplication sign
Set (mathematics)
Mereology
System call
Element (mathematics)
Fraction (mathematics)
Computer animation
Software
Telecommunication
Object (grammar)
Data structure
Associative property
Information security
Physical system
04:04
Category of being
Server (computing)
Word
Greatest element
Computer animation
Information
Different (Kate Ryan album)
Electronic mailing list
Data storage device
Right angle
Client (computing)
Object (grammar)
06:29
Slide rule
Dialect
Focus (optics)
Connectivity (graph theory)
View (database)
Sheaf (mathematics)
Sound effect
Line (geometry)
Mereology
Disk read-and-write head
Arithmetic mean
Computer animation
Internet forum
Logic
Video game
Right angle
Data structure
Quicksort
Resultant
09:17
Arithmetic mean
Computer animation
Multiplication sign
Video game
Mereology
10:46
Graph (mathematics)
Computer animation
Execution unit
Line (geometry)
11:22
Slide rule
Serial port
Block (periodic table)
Multiplication sign
Insertion loss
Theory
Fraction (mathematics)
Revision control
Category of being
Computer animation
Different (Kate Ryan album)
Natural number
Right angle
Series (mathematics)
Object (grammar)
Position operator
Identity management
13:54
Computer animation
Object (grammar)
14:42
Revision control
Computer animation
Personal digital assistant
Summierbarkeit
Variable (mathematics)
Disk read-and-write head
15:18
Category of being
Computer animation
Personal digital assistant
Thermal radiation
Mereology
Information security
Rule of inference
Physical system
16:28
Category of being
Mathematics
Computer animation
Block (periodic table)
Software testing
Disk read-and-write head
17:15
Graph (mathematics)
Multiplication sign
Plotter
Forcing (mathematics)
Graph (mathematics)
Data storage device
Archaeological field survey
Set (mathematics)
Mereology
Revision control
Arithmetic mean
Radius
Computer animation
Natural number
Right angle
Endliche Modelltheorie
19:30
Computer animation
Information
Physical law
Data storage device
Sound effect
Right angle
Machine vision
Number
21:19
Computer animation
Moment (mathematics)
Summierbarkeit
Mereology
22:00
Distribution (mathematics)
Block (periodic table)
State of matter
Different (Kate Ryan album)
View (database)
Multiplication sign
Website
Right angle
Iteration
Number
Social class
00:00
the In that many of the 2nd part of the concept of mind and executive that and of but the book on the wall with
00:19
started here at the moment when you have a lot of the time of the wanted to the work in the but the
00:34
problem that is where you come up with and that is the number of people in a car and I think about this in lab to prove this thing on this week so that we know that the of you for this reason the topic
00:54
of the real thing the main
00:59
goal is to create life you had a lot of you want to remove the the kind of by
01:08
the work of and we all and so the think we start the whole so we want testing to find some of you body that is being the the framework and so I on 1st of all bond is by the
01:30
is that it constant communication is cheaper than this is the 1st part
01:36
the track of the company and there is always the we the on on
01:44
and the last time around the we have to this problem as much as possible because we know the that had the call and as being your solution has to be in the life cycle time that you need to think of the from the stream part
02:09
we we create 5 PM so we work on the object that we need we search for a data from the we try to mark each element with a review of that to me and the region we want to do that we want to do that get more intelligent than based call that you don't have that would be is 1 of the outcomes of our original voice of G was association that we were seeing the network latency among the problem we want to create a lot of white Irish ironic or of what we think of of then we fractions the front of the of the and what changes the way we also to fight the communication we have many by many protection and we have to work on each of assessment of of the we have to use the system I do any single might be that means we need to be read in the that we need to spread out of the car goes to calculate all the time of last possible not fixed and you need to review the data that we you in the time that you any of your of these be security visionary after that and say this is part of the while
03:47
our structure is very similar to and then we have the only thing that we know we have back at we have object of the story about what that cities in the next 3 is the set of the latter reside in I'm trying to
04:06
explain to you but your clients and the couple in estimating the received by the use of these go by the all the resources the a list of size continually note that the quality of the and you usually find words your then you have a list of Barroso resources so that means you do not know exactly where you know only this for each so can read this this all so that's kind of of the that we have to you have no we have 1st that all of the and like we have not so long that you will be my style that is going to have is the use of the server you use is 1 all have coupled so this would be 1 of this is only for discovery and some of the bogus information that can that server and there you go so that I can ority people and you get a handle on the on of the negative or a small and and food for predators to
05:28
retrieve data we have this server that we needed at the bottom so and the you can start you start 1st of all we the property of the object of the discovery of black and segment that you know where your an and property of the altered mainly is through the this user of each other then you have to make the will of the media that means we adopted the size of the object in the at the other side of the difference of that means both so you can see here the different ways of you have many originally read this and that's the word right or or if you have a different of the of the last all we are in the process and and 1 for the all this information
06:30
will be bad but so you have to go what we have the the and goes on and on the side of the world you things such regions of high school some of my life has not yet been devised that the and you have to get off of the conclusion of this is a very common thing that we use for on the use of the that means also when you was that you can it that then you have on the by the with the head of the theory that that you don't need profit when you have made some moderation you need on the part of the different so you have all that and you have to send the fact that you have to read you have to check with these changes and beyond of the people the are of the we have have the effect of light in this course and up mainly because this is the final find the at all and we don't that but you can imagine you need that you can handle make the pre and simplifies the receiver will be connection this structure of some of
07:57
the century of life in the idea of that this will be the line we have come the left of the at the logic and we have the right you can understand that our next we have many pieces and on the right to divide the origin of the already in the use of self that means the next slide each had has been given a based on the that that the instead of specific from view of the and also you can on the 3 but we can fly the meaning of that is made up of that the focus of the of the of the kind of section the results of the that you better so we developed by the sort of the want and you have also lots of hits you and
09:19
I said why I have use because each has has the form and that you can figure out what all of that and that is also the reason why the book you can do that on the you will expand it we try to use as much as possible if they do you know about the life of all very well for and that is designed to work and then we can see using the you can be very high we don't keep simple operational we have a lot of the time he was a breach of the In the beginning the of the of the way and fired all the time you have to be that you have acquired knowledge about the part that everything is we also use the back and the amount that the meaning that I had this not shown that the use of the to what I'm I want to
10:43
give you an example of the the lower the
10:51
this line all of the year by the end of the 2nd is the unit unit you will find and you have some problems with the beginning of the inside of the eyes actually the founder of the black and white and lots of things because to the not the the
11:21
the the the the the the graph
11:25
then you have this slide like you have a lot of what we are not in the block and by all the identified inside you that lost all of and so that all of the same to use external and that's something you need to write a off then you can have the same then you don't have a lot of time on the right you can say OK so he said he said each of the but also the size of the 2nd you can decide what pictures then you have the right you have all the problems and you can figure out how many lots very well you know and then and for each of these is handled by the on the other side of you have the block and the bullet and for us to use it the it small difference on the right and for a fraction of a more understanding here overseas loss on the property use a serial and those we are able to handle version in the measured and serial we also through a series of use of the land the 2 of them and then use all of them were in the war is a real
13:10
yeah a couple of other people the that is the idea of the object is to us you think the Secretary of of the region the position of the segment and so and what's the chance that this and that's so this theory identity the of the of the of the of so we will be the composition of each of the nature of the research that I believe that we have on the on the wire good what you
13:57
can do all way that it is something that you can do the 3 of you can be the object that is handle this 1 of the questions that you can compare 1 of the old 1 by 1 of the things we can do it by and was anything that you have a unique all of that knowledge that we have the same kind of reasoning that you as the nice thing is that you can but it not like I've
14:41
said what we we have a region
14:45
right here you have to like the last possible that he was the last version and keep this friend of the of the of the head of the variability the various of the you stop and here is an hour from now on according to the the final revision of the coordinates of world it was not the case on the roster is
15:17
the sum of the of the of
15:20
the of these based on the lot radiation and the use of the system in that part of the of possible on the fear and we read about 10
15:36
for who you know to use 1 of the copies or where the user can decide what you want what we want to be on the security of the you can decide that this is was a very and on and the so the that by passing the most probable and the job of old that handle other the other you know all of the all of the and the case where we had I not been and election rules to identify who is not to say the In this work is we have found that there is a kind of property that the to
16:32
the on the test by the head of the problems of private property can find this from the changes and we have this thing the I that was on fire what is it that you see is what
16:51
about half of you and this will all be you can decide if you want to be on top of each block and the increase undesirable defined policies have on and and we have these yellow and the 1st for the amount of the a
17:17
small when you've lost out of N of the right you know the the thing is that we have edge in the graph you can see the radius you are able to handle found around 50 thousand a single that means you can sort of that and most of the size of the set of the set of this time we don't know the but you can see also again and again in Part I of the of the we want I 3 so we applied it over time of time and yeah this is on the back and back from the pool of
18:17
all the pinnacle is organized in what about the nature of the the a survey of the model but I would say we call the if you know the fact that each atom in this region atom and the problem of and the 1 who is something that you want to but for example on the storage and use of force that is the user or if you want to use a lot of his you can see from the plot and you know that they're on but in a manner that you want to do something to it in the version you can override the meaning of it all you want to know about it now based on the end of the of the CDC we have to be 1 S 3 we how we have all the people that there is a need for and we have our our is that the thing that's a big thank that you have also been found in this we will a
19:32
what you need use everything by those we believe is possible to for the end of the of the of the use and was on the vision continues use 0 2 and a lot of of our knowledge of the use of all 4 of the you don't need to go on a in our approach to and the effect of the law and yet for now this is the the the the the the the the the the the media we want to ask for your information the have right what is the
20:19
I to you a lot of you know understand the of law but what then you have to use the right of what is the and the use of the river and they're all directly at the end every your book so this 1 a above but also on the last number of years and on the and I know there were a lot of love but you can use all of our region around the use the the the than a you can use also of course at the end the year is review that is 1 of the things that you want to do me a favor and repress the the also work over the people in the of this means that the depends on the if
21:21
you want the sum of the of the properties of of the instrument of I think the more interesting part is the experiment on the that the in the the in the moment you you know the ground and the data was reading of the you know the and yes so that
21:45
we can do what I want to and in many of the people that share young from school was used by millions of users in the value of the different white the work
22:00
so love and out of this site is not at all to the food and we are on the right and 1 of the top that I think of the we require that the removal of the size of is the number so we want to have a lot of the viewpoint that has a different view of the block that's what the mind and how to decide that the so that when I think that all this time I know a lot of about but there is still no and you can also use the use of the and then the right and left on the panel on that doesn't know that yeah that's what I and and everything to with the idea that the stock interested the of well I don't know about that was in what I can
23:18
mean how iteration on the class is from from I'm aware that and from the best of our knowledge flexible at to produce the difference that we get was the and especially the distribution of the of the of the state of the the art while all I think there are more for widening because we are on based the and you have the for you know that that sex is more apparent than using a lot more than that in the state of the of the you know you have it was actually is we are more strongly on along the side that we we want to be read there but I think is a not forcing obligation that very high title title this is about more than many regrets no I don't use the example in of the use of the of the of the time the
