Merken

Design considerations while Evaluating, Developing, Deploying a distributed task processing system

Zitierlink des Filmsegments
Embed Code

Automatisierte Medienanalyse

Beta
Erkannte Entitäten
Sprachtranskript
I don't want to have I will very community that good my name is correctly I will propose company but Indian was making a report on the end here presented topical which I call design and design considerations when developing evaluating or deploying you're on this response wasn't system now lies in developing and evaluating or deploying is because you might start to get on stuff you might want a lot like framework tho right from the start you might be evaluating wrote
of 3 months and available in the market for this reprocessing already you've shortlisted 1 would not the want who modify 1 of them so these are basically my learning is over the past year years last year a half that I've been playing around a stream of necessary that what are the essential components of this should be fast prison system should have that 1 can evaluate another systems for while designing 1 from
scratch 1 can keep keep in mind that were either going crazy so I'll be defining the indignities of what jobs is how we process
passes that was this example that you can see what the image yeah these are the fuel tools are designed back go go back at my office using summary precisely the the talking about how 190 the stuff so what are the conservation that for all these tasks what series all of all of these all of you I would not big much the inverse of the noise probably because I think you want from you might want to evaluate differences as well but I would love to talk about to me after the book is that design
choices in the choices I've tried and form 4 different components that is that a value within the system meets a beta during obedient past management b equal commandment viewed admin part of it and the would whatever and finally to talk about different workflows and the other ones are the real below right now in the open source community I firmly believe that everyone sitting over here has a use case for this you will pass processing so it would be great if you could think of it all new skills and then by connect to my talk at the moment I have my own to the use cases that have pride for additional about 4 7 systems you might be having your own systems so it would be great if you could just connected your use cases and then think about this as a people so that really have to understand what is involved in the next 30 minutes or so so what what is the task and what we mean by this word processing very
few examples of everything that I'm taking it off using the this
Boston systems but essentially for me at task is a subset of a job alright so let's see a job is I wanna say the middle 1 million users right now that's a complete job for me how I would break that the smaller classes to fetch a list of 1 million users that and you at all we need to apply for you go there what he just needs to be said what customers and then probably I'll use my as use tools and those e-mails they so I've battling it is highest picked up a job of sending e-mails and distributed and divided up into smaller smaller past now as we divide them in the past the knowledge that we now going to get into a scenario where we start running into problems for example what you need is asynchronous task you because each human that you need send us argument that depend on the previous customers like each customer's individual user for me so I really did not reach for 1 image sent completely and then the next 1 reason I can find them in parallel the other thing I need is this true admitted possessing 1 so lots of ice for me so I need before number of machines to fire all those things for me support India they possess invested you us what that means is I might want to send all of them right now or I might want to do them this is the next the next month after many days after the favored and stuff like that so what's lecture was it lets me do all these things very easily is very simple to get started with I so use more day morphology of how easy it is to install simply and then decide whether it the ability to fight mentioned that later fullest
task and make it isn't because that's where and when possible flexible and reliable all the design conservation that we will talk about properties on configurable by arguments instantly so that really makes it very flexible on also for me everything is message passing so what what that means is you have a broker I used use of before that so everything that I need to commute to communicate well close informed the sparse all inspect the state of the world because I do it while I would include so all to was a method on the message queue and you will workers then they of that out of the box for operation and management of the system what that means is I know this system and now I deployed it is looking fine for me and it breaks down right but I need to figure out what point of the system the public on divided break and stuff like that to simply says comes along with that help you manage the system but the last people haven't wrappers ordered and their open source so you can adapt to them and then see how they know what of performing for you for example how many task the work of forming how what's the latency of broadcast that the workers performing when you're going to start when you do what is of looking find is limited to writing isn't is limited duration so all these things come out of books
and you can use them Group manages to make then do if you use this is not as high as those mentioned earlier of example I was writing monitoring consist of of it and I used as most of all the data database gets ways of effect and then it ordering pretending system now we talking about hundreds of queries per minute so would you like so and these are all business
richness of permanent value is very important for all of them what we needed was a solution that contains 500 of queries on made it obvious assuming that it of a database which follow scandal that extend what I want right was only that can 500 queries get the desired and then that that is 1 of the major use cases that solving this is a very doubtful architecture of what the looks like so you can consider that as the application you can consider that as 1 of the tasks that
is this really is possessing so think of it as you uploading 3 of 4 left facebook facebook right under photographs are done of luring you you will not stop from using Facebook right you are still able to use Facebook and other features and similar is the case with you can right so that is what is happening is the is the back and process and that is what is happening in the easy at the back and you you need not what the users to wait until you're done with the processing so the example you perform an action on the website to perform an action that say the task gets the task you you have it will at that will execute the task you and probably you want desire back into
the or some other way way or you don't 1 desired and that is where the battle for the love that applications from the individual adopting on the getting people but at the this is how
easy it is to install something or does is just look at the influence of the publisher this so I have I
have already installed so the honor system right now I have to define a to the conflict that basically gives me this brokering used so I'm using here because they know and that I've written before the Park Service saying that it's on my local host and use the improvement of about all here I'm not concerned about what was desire of my
task on and considered as the task to get fired in parallel and is most major after and then the conversation I then define the
task of the life I live in I
like my functions what need to get executed before that the lost my confirmation fight and the left you them more past that religion this simple by functions so it is very easy for you if you have a credit application that you've written and by then and you know automated facility to simply because of the nature of how it absorbs again simply can ordered by the court in course of the past very easily you need not be much of the code for that purpose so let's start
civilian stands so now I'm getting to the to starting stands the task of the layout of the past 500 and the confidence interval of 1 so this is this
is what starts as civilian stance on my on my machine now how legs task let's thus the
equal AD is the function and I will Apple numbers so notified the command and this is
see the past past this is a
unique idea that it assigns
to each staff that comes in summary so that it can keep track of that and it basically adequate numbers and and and
results 0 yeah I can see the
status what happened pass it has successfully completed itself that would give me a success if I say what was a lot of the past it it'll give me for that so it this is how easy it is to get started so the and and stuff for you and this is all takes actually write on past so what you need to take care of his past of the verified and then you can call them just front-end from and calling the past will not be for the cost to finish so for example if you put the steepest fall since 60 seconds in an odd function but it would be easy collaboratively economical interest to find it and it becomes all about so now with the idea that you want you can then call back the message to and say what was a lot of success so can put a check whether the whether the queries to running water that hadn't finished if yes then what is the result coming
back to design choices so this is what I was mentioning that I have died
and form for apples around what is doing kid reviews of the distribute present system that you have how do you manage your tasks in the system
what are the local management and how do you add and boarding part of it because at the end of the day you want to see how it will cause of performing how that task so how many of them feared how many of them was successful securing capabilities can be in the form of immediate execution or in the form of renewables right now both of them have their own limitations and that on prose so you should value system it has all these qualities simply that you do both of them even if a student asks you can put the Kronstadt patent grants for concepts and entering the system it and you say i will be executed every morning 7 30 or you can even do a humanized fall friendly individual say I won't go into execute this query every Monday apart from that you consent in doing this so events that for example I want to execute this every 15 seconds I want to execute this every 30 seconds even if you're not satisfied with that it it should will come approaches that fire this query after 10 seconds so you will you will just political this it will start counting out then 9 8 7 6 4 3 2 1 and then provide whatever task you think this comes in pretty useful in then you have to jobs they clean up and stuff so for example I fired 1 task idle after this task has been fired 90 seconds after this task I will define the past so common approach really had to do that we
will talk about that when we move to the workflow section task management is is a bit tedious in of understanding what kind of past you have and how we will manage them for example you on a priority of
execution say I have 2 machines 1 machine connects to my primary database from which is a pretty scalable and pretty fast 1 machine connects to my 2nd databases which is not that good and I know that primary data database will always give me fosters of so I can find more number of queries on the primary areas other than my signature this is just an example so you can have both have the executions using simply all you did was defined and was probably 1 fast you and wants you and then you post last rule was was to foster task on whatever you you want will have and sort of you the local really 1 of those cues and become the past you can have a look at that can be doubled you can have a look at that these only 1 of the so that's that's flexible and simply that from manner based on west to see you at MIT was environment you have symbols machines you have 1 2 machines you have been those machines that and you have what goes on all of them now syntactic illegal operations might be different for example you just 105 query on database it would be different honoring those books and it will be different on on on a Linux box like so
I can have more the workers running I can have the cues and then
simply will help me take care of that Howard would as I warned you that those books and I want to that boxes and then I find my job so I'll make sure what matters was and what cues and you will prove that the take care of them so in that sense and still managing my different environments the same system that I have the this 200 capabilities of water discuss this you have 1 machine that can process large amount of data you have once more machine which can that amount of data so it's basically how you continue with this 1 can be undermined confidence here for 101 confronting of 5 so that that is you can have a defined on the stuff config management suppose I understand messages so on my messaging Q and or 10 of them need to be processed by so now they're 5 cos 5 of them and pick 1 1 past now there might be conflict what happens with 6 task picks them that my task expect again by some other message or not so all those things you can configure instantly and see that you need to process a
message only once you need to execute the task only once if not all of the solution that I use is for the law on the past using using the word it is so ordered was whenever I pick up a task I put a lot of time is a green and this task so no 1 else model that would be able but the task of forming bonds and on the day task I will release the lock and then anybody else and pick them up as well exception handling is pretty pretty straightforward to say you connecting good third-party EPA and now that's giving your payment what will happen is a systems analyst stop at the and you
wanna put the diameter ammonia sort simulated was if you if you the diet past
immediately it even lets you the diverter task I the given amount of time and even the natural diet for a specific number of times of example I would say if it fails for 5 times with interval of 5 minutes then give me then there is a minimum that means that there there's there's failure so not in the modern so I would like to be in that that kind of stuff so the standard of the dies ad exception handling is loosen you can explicitly expire task since have fighting a task but I want to expire after 20 seconds if take longer expired from the moment for me to comment you by Cecilia related wall is expired additional must so you have that kind iterative soft and hard soft this rate for the rate for the past and then expire part is just expired in respect of the state of the
you can also say that the ideal career so for example I have a look at that this is an hour of class now my local what happens to the message is that the book was finally so severe that she do that but with something was acknowledgment leave that as a group to so it might ask if I said acknowledgment is a group that means that element task finished I will send an acknowledgment of message to that this task has been they can get if the task is not completed admin machine goes down all those messages will get the plates of bias the that means something went wrong with the local machine they were not acknowledged hence they were not forces specifically related without bioconcentration chain itself this is a task I will say task that is what we said what we said when we add the ability then passes processing I want to see that the states of the past I would perform certain actions for example I want to see that the task force used or not I
was here that the past is running on our I probably will revolt that
task I will pause at horrible wanted to kill it right so these are few active the past that 1 should be taken of and mind your system should allow you to that you should even have controls lake pause for example you have finding some stuff anyone was that for a moment right I remember that probably I know that something has been wrong with 1 of my so I pause this set of cost and continually I will kill them for what Obama anyone believed them from making severe something known as forging so so you have 1 minute you have 1 million misses on a cue that people still get process but you know that this task more needs to be done what is simply the wizard was simply puts it thoughts on the task from the message and make it in the so that they won't get processed so you really do not need to restart it used to make those cues and you can simply reports that we had to now comes local management so each task flows to a particular will of local has multiple processors running at the end of the process them now when you because I was startled I was troubled that simple however will warm start down that means the organization finish all
the task and then Bordeaux horrible reported started on right now and get what you want so in case you want have acknowledgment broaden your misses will be lost if you have a lot proven it messes with that if task fields so I will have the trees but would be invited the past to sue the other system which is that it lets you bought the piece that's what would happen with past what what landed Finland poetry heartbeat which will cover the long-range which looks a little frightened Sicily maintains a heartbeat more then I will close up of this will no that is very important in addition we pass in system so you have been will close and you will make sure that all of them or not or 1 of them is spinning so that you can assign the problem of proper past them in case you have woman often model then it becomes very challenging for you what the inspection since let's you broadcast message to all the workers for its own monitoring and status properties for example I would simply due to the inspectors look at 1 if we will be looking at the local give notice that I need to collect it will give me all the stats and then send it back to the command center while Whitehead's is interview broadcast messages to Laurel flow workers so even if I don't want to give a particular task this broad mit broadcast visited between words so we'll get into that the worker inspection comes into play then you have to see of automotive parts of it before before on level of how much by his each task speaking on local and stuff like that or the stand up the students of example currently embedding the competency of cool because I don't have much misses unlimited so q but now the law of Mrs. coming on make you so you can configure silly each of each at its maximum level so houses it says
Ivan only under the confidence level which is maximum for me as the number of course you have in system so if you have it cause and you don't have confidence to form in the office came it with be able to run at the conference and of it and then come back toward of it sees that the coupling is not dead and the the pattern as 1 of its not given across machines so it's not that you can offer broil machine hostility and stop on in order to the doesn't come out of the box that would again have solutions to that is that assigning a new machine is very easy the all you did was the start of the stands like and on my machine so say you have a message with full will close to the epicenter of past and you suddenly need to spawn for new machines all you need to do where was simply being sent stock on all those 4 machines silly ridiculous reading the message from the from the stream and out of it in the past to them since does not ship your according will machine OK so if you have 4
different machines it's a lot bigger of shipping your passport find you have to make sure that before the workers come up your past popular finds already on the machine and it's not that it will start giving you and also if you change something in the past of the probably you add a new task or make some changes you have to restart it will because otherwise it will not be get infected so you have to probably do local by looking at the start of the Hollywood wanna would that probably depends on what kind of changes so you're making that is the I and the boarding I I find at us from the console but that doesn't stop me from will go out section and to do if you bust but soluble the form that might not be clear to people sitting at the back so what it's basically doing is I given name task and then I say OK this is
a task that you need to run but at a particular frequency of it immediately and these are the arguments to my particular past so that they have to move should use also modeling perspective somebody so you've ordered in the past of your friends like that function of ordered no just 1 to control it from the other section you need a ride by the product of was selected passed from the say had you arguments specified that buying the new model and provide for you therefore Bruckschen system you want to see how it's going so this is the ability known as flower that comes with simply you have to look at the installed flat for the water will give you a list of workers so that that up and running right now the number of tasks that they have completed the number of staff that they're be doing you can have more more details on that in terms of at the local level what the task that getting executed a lot of the arguments and what is the desired also ordered to do with historical rating of Homer costs have performed in the past and how much of them are going through a whole lot of them are going fast come workflows now
all the dust that the top logrank add function or s there like 1 task and then with you is simply adding them then you're designing workflows become situation when you want to the 1 task after the task what what other tasks probably investigated and then you would plot who forecasting together and stuff like that too soon becomes what is known as catalyst that led to design their own workflows so for example the are the favorable for that into what is changed so what will change it will link task together alright so what that means is I foreign for after that add 5 so that means and do that the output of fullest becomes the input of another so tactics explore argument over here in the fullest aggregate as and when 2 arguments for come off for but in the 2nd part and just doing a
favor so that means it's will take input for full of all 4 which is a and then added value the output of this would be good so this has to change the radius tasks you might come to a situation where you wanna say I wanna watch in these are for past this fire them environment right so all you do is add who will model and act as a form of what it to fire them in battle it's a lot of it for the 1st 1 of best or the 2nd 1 we'll finish you can look forward support is nothing it's it's basically doing a set of paths and after the service has been done no other function for me so it's it's more the full header and footer about of things so you have 5 tasks 5 process that is including a the 6 stuff for me so it's it's more of group and change together that forms support for you is very interesting because it is it intends to divide your jobs into a number of small instances OK so for example I recently I was working on an exercise in my office what we had was we had to process for a million documents but for me not mention not be published together that's of this so the system that we have process on how the limitation that it could process only 6 documents together right now I wanted a system that I can these all the 4 million documents on a message queue but them 6 everything right so chunks is what it you do so 1st argument is in charge is basically a couple so for example you will release all the ideas for 40 million so you possess informing users so you will fall under this formally news of ideas and then after the call my process then the confidence level for example in this example it's there and you can see in my case it was 6 so ordinary was it will pick up 6 you ladies
passes them the video 1 of them gets the best pick up another 1 so it will not which all 6 of them to finish but hasn't that 1 finishes information at a
given point of time 26 of them are getting fired so that is what John that with but the example that I had pasted on the front plate was passed trees so simply by the for doesn't come with something honest costly you have to add module which is 1 of the task 3 that led to good task in this manner so you definately in that the use the fullest performed by asking in this task is done I will just be of costly and will both of them are and I will pass the dust to dust so this is a simple task 3 that you can define so simply last me is what comes a CV for you tools available in the market there is this a new tool that as well as job costing it is majorly for that applications that will require user actually performed asynchronously it this break or simply itself but gives
other functions that help you of manage use of facing is solve for job is this something that if you remember the movie what is most use but definitely when look major thing that is missing and severe economic is but that kind of looks for like a definable to so if you're specifically looking for something in that definition then you should go and look at Babylon I haven't used in production that just that simple hello world program for that for at least that what was it looks fine if you don't do and writing of MapReduce programs and you need a framework flexibly you is the 1 that was open source less 45 a couple of years back is a pretty simple led MapReduce jobs and assigned task to the weather so be replaced falsely from the Python the other 3 are majorly and who was but they're them easily on the dollar but yes they perform similar functions not there has Watson forms but someone had to define new workflows and that that's also pretty thank you and open for questions thank you very
much for the revision if you have any questions please come up to the microphones and get type things for the of is it possible for the publisher for task 2 update the task later and and not just workflow like suspending but that actually the parametres would be updated and conversely is it possible that if the task while processing find something out the gives status updates to the
publisher without actually finishing up so the question is basically playing on the intermediate of the cost probably an upon this task I want 1 look in the past the learning or if it finds some normally or a business model then you need to perform another sort of cost so how I would in the list of I can call task task right so there ample say I'm running a task that defines the 2nd part of the question that you want to form something else by the former numbers mean may not do so what I'm adding functions but if I say if you if you sometimes comes to then perform this particular function so from there like in the direct medical from the mean task list fighting including the function that is nothing that that I can this the idea and in the past of that particular instance of so thank you for the talk I assume you in your slide that it is there's a web interface for adding task and that they can references schedule and everything will do do you think what that From the pros and cons of using these instead of the granted for example but it so the question is more on the using the admin part of a 20 year adults and minors columns for the support columns of up to some extent but as an engineer after defining complex look strong will not suffice for you for the for that purpose you have systems like so the that had grown to assess will at a given point of time will not have the skill in all of them users and given unemployment on the news in admin interface so I might be using the admin interface to submit new jobs but I'm sure he's an admin interface to control my jobs for example I want all the sort of at the moment so I would hope that panel and all the particular job or say I don't want to execute you for the next 5 is because I'm running into some problems so that is that the admin panel helps me about other than women with and on and when hi and you talk about tasks that accolades so let's say we have such a task and it's in the middle of processing and the worker dies when will the test the week you know so as an instance so his question is when this task Q is fired by processing possible products so not on the inside so this this question 1 is so tiny in the place so you actually have exceptions that you can call the if you've taken care of that and then you have to the new world order it was just part of each 1 of them in that particular exceptional so the idea is that you don't use model that explains the what will happen if if the mother dies and that is not supposed to happen you obviously have a woman beginning and figure out where the water in case you want explicitly mentioned that acknowledgment to be true in that case you will lose your message if you decide that you don't have to prove that local requirements so again the missing there that I have process this message if you want an intermediate intermediate product that I was in the works of analytic processing before I keep I can put that in mind is that this task is form and that has finished for non stated does not finished I know something went wrong but obviously if you will the diet that you you have have a system and see what happens if you will that there's no new messages on the local but yes you have to see what happens all the all the mass is that they will do the work on the honor system so if you are aware of the situation what exceptions can come expendable have exception handling and be placed manually for scenarios what will happen so you got run on the you slides mention that you can kill looked also out of that actually work and can you all the task to to gracefully clean up the resources it was using like yes so basically each task as an idea and then fired that idea so I used it would buy the idea but I will just select and can my particular so each each ideas
science each message is the same with that idea in instantly so each idea what whether it was you have an idea and you get all this but what is happening with that particular the null I want to believe that particular task deletion means removing it from the system itself it's a limited exceeded again giving means for that moment and given it but they never distribute this will happen next when that happened you so you have to decide that will be needed as prominently or just selected for that and so this running tonight it's what actually happens is the crucial skill to room so this it's it's not the process could possibly get killed if you do the wall so locally last fight to end number of processes if you to the world order processes get you if you do a particular task only that last of the city gets to the other possibility happened on a wilderness and I'll always be killed both terminated so it's basically gets on the message you and that's to the discovery that I along with this this and probably you might have about this which I heard of bit of that given this particular task that and that execution of the war holds and so for example see your task takes 20 seconds to get executed you say that all candidates finish at the end of the execute the reaction that you so that the production of course what sort of this of notion of the the question of what about task with that have already been been started so so what do you think can you can tasks that already have been started I think that's the question this was which was more than what happened regular customer already start the difference in the if the task is you'd have to limit the right and I can do if if it's schedule and it's already running yeah so that is also about that as the be of who wish to learn what is the need for the task of and then then connect the last giving out so wholesome we would have lots and lots of the state of the art associated beginnings doing the STD of a friend right so that the these you know many of the problem that what has been transferred and what has not been transferred because you get so many of the properties of celebrity so it will be an intermediate state and that is that you have to think of all of the political from this kind of of action but then you can it right there and then we read for the those love and then and for the top I just a clarification of the validity of information from 1 as you using the random cues appropriate so if you pick up the tab if you get the message and you don't act and if you and then if you're playing dies right and cues that message would reach you I don't understand why you can read as as a locking mechanism so no 1 else except so yeah so I was doing this has a lot of times and cause I want to make sure that violence things in the past the 1 is the word but it still on that not know was also hold it up by the court looks as if anybody except the message it will be good on on the unit itself so no 1 else will get you understand why the idea of the money it if rather efficient you and something the from the random can broker and doesn't act that message is sort of like OK and sentence until I get the active in so the acknowledgment is not by the and simulated quality have explicitly stated that I want to make this a little bit of knowledge as a task has acknowledged constantly so given you simply that 1 was more than and so I was doing that because it is a group of people I would not be it for every possible finish and then get message the back and think what you saying is make sense in that in that scenario what was I would wait for every task and the acknowledgment and then the other possible get picked up with enormous values then you will give a few videos of the past would say the it's floor and knowledge if it gets that exceptional I would be applied if it gets fears that a problem came mechanism is the same if you're past dies in with there were problems of that basically if the disconnect that an acknowledgment of this task is you this is highly statistically acknowledgment again are thinking of here if time for optimal performance of the example I haven't tasks best synchronization on the continent and to this tasks forms another task that that's the obvious how can be assured that departments task is picked up by by the same logic here is the synchronization was down otherwise they need to be picked up by other worker into the sum less because of this can be done on the salt is right so that is the density of problems have been used we're off possible make sure the same what was be of the simplest because probably have intermediate adult wordlist of of and then you have multiple machines that becomes more of a problem because your data is local on that particular issue right use instantly renewed fighting the fight we want a local machine picks up that past the alter of be performed by the look and feel it is not that I have for the past we don't in a city a chain I have past 1 would become 1 past the 2nd aspect gets picked about some of the world to ridiculous you in that sense that the complete she has to be performed by 1 to the local and other material and in that sense so your data if you are deleting some intermediate temporary friends and beating from that in the new be found on the other class that we can but otherwise for that scenario assuming that the of stuff you have to have a common gushingly portion of that everybody everybody can be that so for them but you see that each task because others are either published that that is the 1 some message queue and then about other aspects of the scene doesn't have to be that matters in that scenario you you have commonly across all developers you mentioned rather than q and the and my experience was red broken all of the previous so simply is not limited to just 1 local you can have different ways of looking at the end user is not that well for for model and using evidence before you can have a set of what it is found there and you can have all connected to the also does not limit you with 1 group so you can have multiple groups as well so you can have a mix of Aberdeen and you'll this and other stuff from lots of you know what was the highest throughput through system like normally discussed during looks like focus and all the moles quite so you know the few task that was a long time right so that means all of the challenges as was was a moment the restraints about so 4 million users that we need to process so that and what about 50 so we had to make sure that this is the will of the processing directly and then or dying of this is that even intermediate what happened what happened on so that was that was applied to put in orbit enrollment passed in modern that's not in the other set scenario that is seen as I will make sure that all the tasks and then in the same amount time so a number of ways to talking multiple and although the number of events per 2nd around number of that was the of region that here in the answer to all these means of production is is that you have a small and long than in past support us that are very complex and the beautiful but for events was again I have a number of years the last of images that thanks thanks for the presentation think however we have to
Metropolitan area network
Data Encryption Standard
Physikalisches System
Diskrete-Elemente-Methode
Leistungsbewertung
Code
Singularität <Mathematik>
Endogene Variable
Physikalisches System
Framework <Informatik>
Verkehrsinformation
Computeranimation
Gefangenendilemma
Metropolitan area network
Physikalisches System
Modallogik
Task
Dämpfung
Prozess <Informatik>
Leistungsbewertung
Zusammenhängender Graph
Physikalisches System
Computeranimation
Logik höherer Stufe
Subtraktion
Prozess <Physik>
Momentenproblem
Leistungsbewertung
Geräusch
Remote Access
Computeranimation
Eins
Task
Metropolitan area network
Physikalisches System
Erhaltungssatz
Bildschirmmaske
Task
Datenverwaltung
Zusammenhängender Graph
Bildgebendes Verfahren
Auswahlaxiom
Addition
Prozess <Informatik>
Open Source
Betafunktion
Inverse
Reihe
Physikalisches System
Office-Paket
Differenzkern
Mereologie
Textverarbeitung
Parametersystem
Klasse <Mathematik>
Zahlenbereich
Mailing-Liste
Physikalisches System
Computeranimation
Teilmenge
Task
Metropolitan area network
Virtuelle Maschine
Task
Mathematische Morphologie
Prozess <Informatik>
Parallele Schnittstelle
E-Mail
Bildgebendes Verfahren
Soundverarbeitung
Nichtlinearer Operator
Parametersystem
Punkt
Quader
Kategorie <Mathematik>
Datenhaltung
Open Source
Gruppenkeim
Abfrage
Physikalisches System
Schwach besetzte Matrix
Broadcastingverfahren
Kommutator <Quantentheorie>
Computeranimation
Task
Metropolitan area network
Erhaltungssatz
Datenverwaltung
Wrapper <Programmierung>
Kontrollstruktur
Warteschlange
Konfigurationsraum
Hilfesystem
Message-Passing
Serviceorientierte Architektur
Aggregatzustand
Task
Metropolitan area network
Web Site
Facebook
Prozess <Physik>
Digitale Photographie
Rechter Winkel
Datenhaltung
Gruppenoperation
Permanente
Abfrage
Kartesische Koordinaten
Computerarchitektur
Computeranimation
Metropolitan area network
Task
Multiplikation
Vorlesung/Konferenz
Kartesische Koordinaten
Computeranimation
Videospiel
Umsetzung <Informatik>
Euler-Winkel
Versionsverwaltung
Physikalisches System
Computeranimation
Task
Metropolitan area network
Serviceorientierte Architektur
Diskrete-Elemente-Methode
Task
Passwort
Parallele Schnittstelle
URL
Serviceorientierte Architektur
Lineares Funktional
Euler-Winkel
Natürliche Zahl
Reverse Engineering
Kartesische Koordinaten
Information
Systemaufruf
Code
Computeranimation
Task
Metropolitan area network
Task
Bereichsschätzung
Reelle Zahl
Automorphismus
Chatbot
Lineares Funktional
Datentyp
Transinformation
Euler-Winkel
Stichprobe
Zahlenbereich
Einfach zusammenhängender Raum
Winkel
Information
Nabel <Mathematik>
Computeranimation
Task
Warteschlange
Virtuelle Maschine
Metropolitan area network
Physikalisches System
Task
Softwaretest
Diskrete-Elemente-Methode
Interaktives Fernsehen
Inklusion <Mathematik>
Resultante
Lineares Funktional
Datentyp
Division
Stab
Zwei
Abfrage
Einfach zusammenhängender Raum
Extrempunkt
Information
Computeranimation
Physikalisches System
Metropolitan area network
Weg <Topologie>
Softwaretest
Task
Diskrete-Elemente-Methode
Klon <Mathematik>
Chi-Quadrat-Verteilung
Message-Passing
Gammafunktion
Datumsgrenze
Zwei
t-Test
Abfrage
Physikalisches System
Ereignishorizont
Computeranimation
Task
Metropolitan area network
Erneuerungstheorie
Bildschirmmaske
Task
Datenverwaltung
Prozess <Informatik>
Mereologie
Inverser Limes
Auswahlaxiom
Nichtlinearer Operator
Quader
Datenhaltung
Abfrage
Zahlenbereich
Symboltabelle
Schlussregel
Elektronische Unterschrift
Computeranimation
Task
Metropolitan area network
Virtuelle Maschine
Task
Datenverwaltung
Datenverwaltung
Garbentheorie
Programmierumgebung
Prozess <Physik>
Quader
Wasserdampftafel
Versionsverwaltung
Physikalisches System
Computeranimation
Task
Metropolitan area network
Virtuelle Maschine
Task
Datenverwaltung
Datenverwaltung
Bereichsschätzung
Prozess <Informatik>
Programmierumgebung
Konfigurationsraum
Message-Passing
Durchmesser
Ausnahmebehandlung
Physikalisches System
Gesetz <Physik>
Quick-Sort
Computeranimation
Task
Informationsmodellierung
Task
Datenverwaltung
Disk-Array
Wort <Informatik>
Einfügungsdämpfung
Message-Passing
Prozess <Physik>
Momentenproblem
Extrempunkt
Gruppenoperation
Klasse <Mathematik>
Gruppenkeim
Zahlenbereich
Element <Mathematik>
Computeranimation
Task
Metropolitan area network
Virtuelle Maschine
Task
Gammafunktion
Umwandlungsenthalpie
NP-hartes Problem
Zwei
Systemverwaltung
Ausnahmebehandlung
Bitrate
Verkettung <Informatik>
Forcing
Datenverwaltung
Mereologie
Message-Passing
Standardabweichung
Aggregatzustand
Neumann-Problem
Prozess <Physik>
Momentenproblem
Selbst organisierendes System
Physikalisches System
Computeranimation
Task
Metropolitan area network
Bildschirmmaske
Task
Datenverwaltung
Menge
Datenverwaltung
Rechter Winkel
Front-End <Software>
Gamecontroller
Coprozessor
Automorphismus
Quader
Extrempunkt
t-Test
Zahlenbereich
Sprachsynthese
Extrempunkt
Broadcastingverfahren
Gesetz <Physik>
Computeranimation
Übergang
Task
Netzwerktopologie
Metropolitan area network
Virtuelle Maschine
Bereichsschätzung
Front-End <Software>
Mustersprache
Broadcastingverfahren
Addition
Kategorie <Mathematik>
sinc-Funktion
Stellenring
Statistische Analyse
Physikalisches System
Datenfluss
Speicherbereichsnetzwerk
Office-Paket
Uniforme Struktur
Datenfeld
Datenverwaltung
Rechter Winkel
Eigentliche Abbildung
Ordnung <Mathematik>
Personal Area Network
Ext-Funktor
Message-Passing
Lineares Funktional
Parametersystem
Wasserdampftafel
Stab
Mathematisierung
Zahlenbereich
Mailing-Liste
Physikalisches System
Biprodukt
Bitrate
Frequenz
Service provider
Computeranimation
Übergang
Task
Virtuelle Maschine
Informationsmodellierung
Bildschirmmaske
Task
Perspektive
Garbentheorie
Spielkonsole
Prozess <Physik>
Zahlenbereich
Extrempunkt
Computeranimation
Task
Bildschirmmaske
Task
Bereichsschätzung
Prozess <Informatik>
Typentheorie
Inverser Limes
Warteschlange
E-Mail
Funktion <Mathematik>
Radius
Parametersystem
Lineares Funktional
Systemaufruf
Physikalisches System
Ein-Ausgabe
Office-Paket
Dienst <Informatik>
Menge
Mereologie
Bildschirmsymbol
Mini-Disc
Programmierumgebung
Message-Passing
Instantiierung
Netzwerktopologie
Task
Punkt
Prozess <Informatik>
Kontrollstruktur
Kartesische Koordinaten
Information
Modul
Computeranimation
Videokonferenz
Lineares Funktional
Open Source
Versionsverwaltung
Biprodukt
Framework <Informatik>
Computeranimation
Task
Metropolitan area network
Bildschirmmaske
Prozess <Informatik>
Datentyp
Optimierung
Mikroblog
Parametrische Erregung
Bit
Gewichtete Summe
Punkt
Prozess <Physik>
Momentenproblem
Minimierung
Gruppenkeim
Unternehmensmodell
Synchronisierung
Computeranimation
Videokonferenz
Einheit <Mathematik>
Prozess <Informatik>
Mixed Reality
Figurierte Zahl
Serviceorientierte Architektur
Schnittstelle
Softwaretest
Lineares Funktional
Kraftfahrzeugmechatroniker
Physikalischer Effekt
Kategorie <Mathematik>
Systemaufruf
Ruhmasse
Ausnahmebehandlung
Biprodukt
Ereignishorizont
Dichte <Physik>
Rechenschieber
Arithmetisches Mittel
Scheduling
Verkettung <Informatik>
Menge
Rechter Winkel
Information
Ordnung <Mathematik>
Message-Passing
Instantiierung
Aggregatzustand
Subtraktion
Wasserdampftafel
Klasse <Mathematik>
Gruppenoperation
Zahlenbereich
Analytische Menge
Kombinatorische Gruppentheorie
Mathematische Logik
Demoszene <Programmierung>
Task
Virtuelle Maschine
Bildschirmmaske
Informationsmodellierung
Warteschlange
Softwareentwickler
Bildgebendes Verfahren
Benutzeroberfläche
Zwei
Orbit <Mathematik>
Systemverwaltung
Validität
Mailing-Liste
Physikalisches System
Fokalpunkt
Quick-Sort
Mereologie
Wort <Informatik>

Metadaten

Formale Metadaten

Titel Design considerations while Evaluating, Developing, Deploying a distributed task processing system
Serientitel EuroPython 2014
Teil 36
Anzahl der Teile 120
Autor Modi, Konark
Lizenz CC-Namensnennung 3.0 Unported:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
DOI 10.5446/19961
Herausgeber EuroPython
Erscheinungsjahr 2014
Sprache Englisch
Produktionsort Berlin

Inhaltliche Metadaten

Fachgebiet Informatik
Abstract konarkmodi - Design considerations while Evaluating, Developing, Deploying a distributed task processing system With the growing world of web, there are numerous use-cases which require tasks to be executed in an asynchronous manner and in a distributed fashion. Celery is one of the most robust, scalable, extendable and easy-to-implement frameworks available for distributed task processing. While developing applications using Celery, I have had considerable experience in terms of what design choices one should be aware of while evaluating an existing system or developing one's own system from scratch.
Schlagwörter EuroPython Conference
EP 2014
EuroPython 2014

Ähnliche Filme

Loading...