Add to Watchlist



Citation of segment
Embed Code
Purchasing a DVD Cite video

Automated Media Analysis

Recognized Entities
Speech transcript
adjust and all the tools used from a broker on the ones to tell us something about the quality of service monitoring Folger see Web services so please yes that we should know Tomaž from yeah here in severe the feet and I'm just here and for the torque modern kind wantonly at the HITS storm shout not English as his my Bush if I did it powerful powerful so I will continue in English this is about dual check like Thomas said
it's so more officially co cool quality-of-service monitor for you spatial
Web services and we'll see what it is about and like the last speaker role using reveal yes so I give some credence to the to the maker vacuum at the top Thomas already told little it's
about me I'm from the Netherlands and doing various things there for 1 thing and trying to fool of always now as well local chapter of followers and this project I'm not doing this so by myself actually don't really this started this project probably many of you know him is also working on various
other projects to and harness the water from from Germany and is also 1 after the other contributors and as many more about use these remain people so here probably I don't have to explain what's OGC is what w think like the last speakers were already very detailed into new services so I I I skip this debate so the the the the actual contents of
my talk will be well 1st some monitoring challenges and will will go from there will go from there so suppose you're running 2 c web search you're running your W messed w 1st to mess
OK not entirely OTC team SW MTS and and at some points you get a phone call from a user on e-mail I see pink tiles there's German if you say a cop follow he says yes of this is this is what what the user would expect in this world views were often would see so here after pink tiles but though those tiles are not sent by the server the server said walls and pink tiles today no actually behind the scenes there's a problem and problem could be many faults as could be that you're not receiving and they match but you receive well all of formants exception reports or even worse you could I received the error in the image which is 1 of the W mass options my point is I the other thing let's say your databases being outfielder free nights and somehow the process fails they get nice white images but still there images my point is in many of these infrastructures have regular HTTP monetarist are being run and as the OTC services tends to have their own error handling on top of the regular HTTP it would be noticed so to and that means everything's OK you get a byte image you get your exception report so you
monitorial regular uptime monitor will never detect use situations such as so so we go further you can have get capabilities response which is OK well formed that could be static file with whomever guarantee that any of 2 more detailed surface was for work the reason we have been doing some time based services like sensor observations from sums of things API irregularities show friends who were working with 52 North probably everyone knows several people here in the conference as a source fewer about you can't could have
let's say a gap in your data how would you notice so so this requires all in all of the more detailed
monitoring and the generic monitoring the other thing is the there many uptime monitors you can register like being no more marked the bear bear at time robots I use those as well because this and measure measures is the service really down but many of the critical GC services let's say winning governments they run and
Turtle'' internet so you cannot use an external monetary units and have something internally the IT department has something like being I hope I made my point a bit
and that we need the an 2 see Where surface of folk what enough a it not just for a time of quality and service in general and it would be nice if history capture because 1 of users may
my call and say well the serves a down you you look now sup so you can you need to list unit history capture
so I hope I made this point clear there is a need actually I was looking for such a tool and then I came along due hell check which was already started in 2015 and the start of contributing to
the project and we have a demo running you can even the you can register there service I'll give a
short walk through so there's there's still lots of work to be done on the go we but the main thing is it has a dashboard where you can register your services and I will show you can also register the specific check that but you want to do
so here you see already some some statistics and you can zoom in on a specific service you can see it has been a offline or it has had had had ever sh and then go back up so the scenarios we
began a log in and then you can can enable if people call can register or you can disable that and then you can choose
from a list of services that we support currently it's an extensible saying we recently that it's not yet here instance due nodes and you note but here you would see a list of most of the regular 2 c services so you can edit what is called a resource and then you give just and points you don't have to give a capabilities to just say the point like here to W mass you can give some tax and then you get
into the editor and there you can configure we basically which tests are to be fired on your important and the terminology we use this approach so you have a list of probes and each probe is basically a request mostly some tests on the result of the response so we can zoom in France by default you always get it get capabilities broke so it will fire get capabilities on your end points but you can also this is the W mass have approach for let's say get mapped and then you can edit the probe with specific
parameters and summing gray already fixed because it's the services shoppers should always be and w mass so this configuration get capabilities request they're basically can choose a version and then the 2nd thing of a pro-pot approach checks and those are the checks which are ever actually performed on a response sufferings you want to have an invalid XML at least from what capabilities order the doesn't contain an O W S exception for and that contains these a title the moon so in that sense
and if you had friends to get map at it it has some intelligence to figure out what layer share our so you can select a layer and then figure basically get map request on all this case it's of the layers and once you have considered the
the tests are run currently every hour but where at this week on the coach printer working on the test frequency per and points and when something fails you can configure in e-mail and recently also aware poke to to get notified show for instance I use a separate that you e-mail boxes as this is 1 of the governmental w masses so they regularly fail and get back on and this is not even due to the WMS a mess itself right away so it's a network which is maintained by and by government IT departments so it things can fail for various reasons released we we get notified so
this this is basically was a walk through so how how does it work basically test 3 parts are due well check there is what use just sold a desk water-wet that point you configures services and your your help checks presently and then there's a run our which is now running fire Cronje up which performs the actual checks and it says plug-ins because all these checks
on probe you just so are actually plug-ins and that's a nice thing you can extend that as well and these 2 parts are grouped or fire a database I will get to
that so this is basically the you could say the architecture of the web that what you just saw sport and the run that runs in the background from subjects in the database so största results in all the conflagration and it's a Python project and for water use flask it's is a standards of whiskey so that so you can run at an engine makes our G. unicorn with a preferred way and I've seen also on a conference years Docker show cannot get into Docker get into the car it's it really works well and the runner is now fire Chrome and it runs what is called approach and check social plug-ins it has resulted reporting and mother said notification can have notifications is for the whole server or you can have a notification and the birth of band points so specific e-mail a certain points may be maintained by others and they may have to get those e-mails I talked about Propes and checks which is really the the weighted Sergiu held check performs the hell to judge the quality of service checks on their the actual programs that Anderson in the standard package there's quite a few already and you can write custom organs and when you have a block in you also configure old there it's parametres and that will be feasible in you I I think there's so the name if later on in the database shorts drums Fire equal to me and you can use of preferrably post grass post years or sequel me glossary she lights and database measured leaders support of fire she quotes from there's texture you can group Resources because it can get you can get lots of them installation as some basic you standards price and set up but it is easiest using Docker we have versions DARPA images on Docker Hub so and we have Docker Compose stopper composed basically is a tool to combine several Docker images Dockery imagery database France's Womble image for the Jew al-Sakr and that glues altogether and run wanting you could be up and running in minutes if you have a proper environment show various settings I won't go in all the details which can imagine you have several settings and file and Frances if you want notifications and to whom has to go and of course have to configure also you e-mail clients if you know you need to e-mail modifications a little bit about architecture the the reason is simple data model central as a resource
that's the end points and is relates to user and was and we also keep all the history which are the rounds so the model is really each resource has as a URL Anderson and points
and the proxy fire request summit you rel they get have multiple probes in the paroled can have multiple checks space and the checklist and finally told Cook but creator reports which is now a Jason files for you can format sets and then the other the what talked about the plug model but seeing the time but that I would like to show some code because yeah plug-ins sounds very difficult but it's actually very simple so this is the simplest blogger and this and that the the the probe This is an HTTP request and its is basically a templates you have to provide some para meters and Frances said its name and what type of resource so it could be a w must resource for their work and which shoddy available checks and that's that's about and have friends if you want to implement a check this is a check which implements if the response that comes back from http is not ever art which means it's not in the 400 to 500 range and it's just a few lines here and then the book of course it can get more elaborate wits capabilities but it's still there's no
no code here It's just definitions because the already knows that do an HTTP requests it only needs to know what the templates you relish and basically that's what you define here and it can be extended and finally it's also what you would see in you why so you configure vomitus let's say version you can select a version it's now drop down something the projects it's on on get hot
and my electors had started to temporally this somewhere in in in airport put in an airplane in 2004 seen is energy or Python organization and people programming python here the officials from around because as many other interesting projects there and on the coach prints various Alsace our of developers from these projects are actually they're actually commit person and maybe a cooperates because we that we just we have a demo running and demoted you how object of Oracle ants now some main things are under development there's an issue tracker because this this
presentation is on line the you how off them we're planning instance a REST API architecture so you can also configure the checks and from a
distance and integration with existing monitoring tools please we
really care always so Madurell coding testing documentation the luckily re re you're receiving more more help and PR spots that there you very welcome this is done showing OK
thank you so all any questions the I actually have 2 questions 1st question is why does this slide set of 42 pp 42 pp that it is checked its online no 42 is the answer to all questions in this kind of stuff but apparently don't know so sorry but if the if if so the other question is but have you ever been considering to our get the the error messages actually into HDP with UTC so is there is there's parts and the UGC that you don't return a 200 if it actually fails because I know that there has been some discussion not because it would make sense to say that the server answers yeah it's not a 200 I'm not sending anything but instead it doesn't happen so you know whether there's going to be an alignment of of the error to the HTTP standard yeah so the question is is how old you see improving for improving changing their standards to to really supports error messaging in HTTP I think it and they they artists the most recent developments for instance WF S 3 is anyone following that while the general movement is to go more to rest API type of standards so so use use http not just said to be 1st but also the error reporting so for instance sensor things API is also more restful what I will know about the existing standards if they're be modified and I know of some level you must service remembering the past they will actually which sensor http error codes but most wouldn't and at least we feel we force for instance 2 cents an exception report because the the most difficult thing would be to to analyze this error which is written in the image that would be sort of artificial intelligence file maybe my student project for certainly am we wanted to add an example of which you did that name in the beginning which is a necessity all of Europe has namely inspire and because these by guidelines of them have and the they demand a certain uptime and performance from the services and the actually tried that you have correct to monitor what is there about a year ago but couldn't do so because it was a limitation of a grounding library that's W M S 1 that 3 standards were not supported I checked again and now it's important yes and so I think it will be an idea for a probe to actually at inspire evident that validation of the response x amount yeah or a good question that the extra question came up also on on force for G. you from someone from the JRC and of course you have been inspire you have a very specific quality of service so requirements regarding W mass and that's partly to do with 1 of 2 standard probes like a responsive to become but within 5 seconds and you have to have some some money the requests and also now it would be a matter of developing a standard brawl their custom programming custom broke but we're happy cooperate on yet good question a question this this looks a really useful for our system admins enchanted to monitor services but as a developer of also seeing some potential to use this in during development of services and so on so do you think it would be a very difficult to extent due health care to use for instance for low to testing performance testing because you have approach adjusting to run them yeah and motion reports I guess yeah you can can write a custom program in the 2 types of probes so I'm probably forgot to say there's 1 is the template it's 1 that you have 1 week request you have your text but you may have a look into the Frances w mass crawler and then you can do as many requests if you have out and then you can have checks that's maybe say well those who do responses have to be within that many seconds and otherwise it's an error so you can right customer approach that that would do that kind of scenario share would require some pies encoding and use of the All OWS slipped I should say which is very handy to talk to a spline library for remote service another question what I will touch this little kid what's that a lot of information from and I know I personally would definitely check this and so I will try to to use it and then my projects I can promise that I will I will contribute to that but will see and so thank you therefore a talk and so thanks to the audience so I think it's time to get some coffee but and so refresher little bits of for the rest of the show things right thank you
Source code


Formal Metadata

Title GeoHealthCheck
Title of Series FOSSGIS Konferenz 2018: Bonn, 21. - 24. März 2018
Number of Parts 95
Author Broecke, Just van den
License CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
DOI 10.5446/36211
Publisher FOSSGIS e.V.
Release Date 2018
Language English

Content Metadata

Subject Area Information technology

Related Material


AV-Portal 3.5.0 (cb7a58240982536f976b3fae0db2d7d34ae7e46b)


  462 ms - page object