Bestand wählen
Merken

Easy ETL with OGR

Zitierlink des Filmsegments
Embed Code

Automatisierte Medienanalyse

Beta
Erkannte Entitäten
Sprachtranskript
hello and ready to starts and coca-leaf it's about what you are an extension for which you are and during each element of G or abomasum announced spinning cholera recursos called SIS based company doing mainly to open for teachers and providing services support of churches and re-use as almost everyone uses the old archaeal and that's fine and talk about what your as well yeah the jellies sucked transform load everyone doing Gs is working with geodata are quite a few applications of wearable for doing shell your so certification on a higher level like hey cattle talent is to your extensions so you have that desktop user interface where it can make models for your data to data transformations and so if you want to work on and that's level then I would suggest to have a look at it you cattle elected 1 where much uh but in my case I meet like a library which is embeddable in to just for instance so this is not an option for me I want built on lower-level libraries the GL boatyard is 1 of them and go all the possibilities you can do a lot of things that useful as or if you're handling XML files you can to XSLT termite possibilities about the for us it was we want to
build on all you are so I explain 1st how you do transform data is 0 here on there is boatyard told you or the programmed executable which many people know there is even there uh desktop we told for it helping with that and there are blocking sensing so with using of charge what your pants to understand how it works you have input data and then you you've uh options which uh applied to the input like playing in a science or a layer on layer of type geometry type and then it is red or then this defined is rather than it is in your data model and then you've output options the most important 1 is the default that you want to have and you can transform rates for apply filters and so on but it is important to understand what is what your data model supports it
this quite a simple model it it's uh of attribute fields for a number of fields with types it uses a feature identifier that you can and is configurable any tips for a long time 1 you a field and now since 1 year and it tests multitude 2 fields this is certainly an important improvement and it was financed by Swiss Agency because of that project and because of support for the Swiss formatting which need support for the multiple choice to spelling the next step for next level when using 0 your using the old job virtual form uh this is uh and not so well known and good that imitation of your site and it was made I think Frank incorrectly tool that create spatially years from from uh text files means like SUSY or something of flat tables without an your Michie format but with lat-long coordinates or something similar and then you can make config file acts axonal down there where you can go you can tell which feel so which as roots or form the tumor tree for the X and Y uh at you then using this you can look at the but the non-spatial layer with spatial twins the if you look at it graphical representation you see that this we are the is the inputs for John to which you are but it it points to the to the input data and in the from replaces this input options uh for reading data and you can apply the other old tool G R options for creating underneath but it another former this auction will work form test growing over the years it has many possibilities for many hidden possibilities are not self well known for the of this then obviously defined George fields you can change the color names you can change column types or map them can meet columns and you can apply spatial filters you can we protect layers and you can instead of having an fixed input layer you can have a scholar of Old your as co-expression which could be native SQL for post so it can be as SQL uplights to shapefiles even which are then executed by old you are and this case should appoint a possibility to have like calculated fields expressions ordering joints and other things so this is quite useful and we build on on that new steps forward the have for our purposes and now what I want to show this Python extension using the pi k guys which you your and we collect some functionality and of or during a fall and old your told your and but also uh Python implementations foreign which are included in the ocean or distribution the he provides a single binary for command line usage which makes it more uniform usage and yet we have that chastened conservation file and which has similar content us as the RT just shown but with additional parameters for those who like to watch your which you are told you uh command line parameters and in this flow tools also included these cutest blocking and and that 1 did here is that because all jars already included into trees there is no additional dependency Sophie used the pioneer title job we don't have to run as an external executable but if we can use all the functional devote your work by a pipe pipe API the that this graphics should explain how it works so the new bodies on the right side this this old JobConf gration histories of I'll mention and from this uh temporarily uh created to your is used for as an input for boatyard which points to the input data and input options in output options on the included in the old geog information so the idea is that you the you can and you put your old you are told you are parameters in 1 configuration file what so this is a python library and it is installed like by usually are installed with its canopy insult your tools and then you can use a command line and I would like to show it on the bench of dots in the console them but I have to switch
1st but because they should see it not
but the the so the the so the having solids overslept and I can call sort your executable which is also applied to find and here you can see the commands which are will will uh can look for a version of what your future libraries told I OK you but once you were but but at the same time it and that's good enough OK at the the but version of Auger formants think you can do with regular old your comments home but would like I and my script in the
story thank you the 2nd time but
if but the next thing is I want to
something like old your info the I have some test fine included in this the so that's similar to what or at the same output as you get when you and use of which you are in full as executable uh but this 1 is implemented in Python which undone by me which is also include chart Distribution Teresa a pipe implementation of or during a fall
and I'm using this 1 the that another
feature is and applying as old as school expressions on data this is all the possible ways in which are involved but I to goal was to half 1 then points or 1 an entry point for all these kind of comments so I do an SQL expression on the same on the shape find the what the the at OK now this is co-create so that each I had the inverse or not but I know which at tributes that they had so what they do now I told select operation you
can see it it's not it's the bottom the only the to that 1st
of hello Prader-Willi it's that could be to any time point but going to the input vector here I see the name of the layer and the all the column names the I
made 2 ligands correct for all them they can mistake you I was in the the the that's good by DOE boatyard ESC well which is the same as this as you can do is 0 during fall that's what I do and what it should do the in my example if we learn something I like that the so I can't mistake right now but I hope you believe me that's you would get them this same as um the as we to in for uh it to select I think come to memorize it up the yes on the old your sites you have documentation what kind of a skill you can do and there's qualities interpreted differently when you do it on the sources like shape shapefiles then you have a limited a skull supports and we do it on on POS case it is native cultures as quell or on sequel lighter it's also a native squirrel the next thing which is included this the help perform generating uh this your the files the which is useful if you want to have have don't the if you think the the the the added costs so that was there the ethical form so that in the the the the we can order that's that's the same out with us or joining gives you will be doing a school query on on and what your input type and so you can add where clothes and so on the problem was too strong finding and if you do this all job beyond the the we get
relates purity which
does include the same information as all influence which gives you a starting point for changing data types or changing will add feelings and so on so this is useful is if you want to work with the majorities the next step is now to have a configuration file for doing this are Tools transformations so what they do with of all the comments that generates upon Fig which is similar to this your the concentration generator the the I tell you what what the preferred to destination format is so this is different it is the T because I want also to have the output from the solve or just told you are included in the confirmation fight I don't have to convert to this format but it's it's optimized to if all parameters are optimized for the test default format so the same again I use the shape file the standing the OK so this is how the this conservation fine looks like and some uh primed look familiar so this are OGR tool your parameters which are applied uh when I executed transformation which can be changed the source format and destination format we have the same thing as we had in the RTE defeats types and so on and we
have a tumor to type layer name and john too few specifications 2 PM please explain order allow that I write it into a fine of that it's going consideration the and now I can use that for a transformation in the next step is always transform exchanger but here executable helps can always present look what's missing so the and formants they want I should I don't have to add because it to keep to chase the 1st and then the input file the the end of could fight and it's the same order as which of your job destination and source so the output will be read great Jason of of a mistake or more efficient that I forgot the conflagration file but this 1 is not an option so but I got now is Jason the which is the 2 year chase file the made from the shape I does this mean that good again the and to play let's I can the at the conflagration and let's say as sort at this uh was MIT was the the the the floating point number which makes no so much sense that in
the same again with his new configuration up to his in our duties driver debts originally from which you at your does not all or right existing files is so I'd I had to add options for overriding the to be here for now is to remove defined 1st to the and what was it really changing and the but in the all tell me that they should have use something else the the but I was
quite short of the of and
the the In chocolate chronic which then the capitalist before you have
good the OK but that's so is and I lazy and
now we have to always and ideas integer the the but that's more or less uh the T uh functionality reusing you what I can to was well is doing dairy we reverse transformation hello automatically that's another option of what you're transform so if deceiver slack off time which interprets the the conflagration of find the worst way and help stewing diverse config uh transformation so I go back to transform the and yeah so this was input the now I the the another output file another name and the input is now the Jason the you trace have created now have you know that don't have enough to give formats but it could also use another form now but only have 2 so the divided the super worse this conflict k now I should to the new 73 features sort folks clock that example actors are on on the top page the projects this feature vector
for all slides and if you
will so that's a gig of H. F. on all the sources there and there is quite and documentation in the in the really but and this is an ongoing project and see if someone is interested in and thinks that's useful I'm very old I am open for anyhow so what could be done is that doing something similar like few on on on the good resides that having including a more Pythonic your API uh not all of which underwrote your functionalities included yet then it it would be nice to wear make table Chauncey's easier sell you can do with this as well it's not so easy the Python API itself not accommodated yet docum the other is the conditional pdf pine API but only for the conservation violent executables ends as a set it has served acute is blocking but this due to spontaneous uh specialized on on this we seem to format and that was the reason for this project and and it would be very interesting to have a more generic looking for doing what you are transformations started from countries without the need of an executable which is always leave it difficult on it a spot for independence and past policies must be correct and the lab is most profound and this would make this here could also be interesting to integrate these into processing uh functionality of Q futures which with the then you could use to model in the futures for using for doing things like that the OK time is O R thank you so that you may be 1 question you know the so I remember reading um GDL roadmap that there's potentially some
consolidation of the Dollan dear says that project and and and talk about changing um the with binaries function so that's something that's are they using about that maybe having Sunil effect you this product here it has already happened for a big part of it is implemented and but it doesn't influence this where much it's I mean it's still an OGR API and it goes API um but I'm not sure but I think that the pie make I will status saying I don't expect big changes that uh so doesn't implants project at this despite in part we the you see that the you know some of you and then you what do hear the yeah maybe this this the command line interface has to be even more generic that it even covers uh roster formants it is a set of another step yet thank you and it
Offene Menge
Server
Digitales Zertifikat
Benutzeroberfläche
Nabel <Mathematik>
Übergang
Element <Mathematik>
Transformation <Mathematik>
Konfiguration <Informatik>
Übergang
Unternehmensarchitektur
Dienst <Informatik>
Informationsmodellierung
Last
Speicherabzug
Programmbibliothek
Maßerweiterung
Druckertreiber
Instantiierung
Distributionstheorie
Mereologie
Krümmung
Konfiguration <Informatik>
Virtualisierung
Selbstrepräsentation
Textur-Mapping
Information
Binärcode
Computeranimation
Übergang
Netzwerktopologie
Arithmetischer Ausdruck
Prozess <Informatik>
Spielkonsole
Default
Auswahlaxiom
Funktion <Mathematik>
Softwaretest
Parametersystem
Addition
Filter <Stochastik>
Installation <Informatik>
Krümmung
Ähnlichkeitsgeometrie
Bitrate
Ein-Ausgabe
Rechnen
Dateiformat
Konfiguration <Informatik>
Datenfeld
Funktion <Mathematik>
Generizität
Ein-Ausgabe
Dateiformat
Identifizierbarkeit
Projektive Ebene
Information
Primzahlzwillinge
Programmbibliothek
Akustooptik
Tabelle <Informatik>
Web Site
Mathematisierung
Regulärer Ausdruck
Zahlenbereich
Implementierung
Schriftzeichenerkennung
Gebäude <Mathematik>
Räumliche Anordnung
Bildschirmmaske
Informationsmodellierung
Datentyp
Virtuelle Realität
Programmbibliothek
Inhalt <Mathematik>
Maßerweiterung
Konfigurationsraum
Attributierte Grammatik
Tabelle <Informatik>
Konfigurationsraum
Datenmodell
Datenmodell
Einfache Genauigkeit
Elektronische Publikation
Datenfluss
Skalarprodukt
Körper <Physik>
Parametersystem
Attributierte Grammatik
Räumliche Anordnung
Kantenfärbung
Energieerhaltung
Programmbibliothek
Versionsverwaltung
Skript <Programm>
Quick-Sort
Computeranimation
Computeranimation
Softwaretest
Open Source
Retrievalsprache
Distributionstheorie
Message-Passing
Implementierung
Information
Dateiformat
Computeranimation
Funktion <Mathematik>
Nichtlinearer Operator
Shape <Informatik>
Arithmetischer Ausdruck
Punkt
Inverse
Computeranimation
Punkt
Minimum
Vektorraum
Ein-Ausgabe
Computeranimation
Shape <Informatik>
Web Site
Prozess <Informatik>
Datentyp
Güte der Anpassung
Abfrage
Fortsetzung <Mathematik>
Quellcode
Elektronische Publikation
Ein-Ausgabe
Hilfesystem
Computeranimation
Punkt
Zahlenbereich
Transformation <Mathematik>
Kombinatorische Gruppentheorie
Computeranimation
Prozess <Informatik>
Datentyp
Konfigurationsraum
Default
Funktion <Mathematik>
Softwaretest
Umwandlungsenthalpie
Parametersystem
Shape <Informatik>
Quellcode
Elektronische Publikation
Ein-Ausgabe
Quick-Sort
Konfiguration <Informatik>
Arithmetisches Mittel
Konzentrizität
Dateiformat
Energieerhaltung
Information
Ordnung <Mathematik>
Druckertreiber
Elektronische Publikation
Konfigurationsraum
Computeranimation
Konfiguration <Informatik>
Computeranimation
Lineares Funktional
Versionsverwaltung
Transformation <Mathematik>
Vektorraum
Ein-Ausgabe
Elektronische Publikation
Quick-Sort
Computeranimation
Homepage
Konfiguration <Informatik>
Bildschirmmaske
Dateiformat
Projektive Ebene
Konfigurationsraum
Hilfesystem
Funktion <Mathematik>
Lineares Funktional
Transformation <Mathematik>
Desintegration <Mathematik>
Stochastische Abhängigkeit
Konfigurationsraum
Dichte <Stochastik>
Schriftzeichenerkennung
Quellcode
Transformation <Mathematik>
Dateiformat
Computeranimation
Informationsmodellierung
Softwaretest
Funktion <Mathematik>
Code
Konditionszahl
Generizität
Dateiformat
Projektive Ebene
Energieerhaltung
Baum <Mathematik>
Tabelle <Informatik>
Soundverarbeitung
Menge
Mathematisierung
Mereologie
Pi <Zahl>
Projektive Ebene
Biprodukt
Binärcode

Metadaten

Formale Metadaten

Titel Easy ETL with OGR
Serientitel FOSS4G 2014 Portland
Autor Kalberer, Pirmin
Lizenz CC-Namensnennung 3.0 Deutschland:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
DOI 10.5446/31723
Herausgeber FOSS4G, Open Source Geospatial Foundation (OSGeo)
Erscheinungsjahr 2014
Sprache Englisch
Produzent Foss4G
Open Source Geospatial Foundation (OSGeo)
Produktionsjahr 2014
Produktionsort Portland, Oregon, United States of America

Inhaltliche Metadaten

Fachgebiet Informatik
Abstract The ogrtools Python library lets you run complex ogr2ogr operations defined in a configuration file supporting transformations of all OGR vector formats. It uses the OGR Virtual Format (VRT) internally for transformations like renaming tables or columns, calculating values and converting data types. Since version 1.11 of GDAL/OGR, multiple geometry columns per table are fully supported for major data formats.As a pure Python library using OGR Python bindings, it has no additional dependencies and is therefore easy to integrate in other applications like QGIS.https://github.com/sourcepole/ogrtools
Schlagwörter OGR
ETL
Python

Ähnliche Filme

Loading...
Feedback