Database Transformation, Cadastre Automatic Data Processing in QGIS and Implementation in Web GIS
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Title of Series | ||
| Number of Parts | 295 | |
| Author | ||
| Contributors | ||
| License | CC Attribution 3.0 Germany: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/43551 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
| |
| Keywords |
FOSS4G Bucharest 201933 / 295
15
20
28
32
37
38
39
40
41
42
43
44
46
48
52
54
57
69
72
75
83
85
87
88
101
103
105
106
108
111
114
119
122
123
126
129
130
131
132
137
139
140
141
142
143
144
147
148
149
155
157
159
163
166
170
171
179
189
191
192
193
194
195
196
197
202
207
212
213
214
215
216
231
235
251
252
263
287
00:00
Transformation (genetics)Rule of inferenceWeb 2.0TrailDatabaseGoodness of fitLevel (video gaming)Bus (computing)ImplementationMultiplication signElectronic data processingCoefficient of determinationUniverse (mathematics)Lecture/Conference
00:56
Performance appraisalPresentation of a groupLink (knot theory)Scaling (geometry)Data structureWeb 2.0AreaLevel (video gaming)Field (computer science)Projective planeStandard deviationImplementationSoftware developerValuation (algebra)Electronic mailing list
02:05
ImplementationTransformation (genetics)Stochastic processDatabaseData structureStandard deviationServer (computing)Client (computing)BuildingUniqueness quantificationShape (magazine)PlanningTime zoneBasis <Mathematik>Rule of inferenceFigurate numberInformationTime zoneCombinational logicSoftware developerAreaPurchasingReal numberSquare numberPhysical lawStandard deviationCondition numberNumberBasis <Mathematik>State of matterGraph coloringMetreData structurePlanningBuildingShape (magazine)Execution unitMetropolitan area networkError messageComputer animation
03:57
BuildingStandard deviationUniqueness quantificationData structureShape (magazine)PlanningTime zoneBasis <Mathematik>ImplementationStochastic processDatabaseProcess (computing)Open sourceDerivation (linguistics)Server (computing)Client (computing)Address spaceSocial classContent (media)Discrete element methodHuman migrationInformation managementPolygonMalwareSolomon (pianist)Time zoneNumberOpen sourceLevel (video gaming)Mathematical analysisResultantDatabaseSet (mathematics)Subject indexingDerivation (linguistics)AreaProjective planeServer (computing)PurchasingClosed setWeb 2.0Human migrationMultiplication signStandard deviationPressureWeb browserFile formatOffice suiteState of matterPlanningSoftware developerSelectivity (electronic)Digital libraryDiscrete element methodProcedural programmingBitLecture/ConferenceComputer animation
05:49
Address spaceSocial classGenderComputer fontHuman migrationTouchscreenBasis <Mathematik>Information managementImplementationStochastic processTransformation (genetics)DatabaseDiscrete element methodElement (mathematics)Execution unitContent (media)BuildingModal logicPolygonSolomon (pianist)WindowGradientIntegrated development environmentGeometryPurchasingCodeStandard deviationResultantLevel (video gaming)MereologyPoint (geometry)Scripting languageMultiplication signDataflowSocial classVideoconferencingPolygonGraph coloringAttribute grammarSampling (statistics)Connected spaceOpen sourceCASE <Informatik>Raw image formatExtension (kinesiology)WindowStandard deviationNumberBuildingTheory of relativityTime zoneWebsiteParameter (computer programming)Buffer solutionAddress spacePlanningPurchasingWeb 2.0AreaComputer fontProjective planeObject (grammar)Type theoryDatabaseElectronic data processingDigital libraryExpressionInclined planeLine (geometry)InformationDegree (graph theory)RotationIntegrated development environmentoutputCorrespondence (mathematics)AngleExpert systemCodeHuman migrationArrow of timeDreizehnQueue (abstract data type)Real numberSet (mathematics)Selectivity (electronic)PlastikkarteMultilaterationEvent horizonNatural languageGeometryLecture/ConferenceMeeting/InterviewComputer animation
11:35
Scripting languageCellular automatonAllegoryLevel (video gaming)AlgorithmComputer animation
12:00
ImplementationStochastic processDatabaseCodeStandard deviationTransformation (genetics)Open sourceComponent-based software engineeringQuery languageClient (computing)Server (computing)SurfaceArchitectureOrder of magnitudeMereologyServer (computing)Level (video gaming)Web 2.0Client (computing)Functional (mathematics)Letterpress printingConnected spaceSurfaceResultantComputer architectureInternetworkingSampling (statistics)Web browserQueue (abstract data type)Metropolitan area networkComputer animation
13:58
Personal identification numberGeomaticsForschungszentrum RossendorfSpektrum <Mathematik>Information managementSign (mathematics)InformationVariety (linguistics)Content (media)Texture mappingDisintegrationWeb pageTraffic reportingPresentation of a groupXMLComputer animation
14:27
Functional (mathematics)Link (knot theory)
15:00
NumberAddress spaceInformationTime zoneComputer configurationSampling (statistics)Configuration spaceServer (computing)Web browserLevel (video gaming)Functional (mathematics)Scaling (geometry)Probability density functionLetterpress printingClient (computing)Differential operatorFlow separationOpen setComputer animation
16:41
Polygon meshFile formatOpen setInformationExtension (kinesiology)Computer configurationDescriptive statisticsLevel (video gaming)Client (computing)Metropolitan area networkComputer animation
17:23
Sign (mathematics)R-ParitätInformationVariety (linguistics)Content (media)Texture mappingDisintegrationPersonal identification numberVideo gameImplementationTransformation (genetics)DatabaseStochastic processStandard deviationComputer programmingCodierung <Programmierung>Process (computing)Open sourceDigital libraryClient (computing)Discrete element methodData modelEndliche ModelltheorieBuildingVisualization (computer graphics)MereologyComputer animationLecture/Conference
17:47
ImplementationStochastic processDatabaseStandard deviationCodierung <Programmierung>Computer programmingTexture mappingProcess (computing)Open sourceClient (computing)Discrete element methodDigital libraryBuildingData modelVisualization (computer graphics)Endliche ModelltheorieDescriptive statistics1 (number)WebsiteProcess (computing)Endliche ModelltheorieLine (geometry)Level (video gaming)Point (geometry)Standard deviationProjective planeBuildingCASE <Informatik>Dimensional analysisPresentation of a groupCopyright infringementExecution unitMultiplication signCellular automatonLecture/Conference
19:19
Combinational logicStochastic processAreaCodeWeb 2.0MereologyPreprocessorScripting languageMultiplication signLimit (category theory)RotationBitHypothesisState of matterAngleRow (database)Pairwise comparisonInterpolationDatabaseServer (computing)Point (geometry)Category of beingPhysical systemBeat (acoustics)Network topologyCASE <Informatik>Extension (kinesiology)Order (biology)Level (video gaming)Functional (mathematics)Graph coloringMathematicsTheory of relativitySymbol tableLine (geometry)Data conversionSystem callVotingObservational studyQueue (abstract data type)HypermediaCollisionMixed realityArc (geometry)Personal identification numberIndependence (probability theory)Lecture/Conference
Transcript: English(auto-generated)
00:08
Okay, welcome to this new session of talks of the academic tracks today. We'll have three talks the rules for the speakers are 20 minutes talks five minutes question and five minutes for moving. So I ask you please to stay in the times
00:24
I present myself. I'm Daniel oxali. I'm a researcher at Polytechno de Milano working in GIS and Now I'm glad to leave the stage to dr Stata bus that present in database transformation cadastre data processing QGIS and implementation in web gis, so
00:42
So Hello ladies and gentlemen, I wish you a good morning and good start for this season My topic is related to the database transformation cadas data processing in QGIS and implementation in the web gis
01:01
The following work was carried out in cooperation with the University of Applied Science in Stuttgart and The shtick and company and dr. Koch company which is the other firma for the d-stick This stick is the well-known company in southwest of the Germany and
01:23
Who are dominated in the city planning and city development? Dr. Koch is a sub company of the shtick and works in the field of the evaluation of the real estate in the larger scales and Which means evaluation of the whole city and quarter or industrial area and moreover?
01:44
Evaluation of the so-called land standard values. This will be a topic or link for the following project So the structure of this presentation Is introduction methodology of processing the cadas data
02:02
QGIS and semi-automatic map creation web gis and conclusion and further research so as You know that company is located in the Germany so we are following the German rules German law
02:24
German building law Represent a significant law and toolset regarding planning building and has influence on the shape structure and development of the manuscript qualities according to the rule
02:42
196 the land standard values have to be derived and published by the real estate value advisory committees The land standard values are the values given the euro per square meters for the homogeneous special zone like a residential industrial and the combination of the residential and
03:06
Industrial area and Derived mainly of the basis of the collection of the purchasing price in the manuscript quality as you can see in the figure Here we have we have you know some
03:24
Homogeneous special zones like here this one and this one which will be highlighted by the pink color this Number states for the you know price for the one parcel unstructured
03:40
constructed parcel inside this zone and this B stand for the development condition and it this kind of you know Information has been decided by the city planners in the company and this is the zone number which is the identical for each zones and
04:04
another letter here is W standing for the residential area this is the German experts, you know German letters and The next one is the floor space index So some introduction the databases
04:26
For the derivation of the land standard values are the official CADAS data Which which is the ALCIS data and this this data consists more than 200 layers For creating the map that I show you
04:42
Needs huge manual steps Like geocoding of the purchasing price Selecting aggregating and And categorizing the data It's it would takes time, you know and if this pressure is really time and cost intensive and the aim of this project is you know,
05:06
migration or jumping from the commercial or closed source and GIS to the open source GIS and Taking advantage of the open source special database PostgreSQL and
05:20
QGIS server and leads map web client to visualizing in the web as you can see there is a methodology of this project We have the some basic data sets and data precision and result of the analysis in the basic Dataset when we have the ALCIS data. This is the CADAS data
05:43
based on the XML format and In we have the urban land use plan like a local plans informal planning like an urban development concept and for the other relevant geodata For taking that kind of values. We will use the dam digital elevation model
06:06
and digital orthogonals, but in Some cases it's this kind of data is not available just for some big cities and the most important parameter to Drive the value the land standard value is the purchasing price of the undeveloped sites in
06:24
relation to the land parcel number and the addresses so This is the datasets and we need to have the data processing data processing so by using the migration of the XML data
06:42
Selecting and aggregating of the CADAS object classes like a building and detection of the type and degree of the building and land use and delineation of the slope inclination and aspect and other relevant areas so and for the purchasing prices, we need to have the geocoding and
07:07
Geocoding of the purchasing price for the corresponding land other land parcel and the addresses so by taking you know by consideration this kind of Input data and data set and precision the expert in the company the city planning will decide about the zones
07:28
Which which parcel are you know are? Has a homogeneous special related and can have the you know the same value This part after you know, the city planners will do in the in the map in the paper
07:45
this is the kind of you know, semi-automatic part of the for the digitizing the this map in the QGIS and giving the attribute to the Polygons that we create and the final step is the you know, the publishing in the web
08:05
So as I want to divide my project into three different three important aspects the first part is that you know to dealing to data preparation in the database so
08:20
we are using the Nord beat Extension from the OSG04W for the windows environment to import the raw Alki's data to the post SQL post geese and So this kind of as I told you we have more than 200 layers. It's in some cases is 212
08:44
213 and we must provide this kind of data We have a sample here for example this one we have the AP on the line PTO layers Which contains the street name and it's a street in geometry, but you must
09:06
There is no visible for this Street name you must drive this kind of information from This layer by really simple or basic SQL code, but very effective to create the street name
09:24
Some expression is in a German language but if you have any question, I will explain to you later on and For the parcel number this parcel number, which is which we connected to the purchasing price later on
09:40
We must create the parcel number by really simple another simple SQL code and as you can see in the result in the map, and we have the parcel number which is unique for each Parcel and here we have the purchasing price as a sample which is
10:03
Visible in the red color. So the second Important part of this project, you know finishing the database layer preparation and this is the time for the visualizing in the
10:20
GIS this stuff as I told you this is the point and you know to jump from the commercial open-source by using the QGIS This is just one Really small part of the code that we develop, you know by you know connection to the database and you know taking the
10:43
data and Giving the size buffer rotation as you can remember in the previous slide and For the for the each point for the labeling we need to have the
11:01
Unique angle to be rotated to be fit exactly in the street So this is the this is the code and this is the final result just for this code will be you know the street name exactly to be fitted in into the street flow
11:21
So I would like to show you really short video of Creating this project in the QGIS by running the script
11:43
Here you will have some algorithms and you know the map the end this map is the One really a small city in the southwest of the Germany, which name is tight. So So it would take it's not all because you know
12:00
it would take around two minutes three minutes to be completed for the labeling and you know, they're rotating after label and It's a little So so the second part is done so
12:20
Magnitude polities ask us to visualize to publish this map into the web So previously our company just asked, you know some some external company, you know to publish this web this this map into the web in the internet but we could develop by ourselves by using by taking advantage from the
12:44
QGIS server and lismap web client and As you can see in the web GIS architecture we are starting from the post SQL connection connecting to the QGIS and QGIS and QGIS server and
13:00
one really a great client lismap the client has functionality like navigating printing and configuring the client surface and currying on the feature layer And so many other functionalities I will show you one sample
13:22
So this is the final result As you can see in which has the you know, the company logo The title and I will show it live
14:04
Okay Yes, I think It's a little complicated Maybe you just know this is another presentation
14:38
Okay, that's nice
14:48
so and As you can see, you know, we have this is the you know, the link everybody can access To this link and you know, we have different functionality
15:03
Here and the most important one is the kind of you know address searching, you know and finding the parcel number We have for example, we can try here parcel number 25 So and we will go exactly to this
15:22
parcel and You know We configured we developed this Pop-up configuration for that. For example here. We have the full districts number the address for this one and the Zone number the price and
15:41
This is this parcel is exactly inside this Zone and it will take the information from this zone and This is whatever you will see here as a pop pop up You know the information in pop up information in in the map it must be exactly same like it the label for each zone and
16:05
We have other functionality in the lease map web client Such as the legend, you know liar, you know, we can just Of or on and and other important things for the for the city planners is the printing option
16:23
So we defined a different scales you can you can choose the different scales but you know this kind of configuration will be done in the QGIS server and lisma web client and this is the Sample if you go and we can you know save this as a PDF so and
16:49
We have this option, you know to make off or on and to use the open street map which is free we can just add into our
17:00
client and Some other option maybe this is the logo for the municipalities this is the description for the labels and you know some other information related to the city planners the projection extend and so on
17:21
So I will Let it open maybe later on if there is a question So I will continue with Yes, so yes
17:44
So We are in the last part conclusion and further research It was the you know, the description of the semi-automatic map creation for the land standard value, which is right now really important in Germany and because
18:02
Right now many quality will decide government will decide about you know, the taxes for each parcel so this project is kind of really important and It was it would help, you know to save time and cost, you know, and This this project is really open. It's it can be, you know, really optimized, you know to be developed to be faster and
18:28
We can continue the coding in for the layer preparation for the Python and To to automize even the digitizing process is kind of you know difficult because and
18:43
The lines the city planner that use they are not following just the you know The parcel border in some cases we would have some intersection this is the kind of you know, really difficult point and Later on we have this chance, you know to visualize this map
19:01
Right now it's in the 2d and we can have the three dimension by using the Digital elevation model and building Heights and so on Thank you so much for attention. I Hope you enjoy
19:20
Thank you so much for the nice presentation. We have plenty of room for questions. Just save some minutes. So please Your question from the audience. Yeah Hello, thank you Did experience some problems with symbology while moving from QGIS desktop to QGIS solver
19:44
Because it's also exist in commercial projects like for easy when you move from desktop to ArcGIS online There are certain symbology Limitations did you experience some limitations with your Python based symbology? Thanks It was it is a really good question actually
20:03
The whole thesis hypothesis was related to the and comparison between the ArcGIS online and the QGIS server Actually, I tried with the ArcGIS online that and you know, I faced too many difficulties because you know, it's kind of you know difficult
20:21
symbology labeling and You need to first, you know convert to the graphics and in some cases is difficult to upload them in the ArcGIS online But the good things to use the QGIS servers you can upload the labels the category or whatever you create in the QGIS desktop you will see in the
20:46
Web by using the lisma book and this is the really great point of using I didn't face any problem But in some cases we need to you know to develop a little but You can you can change to this
21:02
Okay, thank you we are based for other questions Hi, I'm sorry if I missed it. I came late The colors in the map are those parcel classifications
21:21
You mean yes the color or You know, it depends for example. This is the industrial area. This is the you know Combination of we have as maybe you can it's around eight different colors and but you know mostly are you know the pink and the brown because the pink is assigned to the
21:43
Residential area and M which is the brown is and it's a mixed area for the Industrial area and Residential area, okay. Thanks Other questions
22:03
Hi, I have a questions Just last remark if you have maybe You know, I'm not this city planner But if you have any question related to the how to get these values, you know from there, you know city planners architecture, I put some pens here which the name of the
22:23
Companies here and you can you can just connect them or ask question or directly from my side Okay. So now just just a brief question as the problem of styling Everybody knows quite tedious on Did you share some code like for for the rendering of like the Python pre-processing you did?
22:44
Those processing scripts are somewhere and you know I think most of them it's possible to find in the intent in the key tab, you know, I use them but you know that that Kind of you know, most tricky or most challenging part was the
23:04
Rotation angle for each point, you know It was kind of you know time consuming and I think maybe I can upload this into the Usable because maybe someone can save a bit of time and improve. Yeah, we know Okay, I actually have two questions
23:28
yes, so if you You said that you got data that was not Topology topologically identical with the parcels and so
23:44
Could you make some interpolation or you have you you have just first Corrected the topology of the original data That's one question. And the second one is I suppose
24:02
The system in Germany is like very experienced and everything is In order but is there any flexibility for developing countries in your approach and if it if there is not very flexible, what do you recommend to do so that if
24:28
If the system if the archies like archies changes in time How can you make your approach more flexible to adapt to?
24:41
The state requirements so to say thank you. Actually, I will start with the second question You know these three parts database part QGIS part and the web part is you know Related but they can be you know independent from each other. So it means for example, if we have another row data
25:07
so Actually, we cannot use these for example nor beat Extension to to upload them, but I'm sure there is a too much possibility to upload the data into the post-gri SQL and
25:23
After that, it's just you know, the quote the Python code in the QGIS It's just reading the data and you know that the function and it doesn't matter this data is out of the Alki's data or not So it means if we can upload the data for the new countries, I don't know maybe
25:41
For I'm originally from Iran maybe from Iran data So If we can upload this kind of data into the database the other parts it's definitely can be you know assigned and the for the first question if I got correct
26:04
This you know each parcel Has you know Kind of you know, we are not more The data these Alki's data are really accurate data, you know, actually we are we don't check, you know the topological
26:21
you know relation between those but you know the city planners, you know using the Data preparation that I've done for them and you know going to the field, you know to check to how is the data going? you know This this part is kind of you know related to the city planner and
26:41
Architector, you know to see What is happening? You know, I haven't been with them, but it seems like this But if you have some kind of you know more detailed question about this you can contact them or I will connect you with them to get your You know really correct
27:00
Answer. Okay. Thank you. We are perfect on time. So thank you so much And I If you need to change the room, thank you so much. Thank you. Thank you