Building an open source mapping system for support of regulatory activities in the field of electronic communications networks
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Title of Series | ||
| Number of Parts | 295 | |
| Author | ||
| Contributors | ||
| License | CC Attribution 3.0 Germany: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/43354 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
| |
| Keywords |
FOSS4G Bucharest 2019229 / 295
15
20
28
32
37
38
39
40
41
42
43
44
46
48
52
54
57
69
72
75
83
85
87
88
101
103
105
106
108
111
114
119
122
123
126
129
130
131
132
137
139
140
141
142
143
144
147
148
149
155
157
159
163
166
170
171
179
189
191
192
193
194
195
196
197
202
207
212
213
214
215
216
231
235
251
252
263
287
00:00
Physical systemSturm's theoremTelecommunicationForestPrisoner's dilemmaEvent horizonSoftwareService (economics)Lecture/Conference
00:37
TelecommunicationPhysical systemTexture mappingOpen sourceService (economics)Sturm's theoremBuildingComputer networkWeb serviceFrequencySpectrum (functional analysis)Task (computing)Broadcasting (networking)Independence (probability theory)Presentation of a groupOperator (mathematics)Open sourceMathematical analysisDifferent (Kate Ryan album)SoftwareTelecommunicationPhysical lawRule of inferenceAdditionLine (geometry)VideoconferencingBit rateTorusMultiplication signWorkstation <Musikinstrument>CausalityMetropolitan area networkOpen setComputer animation
02:06
Independence (probability theory)Computer networkService (economics)TelecommunicationDigital mediaComputer animation
02:27
Spectrum (functional analysis)Presentation of a groupComputer animationSource code
02:50
Internet service providerService (economics)Spectrum (functional analysis)Computer animation
03:10
Independence (probability theory)Broadcasting (networking)Computer networkService (economics)Presentation of a groupField (computer science)TelecommunicationComputer animation
03:31
Condition numberTelecommunicationFrequencyEquals signOperator (mathematics)Information and communications technologyService (economics)Spectrum (functional analysis)Content (media)Broadcasting (networking)Digital mediaGroup actionProcess (computing)Point (geometry)Texture mappingComputer networkRadical (chemistry)Local GroupPlanningInformation technology consultingDatabasePhysical systemOpen sourceMobile WebInterior (topology)Application service providerParameter (computer programming)SicAttribute grammarQuiltComputer programmingPoint (geometry)QuicksortRadical (chemistry)CodePhysical lawFile formatMappingMathematical analysisoutputSimilarity (geometry)TelecommunicationFormal languagePhysical systemDifferent (Kate Ryan album)Core dumpProjective planeOperator (mathematics)Information and communications technologyData managementSoftwareHTTP cookieOpen sourceAttribute grammarProcess (computing)ResultantDatabaseUniform resource locatorField (computer science)Server (computing)InternetworkingBuildingWeb 2.0GeometryTable (information)Line (geometry)Right angleArithmetic progressionCentralizer and normalizerOffice suiteAuthorizationForm (programming)Shape (magazine)Multiplication signAreaCuboidSystem administratorTheory of everythingComputer animation
08:56
Computer networkRadical (chemistry)Point (geometry)SoftwarePoint (geometry)TelecommunicationOperator (mathematics)Different (Kate Ryan album)InternetworkingDimensional analysisConnected spaceAreaMultiplication signDialectState of matterLine (geometry)PermanentNumberComputer programComputer animation
10:12
Mobile WebNumberMobile WebComputer programAverageCentralizer and normalizerMereologyBroadcast programmingUniform resource locatoroutput
10:58
Workstation <Musikinstrument>ResultantUniform resource locatorSoftwareoutput
11:30
Cellular automatonResultantMetreOperator (mathematics)NumberInternet service providerAddress spaceWeb serviceTelecommunicationLocal ringComputer animation
12:15
Inclusion mapComputer networkInformationMilitary operationEmailAddress spaceDatabaseTheoryLine (geometry)Computer configurationOperator (mathematics)SoftwareConnected spaceVery-high-bit-rate digital subscriber lineInternetworkingBuildingComputer animation
13:10
Computer networkVideo GenieType theoryTelecommunicationMobile WebComputer configurationInformationService (economics)Mathematical analysisCalculationCAN busInformation and communications technologyAddress spaceTelecommunicationDifferent (Kate Ryan album)PlanningResultantMathematical analysisSoftwarePhysical lawOperator (mathematics)Mobile WebContext awarenessMultiplication signAverageInsertion lossComputer animation
15:22
SoftwareAddress spaceRadical (chemistry)Point (geometry)Connected spaceType theoryUniform resource locatorGraph coloringDifferent (Kate Ryan album)
16:20
Local area networkRadical (chemistry)Point (geometry)TelecommunicationType theoryAddress spaceConnected spaceSoftwareBusiness objectArchaeological field surveyWeb pageCASE <Informatik>AuthorizationTraffic reportingBuildingFinite differenceLine (geometry)TorusComputer animation
17:25
TelecommunicationComputer iconModemLie groupInformation and communications technologyLine (geometry)Electric power transmissionComputer configurationTelecommunicationWater vaporPosition operatorOpen sourceComputer animation
18:36
EmailUniform resource locatorOperator (mathematics)Computer animation
19:13
Finite element methodExecution unitPole (complex analysis)TelecommunicationMobile WebGraph coloringUniform resource locatorCalculationLine (geometry)Operator (mathematics)Field (computer science)ResultantSoftware testingTexture mappingRight angleComputer animation
20:13
TelecommunicationUser interfaceExecution unitNewton's law of universal gravitationConstructor (object-oriented programming)Information and communications technologyLine (geometry)Multiplication signBuilding1 (number)Computer animation
20:57
Addressing modeTexture mappingSoftwareComputer configurationOpen sourceProbability density functionComputer animation
21:20
InfinitySoftwareOpen sourceComputer programComputer animation
21:53
Operator (mathematics)Real-time operating systemUser interfaceFrequencyMultiplication signNumberMathematicsComputer fileState of matterLattice (order)WordAuthorizationRelational databaseSoftwareProjective planeDatabasePoint (geometry)Server (computing)Process (computing)Basis <Mathematik>Electric generatorRadical (chemistry)GeometryArchaeological field survey.NET FrameworkLecture/Conference
Transcript: English(auto-generated)
00:07
Okay guys, so moving from the forest inventory to electronic communication network, so this guy is going to present something interesting for us.
00:22
Thank you. Hello everyone, my name is Tomasz Turm and I work for the Agency for Communication Network and Services of the Republic of Slovenia. I work in this agency for only the last two
00:45
years and before that I didn't know that that kind of agencies exist at all and now I know that every country in Europe has one. I will show you that we are using open source software to make special analysis to support regulatory activities.
01:08
And we are basically independent agency that we are involved in lots of different aspect of regulatory stuff in my country like electronic communication markets, that's the department I'm
01:23
working at and basically we are regulating the telecommunication operators with the offers and the data and when they are doing additional optic fiber lines and we are overlooking if they are doing everything by the laws and they are following the rules and the dates when
01:46
something has to be done. And in that manner I will show you the short video presentation of ACOS so we will understand what all the other regulatory agencies in other countries in Europe, they are doing pretty much the same stuff as we do.
02:29
There's no sound but you can see, that's it I think, so we can go back to the presentation.
03:26
How is it, full screen? Yes, thanks. Basically, you saw how many different fields we are covering, this is like a summary of everything, basically those are the four main
03:43
fields of activities and I work in electronic communications and I will just show you how we set up the system and what kind of data we use and some of the results of the analysis. So basically, all the story about world land mapping in my country started years long ago
04:04
because we needed data to do analysis but the most important here is probably 2012 when the agency together with the Ministry of Public Administration and the Serving and Mapping Authority, they decided that the telecommunication operators
04:24
need to collect and view the data of network termination points. Do you know what is network termination point? Basically, this is a location where the telecommunication operator has an
04:41
equipment then the customers can access to the internet. And this is basically, if you live in a house it's one point and in the big buildings you have also one point and many different apartments and so on. So the year 2012 was crucial and in 2013 there was
05:03
issued the general act where there is obligation for operators to give us the data and if they don't they get fined. And after that in 2015 we launched the whole world land mapping system
05:22
in the agency. We are using Postgres SQL, Postgres on the top, Kugis and Kugis server and all together gives us an opportunity to do good analysis to show the data to operators and general public. We use the special oriented data only the attribute data
05:46
and this is basically all the summary of the tools we are using in this system. We have many Postgres SQL databases, basically at least three. One is operational, the most important one
06:04
it consists of almost 300 tables in 90 schemas. The other one is web database just to extract the data we need for the geo portal that is available to public and we also are doing a
06:21
hive database. That means if you look at the picture on the right I made a database for all the data at least twice a year and so we can follow the progress of collecting network termination point and building the electrical communication lines and so on and we can easily
06:46
then go back in history and see what was how big was the difference comparing to today. In the database we have data from many different sources. All of them except central
07:03
population register are freely available on the web. So basically we can say that in Slovenia we are quite open source data society. That project started in 2015 when there was a law on reuse of the data that were collected with the tax money, basically something like that. So
07:27
all the data are freely available and some of the data we also are doing on our own like the coverage of 4G, 3G, 2G and the fixed broadband coverage. We are doing something like
07:40
that on our own and we get the data from different in different formats like shapes, series, text, AMF, VFS and we are using different techniques and approaches how to load all those data in the database. It takes about two to three days and all the data are
08:03
new and all the data and all the new data are in the database. So we are using most of the of the sort of the code is written in SQL language so this is basically the core of the system just writing the code and using it for the input data, analyzing data and so on.
08:26
And we also then using the similar same tools for special analysis like SQL is the main tool. Some of them is also made with DB manager in cookies and some of the things are also done
08:42
using processing toolbox. And here are let's say some of the results of what we are doing. In this picture you can see the green municipalities are basically the areas, this picture is like I think it's four or five years old, those were the areas at that time
09:05
where they had not optic fiber connection to the internet and there was a state aid and European aid to help the people who lives there so the operators did the electronic communication
09:21
lines and network dimension points. So the next one is we are collecting the download speed per data and this is just a picture so we can imagine how are the download speeds in Slovenia in different regions. The next one is let's say settlement without network dimension point.
09:45
So basically people live there but they don't use internet connection at all. You know if you are on a weekend that's not bad. This one is settlements, it's different the other one where no one lives permanently,
10:05
you have just like temporary settlement and we can use that, this we can get from our data. This one your average number of TV programs per municipality. As you can see we have lots of
10:21
programs and if you look at the northeast part of the country there is a border to Austria and Hungary and there they have more programs and like in central part of the country. This is one of our own layers mobile coverage of 4G is just an example we also are calculating
10:43
the 3G and 2G coverage and it's very useful so we can the people just look at this coverage and they see if there is some kind of 4G available or not. Here are base stations look base station locations like this is 3G example we also
11:05
have all those data and these are the necessary data there's an input to calculate the coverage but for calculating coverage we are using very specific software and the software is not so
11:21
cheap it's quite expensive and it's not spatial software but the results that goes out are spatially oriented. This is another one because we are not allowed to have the data from operators on a single address in that way we are using different grids
11:44
like this one is 200 meters and then we made the summarization on one grid cell and we can then easily show the results like a number of service providers or the number of instructor owners because we have like four main mobile or telecommunication operators in my country
12:05
and some all the others are small but for a really big one they cover the whole country almost so there is a big competition for customers and this year in May I'm proud to say we published or launched Geoportal where all the data we have in the database are shown to the public
12:28
so and you can go and see for your own home address what is the download speed theoretical download speed or if you are buying a house or apartment you can check easily on this portal
12:41
what is the internet connection at that address but the main purpose was to reduce the cost of building very high speed networks so the operators can look one another what they are doing where they are doing so they that we want to prevent that every operator dig its own line but one line
13:02
for all of them and then they hire the line for other purposes like one is the main operator national and the one has an option that other operators can hire his optic fiber lines for customers and basically these are all the data you can see in one place do we still have time
13:30
okay so there's a lot of different things like fixed mobile network averages all different kinds of electronic communications and when we are doing some new analysis
13:46
every year our plan is to publish those results to public because as I know the telecommunications sector all the data we are using are so not widely known to general public
14:01
and I was so surprised what we are doing now I didn't knew anything about that maybe two or three years ago and we want to make a step closer to the general public and to raise the awareness what they can do if they are notified let's say with the operator or with
14:23
the download speed so they can press to the operators maybe to us because we have a quite a big law department so the public they didn't the people they don't know but they can turn on us if they are not satisfied with that operator and then we help the people to get what
14:46
they would like to achieve and if we can go to the I miss mouse but I hope this will open
15:05
yep first there is a disclaimer because we it's written that we are not responsible for any use of data because the data are public and we don't collect them so they're just freely available
15:23
and after that this is my country and let's say if we go to some place oh the collection of network termination point located on the home address and the different
15:58
color like yellow it's a cable blue it's optic fiber red is a copper the black is
16:06
air connection so you can see for every location what is there available and when you click on the
16:26
home address you see who's the owner of telecom of network termination point what is the speed what's the type of the the connection what is the download speed what is the type of the building is it a residential or business object and you can download those data from our reporter
16:48
because it's easier than to you have to go to the survey authority the web page and then it's not so easy because here the data are already adopted for the general use
17:03
and we also allow if you want you can extract the data for one municipality or just one settlement as a all together how many different operators how many network termination points
17:23
and how many case of electronic lines and so on and beside that we are also showing the
17:44
electronic communication lines if you click on one line you also get the data so who's the owner was the how precise is the position of those data and beside that we also put on the other data like
18:13
roads electricity lines waste water gas pipelines heat lines water lines railway lines so basically
18:23
we try to offer to general public all the available data in one place and basically this is like the first portal in slovenia that has this option for general public and let's say so here you see those are the locations of base station 4g from one of the
19:14
operators but what i wanted to show you this is something we did like last year we made drive
19:25
we made drive test so that means that a couple of guys were driving around slovenia they made like 6 000 kilometers and they were measuring the strength of the signal of all technologies for all the operators around slovenia and now you can you can see on this map
19:43
um what was the strength of the signal the green color means that the signal of those locations for this certain operators are good and the red line means that there is no signal and because we are calculating the mobile coverage of certain operator and certain technology
20:05
now we can compare the theoretical calculation with the results that were measured in the field this is the end the last thing but not least uh here are the data on
20:25
joint joint construction that means if there is a company that build that is building something like communication lines or wastewater lines or whatever lines they have to apply to some portal and they announce in which settlement they will build something so all the other
20:44
shareholders or all the other companies they see when where they are building and when so they can join to them so they can dig only once not like five times or three times and so on and nevertheless we also offer the option to make a pdf map of the data shown
21:08
in the portal for general public let's see just to if it works yeah here you see the map of with the legend and everything so
21:24
that's it and i will just say the the use of open source software gives us so many possibilities to basically do whatever we want with so not much programming it's just the idea
21:40
what you have to do thank you yes we are already we showed uh sorry uh yes we showed this project in
22:06
submitting in brussel in poland uh and we are spreading the word because i think this is like state of the art of the geoporters in in europe for now and we are getting new ideas from the
22:21
public we are showing them though that thing so yeah yes
22:57
they send xml files to national server authority and they care they take care of
23:05
just basic quality issues like if the xml is in the right it's properly made and so on yes yes uh now the data we are getting data like three or four times a year two or three times
23:32
a year so it's static but we are now making a project that that we will get only the the
23:40
changes on a daily basis basically so in real time so and hopefully and we will finish before new year's day uh no basically it's when they do some network termination points of other
24:01
stuff they have three months after they finish their job in three months they have to report the the new data to survey authority yeah just just the changes yeah uh yeah agency we take
24:33
care of uh not material stuff like we sell numbers phone numbers to the operators we we take care of
24:43
the frequencies for the tv radio and now the digital uh frequencies and so on and the the users like operators have to pay for use of frequencies and numbers and so on and we this
25:01
is our main uh funding yes they pay for for the numbers and frequencies and so on and they put the data in the database but we are not so strict uh if they don't follow the the dates and so on
25:23
because we have to we must have the good relation with the operators it's a some kind of win-win situation in the end no the the user interface is made in dotnet technology
25:46
yeah but behind that is geo server yeah