Geosocial Big Data Analysis Using Python and FOSS4G with the Case Study of Korean Data

Video in TIB AV-Portal: Geosocial Big Data Analysis Using Python and FOSS4G with the Case Study of Korean Data

Formal Metadata

Geosocial Big Data Analysis Using Python and FOSS4G with the Case Study of Korean Data
Title of Series
CC Attribution - NonCommercial - ShareAlike 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this license.
Release Date
Production Year
Production Place
Seoul, South Korea

Content Metadata

Subject Area
Nowadays, there are many researches on the analysis of Geosocial big data, such as geotweeet and as foursquare venues and OSS(Open Source Software) has an important role on this. In the analyzing geosocial big data, there are several different steps such as data collection, data parsing, data conversion, statistical analysis, visualizing and database management. So, the integrated system architecture and the compatible analysis environment has a key role to acquire the relevant analysis results. The Python programming support the interoperable analysis environment for the various and different software functions and enable to process for geosocial big data in the integrated platforms. FOSS4G support software environment for geovisualization and data management for the collected data. In this study, the way and process of geosocial big data analysis is introduced with case study of geotweet and foursquare venues and the analysis results are presented with the case study of Korean data. For this study, Python API libraries for tweeter(tweepy) and foursquare(pyforsquare) used to collect the geosocial data, and Pandas and Simplejson are used to parse and extract the valid data, and GDAL and PySAL are used to convert and analyze for GIS data. PyTagCloud and WordCloud are used to visualize the qualitative text. MongoDB is used to store the collected dataset and QGIS are applied for the geovisualization.
Beta function Observational study Multiplication sign Execution unit Mass Function (mathematics) Run-time system Code Event horizon Computer programming Machine vision Depiction Twitter Facebook Hypermedia Different (Kate Ryan album) Authorization Social class Physical system Mobile Web Predictability Domain name Curve Dependent and independent variables Key (cryptography) Mapping Mathematical analysis Content (media) Database Funktionalanalysis Instance (computer science) Message passing Uniform resource locator Computer animation Visualization (computer graphics) Object (grammar) Reading (process)
Group action Statistics Game controller Service (economics) Computer file Code Multiplication sign Event horizon Code Machine vision Theory Number Power (physics) Different (Kate Ryan album) Authorization Physical system Algorithm Mapping Mathematical analysis Sampling (statistics) Lattice (order) Limit (category theory) Computer animation Logic Personal digital assistant Internet service provider Order (biology) Text mining Right angle Quicksort Freeware Library (computing) Spacetime
Dissipation Presentation of a group Distribution (mathematics) Multiplication sign Connectivity (graph theory) Execution unit Tape drive Machine vision Number Power (physics) Computer animation Gastropod shell Chi-squared distribution Physical system Gradient descent
Latin square Multiplication sign Source code Set (mathematics) Insertion loss Client (computing) Mereology Data quality Subset Envelope (mathematics) Hypermedia Negative number Software framework Endliche Modelltheorie Position operator Physical system God Electric generator Mapping Software developer Bit Price index Funktionalanalysis Variable (mathematics) Category of being Type theory Process (computing) Angle Phase transition output Quantum Summierbarkeit Right angle Linear map Identical particles Resultant Point (geometry) Dataflow Statistics Observational study Computer file Mass Rule of inference Theory Number Element (mathematics) Goodness of fit Robotics Natural number Metropolitan area network Computer architecture Pairwise comparison Key (cryptography) Forcing (mathematics) Physical law Mathematical analysis Content (media) Variance Database Uniform resource locator Computer animation Personal digital assistant Network topology Physikalisch-Technische Bundesanstalt Text mining Object (grammar) Window Library (computing)
Digital electronics Mapping Observational study Modal logic Mathematical analysis Content (media) Infinity Computer animation Computer network Speech synthesis Quicksort Freeware Family Resultant
Service (economics) Computer animation Mapping Multiplication sign 1 (number) Content (media)
tha assisted not come not from not only was the this is my topic is the users of the classes using ice and what would you be the case study of the of the of but as in all of the all of that is that the end this is very popular and they saw no particular location for the smart so everybody everyone using these kind of modification and it's not included this is this functionality so the bigger as the object of this coding so we call it a little data that shows that so take these 4 solutions data and should treat that from the people and the output of the news from the 1st case suppose famous on so and allow those many messages processes so the time of respondents is up on the top of the new key is copies so also take the 2 correction and beta instance insistence and as the user from vision dying so he must focus on there are competition missile in data collection massive and some visualization and 2nd 1 is a father of some different as there authorities not helping user called crowds quoted the Kepler tubular all tweets should be in this case if he using some of the approach we don't content policies so that he is not focused on that all content that is that people talking about some reading that so in this case for the time he used you use and because they're sitting million I could take for of this but in this case he just that 14 thousand . 3 for the analysis so the user our our spatiotemporal and to follows that he couldn't patents in the use of 3 D and In this case the idea of using promise that this go on this is nestled so the trying to figure find out some of the special relationship with the party did content and on and on other song to depict predictability risk last loser are she be or use so the using the our sentiment of armistice in that so far in this case the using Markov Bayesian learning is the offer so all the film a different resources research using their own authority and for the ICT policies so we can say are these the kind of woman he this the duty on use it has a multidisciplinary aspect of the what respect fully socially at a certain is that we can think of it is the kind of our belong to the social the synopsis of in science and television and media however all data is regulated so and they're all Facebook quote trigger so cool for which these data we need to know how the summary and using the Web for and that there are collecting the data that we need to know that the time is not usually have and who lies in this they that they have a some different approaches like up quality borrow this for and all candidate he because this is the curve this those that the policies and class issues that I go data visualization of to that these data of how to and so on 2 challenges of mobile about these resources like of the tool many depend the height and map that country was care this Facebook and each research such as the own our pharmacist environment nestled like the using the program uses system and the Department of something picky and database and that this goes nestled and you shall be delays and of and that underlies at the various so 30 out event domain knowledge as I mentioned is to belong to socialize each of the subtrees lingustic so my question is like go the society in the interdisciplinary cooperation so that is the way to integrate these method so I found I tried to found the solution from the top was was the and Tyson quiz all place and these units provide some intuition
about the environment and so the rivalry original face free and often and 24 programming and that the provider of it is kind of signed peak APEC is like going by some them that 1 of the people places in the the theory of this especially applies infrared allowable on different kind of library so to the people to the pipeline Our confined for those companies 60 6 so what were the things that kids and there the so unless a laser faces very simple coding about so need to rely on the 2 coding and could be amended so my research purposes so that is something that would have long formalizing these the status of the the using by samples with the that includes all data collection is not on the authorities of collective human quantity muscle and our sentiment analysis and should be ladies and I tried to move again our cases for the analytical and adjusted for the time right so so what you did vision and the space of that unopposed and I'm going to trying to forget some sentiment analysis of broken and to the and should be in the beginning of it surely I'm doing this all around the true years and throughout the so the beginning this was 38 genetic I haven't Nico this off solution needed time and so you send me using instead you get the file is is a simple matter and not about to prove so far we can create power was signed this treaty was statistics and once again we we got the code can convert to true there are much if I and meeting year just after we can't make a that the on the the question there's all by users being the kind I think that he agree where are is usually it has no hard occasion for the person users so there's a limitation like a sort of misidentified 50 close but all from the user so cool you from hold for this reason I had that a couple of months the user the thank 1 user ID which the semantic I switched to use up and I could not on data and that there isn't any monitored so the data come coming out this is in of the due to these just the 1 per cent of they're prepared to 3 now is did increased electrified 7 % Sharon the that comes from the treaties that we have our from the text you can be used for the quantitative analysis that text mining or sentiment analysis and the use and he died weekend our algorithms allow finalize system like of the ago appeared with each other the thing is us very heavy use of right things and because of some of these include so we can make some at or tubular logician and special courses and it also that didn't find it cannot falsify some control analysis until I I I made the true 1 is that special assistants obligation this for Newtonian order and 2nd 1 is so specialties vision agree on duty and 1st these all or for the overloaded this in the time politician this was a little be idea of our collective To our knowledge the of 1st event using sour using the license was killed in the I offer like some heat and personalities the contest but in some of Jupiter to remove it most of to this time so this map shows that he can at all of the of the solution group there all was given you is how you can see there are hot place those come number idea and gives you 1 and then this and I was analyzed the currently the president is obtained Carter worry so of them along heavily is food and now the professional services and so on while in others so this so the seed commonly used or almost there the in many but had most of the day they belong to this country
and 2nd this so so far has that and this is the opposite opinion on I use the number the venue for the the number already you crucial is number of using the opinion and take on someone is that using the chi Woody presenters of comedy I also apply some are has but this and that this shows the our w polymer then I used to have a working population and the mn devices a variable per there are more than and it shows that our central of unit is the 1 known as the showing some kind called last next
is also the a lot you the so or ion lies the accordion our joke is to the power dissipation I'm using the tape the Shiite and it's this shows some of distribution of trading Claudia and some component of the shell of year duty and also twice and that some of these so this so I shows that this vision of the to the courtier actually I correct for all that I can actually get number problem the young last week are just icing on on and can come around to fanciful was the tryptic and this should map shows that the solution of the chip Concordia newsroom it has word and and the reason is that most of them were taken the is shows those of non city I you know I predict the size of the member of the world of that descent putting it so this 1st stage and lasted His system well then down 3 this is out Sunday that obey the delays on that so we they using please and down often down this and this kind of look at and this was a delicate time so it's going in this from going all way the true here is the the kind of going down In the of this is that they leave at time of the year to and I
would also provides inputs answers on the is no i still of of the reason although it to the reason I our collective that text and made somewhat so what was the she was let you to reason so 1 thing that I find is the hypothetical will reduce this the world is a quote from the of take and the she was somebody's into some particular up make up name of the reasons and I use these kind of all of our library and also interesting is that this is a point that the theory of the OK did you that this signal there so most of the distinguish and we think they must properties will do is sit the in
so have a function that the idea of using some of our knowledge from every suffix on of this but this is the the PTB walk I mean and we tried to select a subset from might it have that an idea using independent variable that this 1 and this 1 and making them that is not designed tying there's so many of you know each case may different case there so it was really takes time for the manual so otherwise there is found was by the time big again the actually I bend it the this is the part that's fine but then but this time I can a man is and I have about of 6 analysis of collected data set in the so almost almost the 1 you got over the 1 gigabyte text file again that ended so when the user no really aperture I was using 2 different system 1 is a set of things that for the data collection and analyzing for I use the Windows this that the sum of of the is there so I try to using that has imposed to intuitive this system element and handling the Latin and data and I'm going and I'm going to try to make some make to process for the of the sources so this is a new accident that I'm going to be the walking so here's a social media so about and I use that of that's right for the the races in the summer and the seasonal Python library it's to titles 1 is the dual on client and answers quite while the the major 9 non-trade using the quantum status and somewhat found its flow from his and his crew right because left are all all nature forces now reading this criticism analysis and some statistical analysis was it was for the present and the pond as per the data on analysis notice that the objects and in use up on that so what is this shows the processes so there's a social media time so if has facilitated combo today's database and data quality given funding for debate on desks in case of quantitative data idea making the consent Text Mining Conference on sentiment analysis in the case of of indicators spectra can of flies and policy based on a school feeding you that was in the genetic and reading there's this assistance extend makes mass about what you to Burma so the Socialist especially those of bit that a special idea every and ii using their hospital like use the stand-alone and 5 the database so he is that he's handed tree in the beginning I and type using the law of somebody robots are equipped with I found some unfolding reader book eyes but nowadays the website there's no what you had connected to the fact so I find that time he would have been devoted much the opposite so justify this OK so now I think you and Latin had using about use of Afonso underlying these OK and take those very are high comparability and interoperability and used to use a piece of who you so and as for the sentimental about this and Nanjing to develop and decay and things in the social defeat 14 the quality the tax they converted the this through the 3 variable metaphor Durkheim number a negative number and it from so study would can be used to stop right to further sentiment and mapping of opportunity so this is so just 1 case each man using condemned days this on last July collect 9 months I collect the duty God and sentimental value for the Socialists of high quality but there you and chosen role the value and we know that we can evaluate by using the better as the number of social so he can so these was the key key of pretty good reason for use the result and sentiment policies so here upon certain crossed from molten they're in some in the course of this that of the the text from each of reason and date nite is what files models content in there so it's only has to be different like hiring job because of center of this is distinct and home there is there are 30 you know after phase for the year generations of this of Adam and Eve Johnny's up but it did not like food happened and that this size of this approach it truly frequently the correct here's suggested this happy all pairs rule because the world Jewry there on and they I wouldn't allow us to separate the English so I can now I fumbled community to preserve value but using this cases angle now I would not try to and also anymore re-entry for the positive Wallace's the reason of is it the variance of the of the United so that is very complex and multidisciplinary process and this this this I tried to fit in so my introduction stationary-phase phase inputs putting it's official work I'm not done yet on the coat some of the best statistics we do a place and on and on on the development to work it is on automated present thinking about my 1st question the 2 questions so my 1st question is a general linear map of insertion is uh a big messy and the the most of the data is produced that I mean that generally created by and that in some number of sources and the moon maybe 1 person conjuring and monotonic so and things like that and in the framework for creating the architecture of the framework to you will be displayed earlier I didn't see that the cleaning the in popcorn room for this and they are you considering that is my work the 1st position near the as homologous the objective of this is that my the 2nd question is the when envelope I use use adjudication off the the the the the cell phones that are used for the smart device that are used if so people might maybe tweeting about and even to in a different location than there are no so how would you address at all that you really big enough to think about that to kind of the fun of on thing but there is also some feature although
or to the users signing up on and he was to read this is the use
decision and that this circuit farming out of 10 is you can reasons that belong to the highest true of the mysteries and quality the the region has only 2 the 2nd through 1 that make 70 % all the between having said that the so this but now this many of my many desserts tried to researching kind of heavy use of speech would feed this is kind of 1 of the topics for the resistance think so but I do that for making some of the good results searching and we to make myself more data and is amended as a festival but the case the case is very different from the studies 19 uses some reasons Estonia and us in 1st of and this again in the 2nd 1 the use of what was the 2nd this I was work you might be of course at this value so far was using infinite families of little book all those so all for many common in their reviews on the user's profile in the content but I I know that is available and do this no necessity to have a look some of this and the the this work and I'm a lot has it further there's free text and things like that this sort of outside of geography but there's also a lot of hashtags used or characters Imojean's things like that we you able to process any of those a map any of those in your sentiment analysis on our and that the net work hours a
neuron in the of the user
it is on the yeah like this time as you is that is that map to listen and so 1 quantitative content all is supplied through you know made songs you using these new ones that will be the by what now I have to it added manually as I mentioned the the the the foreign-educated price and the using some or ivory or some of whom were of for the world to get the value of the sentiment In the using your using these services last year my all while dictionary for the for the gift that if