We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Using NoSQL & HTML5 Libraries To Rapidly Generate Interactive Web Visualisations Of High-volume Spatio-temporal Data

00:00

Formal Metadata

Title
Using NoSQL & HTML5 Libraries To Rapidly Generate Interactive Web Visualisations Of High-volume Spatio-temporal Data
Title of Series
Number of Parts
95
Author
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language
Production PlaceNottingham

Content Metadata

Subject Area
Genre
Abstract
Twitter has developed over the past few years into a potent source of public opinion and comment. The service passed 500 million users in June 2012, collectively posting hundreds of millions of tweets each day, and several high-profile analyses of this data (such as the Twitter Political Index, which mapped sentiment across the US towards the 2012 presidential candidates over the course of their campaigns) have demonstrated its potential for insight and near-time customer feedback. Handling such large volumes and throughputs of data is a sizeable engineering challenge, however, and several commercial ventures (TweetReach, Tweet Archivist - many others) have sprung up specifically to deal with this complexity - at a cost. In addition, many existing solutions are unable to properly utilise the location data that is present in a significant proportion of tweets, losing out on the rich geographical context. This retrospective aims to demonstrate how an informed coupling of emerging open-source component technologies can be used to resolve the complex problems of i. large stored data volumes, ii. real-time streaming input, iii. concurrency of writes and iv. geographically querying and visualising results - with a minimal development outlay. Specifically, the construction of an open-source process to read, process, write, query and visualise streaming, geolocated Twitter data using the MongoDB NoSQL database and D3.js JavaScript library will be detailed, focusing on how MongoDB handles real-time spatial data (including spatial indexes & querying) and the unique features that make D3 so well-suited to visualising and exploring spatial data in the web browser.
Visualization (computer graphics)World Wide Web ConsortiumLogic gateSoftware engineeringLaptopMereologyHypermediaMultiplication signInferenceSummierbarkeit
VelocityVolumeSource codeQuicksortSource codeComputer configurationUniform resource locatorRight angleDefault (computer science)System administratorStructural loadTwitterMessage passingFile formatForcing (mathematics)Computer fileShape (magazine)Product (business)Boundary value problemLine (geometry)Computer animation
TwitterQuicksortPersonal digital assistantTwitterProcess (computing)Visualization (computer graphics)Software testingSource code
Attribute grammarAreaVolumeVelocityMethodenbankFocus (optics)Software developerStreaming mediaComa BerenicesPresentation of a groupGeometryAreaCartesian coordinate systemTwitterMethodenbankInformation privacyChannel capacityMultiplication signRow (database)Moment (mathematics)Parameter (computer programming)MultilaterationWorld Wide Web ConsortiumLoginDependent and independent variablesWebsiteMachine codeEstimatorRuby on RailsLine (geometry)BitElectronic program guideSoftware developerFormal languageDatabaseStructural loadStatement (computer science)Operator (mathematics)GeometryMetadataQuicksortNumberPhysical system2 (number)State of matterFault-tolerant systemExecution unitWeightConnected spaceSampling (statistics)Software frameworkMaize1 (number)Streaming mediaGoodness of fitVideo gameSubject indexingXML
World Wide Web ConsortiumGeometryPoint (geometry)Attribute grammarOperations researchDatabaseDatabasePoint (geometry)Operator (mathematics)QuicksortMethodenbankGoodness of fitElectronic mailing listTwitterRange (statistics)Dot productVisualization (computer graphics)Structural loadWordTouchscreenGeometryAttribute grammarDifferent (Kate Ryan album)World Wide Web ConsortiumMultiplicationPattern languageNear-ringImage resolutionWeb applicationMedical imagingMathematical analysisStreaming mediaMultiplication signSpacetimeDependent and independent variablesProjective plane2 (number)Spring (hydrology)Web browserWeb pageMathematicsNetwork topologyBoss CorporationComputer animation
MathematicsGeometryData conversionLine (geometry)File formatRange (statistics)Transformation (genetics)MaizeComputer fileoutputFunction (mathematics)Level (video gaming)Key (cryptography)Subject indexingMultiplicationWordData structureDatabaseTable (information)Equivalence relationData conversionLine (geometry)Workstation <Musikinstrument>CodecFile formatRight angleTransformation (genetics)SpacetimeRange (statistics)Atomic numberFunction (mathematics)Dependent and independent variablesVariable (mathematics)State of matterStructural loadSoftware developerQuicksortExecution unitProtein foldingComputer configurationChemical equationRelational databaseWordProcess (computing)Subject indexingShape (magazine)Figurate numberElectronic mailing listComputer fileMathematicsComputer programmingQuery languageField (computer science)MassMachine codeAutomatic differentiationoutputWritingCoordinate systemOpen sourceMultiplication signTwitterXML
Revision controlMathematicsFeedbackMoving averageCodeComa BerenicesINTEGRALTwitterMetropolitan area networkDependent and independent variablesProcess (computing)FreewareMathematicsMultiplication signRight angleInteractive televisionInterface (computing)Game theoryWorld Wide Web ConsortiumFlow separationLine (geometry)Boss CorporationUniverse (mathematics)Moment (mathematics)FeedbackRevision controlMachine codeSoftware developerVisualization (computer graphics)QuicksortHydraulic jumpMereologyXMLComputer animation
Coma BerenicesWebsiteTwitterControl flowMeeting/Interview
Transcript: English(auto-generated)