We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

IoTPy: Python + Streams + Agents for Streaming Applications

00:00

Formal Metadata

Title
IoTPy: Python + Streams + Agents for Streaming Applications
Subtitle
Ingest and analyze streams of data generated by sensors, social media an other sources.
Title of Series
Number of Parts
130
Author
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Sensors, social media, news feeds, webcams and other sources generate streams of data which are analyzed to control actuators, generate alerts, and feed displays. These applications process streams on onboard computers, such as the Raspberry Pi, connected directly to sensors, and send summarized information to the cloud for further processing. These applications have two characteristics: (1) Concurrency: The applications are concurrent using multiple threads to connect to sensors and actuators, shared memory across multiple processes on multicore machines and message passing for distributed systems spanning multiple computers. (2) Data Analysis: The applications use programs from a variety of libraries including those for signal processing, machine learning and natural language processing. Developers of streaming applications can use open-source software to deal with both characteristics. Concurrency: multiprocessing.Array can be used to construct shared-memory multiprocessing Python programs in multicore computers, and frameworks such as APMQ and Kafka can be used to build distributed applications. Data Analysis: A vast collection of open-source Python libraries can be used to analyze data in streams. Developers of streaming applications encounter an impedance mismatch between the software libraries that address these two characteristics. The next paragraph describes the mismatch and how IoTPy addresses it. Programs in most software libraries apply a function to data, get results, and terminate execution. By contrast, streaming applications are perpetual processes that analyze endless streams of data. IoTPy helps developers: (1) build non-terminating streaming applications by harnessing conventional terminating programs from Python’s huge base of libraries and (2) create multithreaded, multicore and distributed Python applications by simply connecting streams to each other.
Cartesian coordinate systemStreaming mediaPiTouchscreenMeeting/Interview
Open sourceSocial softwarePoint cloudSpacetimeComputer networkProcess (computing)VideoconferencingVector processorBuildingThermal radiationIncidence algebraDependent and independent variablesStreaming mediaThread (computing)Message passingComputerSoftwareVirtual machineShared memorySystem programmingFunction (mathematics)outputInversion (music)AbstractionParallel computingComputer programOpen sourceFreewareContrast (vision)Inverse elementComputerWorkstation <Musikinstrument>Hazard (2005 film)TwitterType theoryDeterminismDifferent (Kate Ryan album)Thread (computing)Data structurePoint cloudParallel computingMathematicsGroup actionMereologySemiconductor memoryFunction (mathematics)CASE <Informatik>Streaming mediaWordData streamCartesian coordinate systemThermal radiationAbstractionProcess (computing)Similarity (geometry)Internet der DingeUniform resource locatorVariety (linguistics)Service (economics)Data storage deviceShared memoryGraph coloringAreaLength of stayInheritance (object-oriented programming)Student's t-testSystem administratorFunctional (mathematics)Power (physics)outputLibrary (computing)SoftwareCodeVideoconferencingInformationPoint (geometry)Message passingBlack boxInvertible matrixProcess (computing)Computer programCondition numberInverter (logic gate)TheoryAnalytic continuationXMLComputer animation
Streaming mediaTape driveFunction (mathematics)Thread (computing)outputShift operatorPunched cardCodeDiagramComputer networkData structureLibrary (computing)Parameter (computer programming)PermanentArithmetic meanState of matterFunctional (mathematics)Streaming mediaInverter (logic gate)Function (mathematics)outputObject (grammar)TheoryFunctional programmingLibrary (computing)Matrix (mathematics)SequenceCore dumpInverse elementArithmetic meanLevel (video gaming)Right angleMultiplication signMatching (graph theory)Internet der DingeState of matterGraph (mathematics)EllipseElectronic mailing listWindowMusical ensembleThread (computing)Contrast (vision)Shift operatorCodeDiagramSoftwareDifferent (Kate Ryan album)Element (mathematics)Type theoryCASE <Informatik>Tape driveLinear algebraMathematicsData structureDemosceneSystem callPhysical lawWordResultantBoundary value problemAtomic numberStandard deviationLengthDampingComputer clusterPower (physics)Radical (chemistry)Computer animation
State of matterFunctional programmingForm (programming)Thread (computing)Virtual machineConcurrency (computer science)Shared memorySystem programmingMessage passingFunction (mathematics)outputPositional notationProcess (computing)Read-only memoryComputer networkCommunications protocolImplementationStreaming mediaComputer programmingProcedural programmingControl flowSequencePresentation of a groupSoftware frameworkInterface (computing)Temporal logicTheoryParallel computingComputer simulationDiscrete groupEvent horizonNichtlineares GleichungssystemAlgorithmVideoconferencingOpen sourceComputing platformFunctional (mathematics)Shared memory2 (number)Function (mathematics)String (computer science)CuboidComputerCASE <Informatik>Communications protocolProcess (computing)outputSoftwareThread (computing)Internet der DingeSoftware frameworkLimit (category theory)LaptopMultiplication signProcess (computing)Point cloudMultilaterationWebsiteSocial classNichtlineares GleichungssystemStreaming mediaObject (grammar)Declarative programmingRight angleComputer programInterprozesskommunikationFreewareKey (cryptography)MathematicsPoint (geometry)Student's t-testMessage passingSemiconductor memoryParallel computingLibrary (computing)Procedural programmingProgrammierstilCodeBlack boxPhysical systemOpen sourceInformationState of matterImplementationFunctional programmingForm (programming)Event horizonData structureSimulationCartesian coordinate systemPresentation of a groupMixed realityMatching (graph theory)Computer animation
Computing platformLibrary (computing)Multiplication signMulti-core processorThermal radiationTwitterTheoryComputer programHookingShared memoryComputerOpen sourceCore dumpLibrary (computing)Programming paradigmLaptopInformationInternet der DingeWindowSoftwareCartesian coordinate systemProcess (computing)PiSemiconductor memoryPerfect groupXMLUMLMeeting/Interview
Internet der DingePiMeeting/Interview
Transcript: English(auto-generated)