We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Ensuring data integrity with asynchronous programming in a cloud IoT core

00:00

Formal Metadata

Title
Ensuring data integrity with asynchronous programming in a cloud IoT core
Subtitle
Python3.6, AsyncIO, Flask, RabbitMQ. A simple and powerful combination for IoT data integrity.
Title of Series
Number of Parts
130
Author
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Undoubtedly this will be the decade of low-cost and high-performance cloud IoT core development. All cloud IoT solutions will have to meet the same two fundamental requirements: Performance and Data Integrity. Having said that, AsyncIO comes to mind. While researching similar topics on cloud IoT solutions, we noticed that the vast majority of such solutions primarily includes performance. In this discussion we would like to demonstrate how you can ensure that a low-cost, fast developed cloud IoT core can ensure that its data is not corrupted and is accurate for the user. Technically speaking, it is very interesting to analyze how a bucket of async/await tasks can handle (consume or even produce) messages from or to message queues, interact with other (even non pythonic) modules inside the core, manage socket connections and many other functionalities that make Python3.6+ the heart of any IoT core. Note that it is equally important to check imported data with periodic tasks, acquire statistics from devices and sanitize database data in order to ensure data integrity. Our goal: Firstly, to encourage new developers to get involved with cloud IoT cores and use Python and AsyncIO as the heart of their core. Secondly, as new developers we would like to show our logic and our prefered python libraries and techniques in order to receive feedback from more experienced developers. We are a team of software engineers located in Athens, Greece working for a fast growing startup in San Francisco (https://www.veturilo.io). We have developed our own cloud IoT core for a vehicle fleet management SaaS.
Data integrityComputer programmingCore dumpPoint cloudSoftwareApache ForrestComputer networkObject (grammar)Customer relationship managementMagnetic-core memoryServer (computing)Euclidean vectorTheoryService (economics)ImplementationDatabaseGateway (telecommunications)File formatPresentation of a groupInternet der DingeZoom lensHand fanServer (computing)Cartesian coordinate systemMethodenbankSoftware bugInternetworkingPoint cloudCustomer relationship managementDatabaseMereologyDataflowProjective planeCore dumpData integrityService (economics)Data storage device2 (number)Magnetic-core memoryOperator (mathematics)CASE <Informatik>Error messageOrder (biology)Gateway (telecommunications)Ideal (ethics)Goodness of fitCodeState of matterOffice suiteComputer programmingAreaSelf-organizationDecision theoryLevel (video gaming)Lattice (order)Product (business)GradientComputer animation
Data integrityData storage deviceData integrityError messageSoftware developerBlogAreaCharacteristic polynomialForestRoutingEndliche ModelltheorieWordGoodness of fitPrisoner's dilemmaOrder (biology)Data storage deviceInformation securityService (economics)CASE <Informatik>2 (number)Level (video gaming)MethodenbankDatabaseView (database)Internet der DingePoint (geometry)Multiplication signChainComputer animation
File formatDatabaseGateway (telecommunications)Connected spaceIndependence (probability theory)Event horizonInstance (computer science)Dependent and independent variablesThread (computing)Internet der DingeService (economics)Data transmissionMultilaterationImplementationThread (computing)Scripting languageComputer programmingLoop (music)BefehlsprozessorMixed realityMetric systemTask (computing)Service-oriented architectureMethodenbankMessage passingCodeInstance (computer science)Computer fileData integrityBoss CorporationOrder (biology)WordHand fanGoodness of fitEndliche ModelltheorieOffice suiteDoubling the cubeMenu (computing)
Task (computing)2 (number)Physical systemExecution unitMultiplication signOrder (biology)Office suiteStatisticsConcurrency (computer science)WordThread (computing)Task (computing)Queue (abstract data type)Block (periodic table)
Thread (computing)Task (computing)Concurrency (computer science)Instance (computer science)Address spaceMultiplicationNetwork socketMethodenbankGateway (telecommunications)DatabaseQueue (abstract data type)Service-oriented architectureMessage passingComputing platformBlock (periodic table)CodeCAN busLoop (music)Broadcast programmingEvent horizonInternet der DingeDependent and independent variablesExecution unitProcess (computing)Point (geometry)Level (video gaming)Service (economics)Message passingCondition numberComputer fileTask (computing)Multiplication signMethodenbankLoop (music)Repository (publishing)2 (number)Linked dataThread (computing)Different (Kate Ryan album)MultiplicationQueue (abstract data type)Connected spaceDatabaseCore dumpPhysical systemData integrityInternetworkingMereologyOrder (biology)Event horizonGateway (telecommunications)Library (computing)Service-oriented architectureAsynchronous Transfer ModeLogicKeyboard shortcutLimit (category theory)Computer multitaskingNetwork socketCodeBoss CorporationFamilyAreaWeightData storage deviceCASE <Informatik>BlogOperational amplifierDiffuser (automotive)Symbol tablePattern languageTablet computerOpen sourceSimilarity (geometry)Error messageDistancePhysical lawPlanningGreatest elementNatural numberEndliche ModelltheorieFerry CorstenGroup actionForestComputer cluster
Task (computing)Loop (music)MethodenbankEvent horizonQueue (abstract data type)ImplementationMagnetic-core memoryGateway (telecommunications)Error messageRange (statistics)FrequencyFlip-flop (electronics)Service (economics)Data integritySynchronizationSign (mathematics)Message passingService-oriented architectureSoftwareLogicCodeDrop (liquid)Software repositoryLogicArrow of timeKeyboard shortcutMagnetic-core memoryData storage deviceMessage passingElectronic mailing listDatabaseFrequencyLoop (music)Computer-assisted translationEvent horizonData integrityInfinityCore dumpCodeGraph coloringArithmetic meanCoordinate systemScripting languageService (economics)Patch (Unix)Repository (publishing)Fraction (mathematics)Content (media)Multiplication signQueue (abstract data type)Internet der DingeFunctional (mathematics)Order (biology)MethodenbankMechanism designAdditionData qualitySystem administratorMultiplicationTotal S.A.Software developerFeedbackTask (computing)DataflowShape (magazine)Stability theoryMedical imagingMereologyMonster groupMathematicsSelf-organizationDigital photographySet (mathematics)FamilyResultantForcing (mathematics)Revision controlElectric generatorImage resolutionBasis <Mathematik>Presentation of a groupAreaError messageFault-tolerant systemMassForestWeightProduct (business)Insertion lossWord
Drop (liquid)Software repositoryData integrityEndliche ModelltheorieShared memoryCollisionLocal ringThomas BayesMultiplication signGame theoryAreaInsertion lossMachine visionMessage passingTrailRepository (publishing)Core dumpConcurrency (computer science)CodeComputer animationMeeting/Interview
Transcript: English(auto-generated)