We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Fast Global Internet Scanning - Challenges and new Approaches

00:00

Formal Metadata

Title
Fast Global Internet Scanning - Challenges and new Approaches
Subtitle
Or how to become your own ISP
Title of Series
Number of Parts
102
Author
License
CC Attribution 4.0 International:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Current search engines such as censys or shodan give everyone an insight into the global Internet. Unfortunately, they don't provide a comprehensive view of the Internet because you can't access the raw data. Consequently, you have to scan the Internet yourself. Anyone can perform a one-shot scan via Mass-Scan & Co. However, how to build an infrastructure for regular Internet scans that is not blocked after a short time by Intrussion Detection Systems and Spam/Blacklists is not easy. First we will talk about the right scan setup, infrastructure, scan strategies, and data enrichment. We will then take a look at the data and gain common and interesting insights into the structure of the Internet. Current search engines such as censys or shodan give everyone an insight into the global Internet. Unfortunately, they don't provide a comprehensive view of the Internet because you can't access the raw data. Consequently, you have to scan the Internet yourself. Anyone can perform a one-shot scan via Mass-Scan & Co. However, how to build an infrastructure for regular Internet scans that is not blocked after a short time by Intrussion Detection System and Spam/Blacklists is not easy. The following questions must be answered: Which scanning algorithms are used (centralized, distributed, BGP prefix hit lists)? How could you reduce scan traffic? How do I process the data in the long term (up to 600GB / scan)? With which further data do I enrich the scans for further analyses (BGP prefixes, Inetnum objects) ? How do I build the right server without a bottleneck and how do I connect it to the internet (rent a server or become a RIPE-Member/ your own ISP with a /22 IPv4 /32 IPv6 Block)? In the first half of the talk we will deal with these questions. In the second half of the lecture we will discuss real scan data. We will concentrate on the analysis of the network topology and distribution of BGP prefixes, whois blocks and network services of well-known autonomous systems on the Internet. As a further example, we will look at the network structure of a large well-known German hoster, which gives us a good overview of its internal organization of data centers and other services. Finally, we will look at some data and analysis from a security perspective.
InternetworkingChaos (cosmogony)TelecommunicationInternetworkingPhysical systemIn-System-ProgrammierungFlow separationFirewall (computing)Hacker (term)Roundness (object)2 (number)Bookmark (World Wide Web)Data miningControl systemTurbo-CodeXMLLecture/Conference
Alpha (investment)Port scannerInternetworkingExpert systemHacker (term)Information securityCompilation albumFirewall (computing)Address spaceDatabaseComputing platformFAQInternetworkingPhysical systemMeasurementRaw image formatInternet service providerMultiplication signResultantComputer animation
Address spaceDatabaseComputing platformFAQIP addressDatabaseResultantMultiplication signProjective planeUltraviolet photoelectron spectroscopyRaw image formatFreewareServer (computing)Sinc functionConsistencyPoint (geometry)Right angleGoodness of fitComputing platformInternetworkingCategory of beingLecture/ConferenceComputer animation
Web serviceAddress spaceExploit (computer security)Web pageCommunications protocolCodeTelnetPort scannerGoodness of fitPoint (geometry)ConsistencyInternetworkingNumberCodeIP addressPhysical system40 (number)Forcing (mathematics)Arithmetic meanP (complexity)Blind spot (vehicle)Database
Different (Kate Ryan album)CodeConsistencyProjective planeSystem callLecture/Conference
Port scannerWeb serviceProjective planeMassSingle-precision floating-point formatInternetworkingMultiplication signSource codeIP addressElectronic mailing listPhysical systemAddressing modeInstance (computer science)Distribution (mathematics)SoftwareFreewarePort scannerJSON
Server (computing)Computer hardwareComputer networkElasticity (physics)SoftwareArchitectureStrategy gameSystem programmingNetwork topologyWeb serviceDistribution (mathematics)Software frameworkInternetworkingContent (media)Computer networkAddress spacePort scannerMessage passingInternet service providerPhysical systemCloningElement (mathematics)Source codePort scannerMultiplication signSoftware frameworkIn-System-ProgrammierungSource codeServer (computing)Web serviceInternet service providerVulnerability (computing)Different (Kate Ryan album)InternetworkingSoftware maintenanceIP addressResultantEmailDistribution (mathematics)Intrusion detection systemSoftwareMessage passingElement (mathematics)Autonomic computingSingle-precision floating-point formatVirtualizationGoodness of fitSpeech synthesisSpacetimeElectronic mailing listAreaCuboid1 (number)Data managementComputer networkPhysical systemComputer animation
Internet service providerPort scannerExecution unitIP addressMessage passingAddress spaceComplete metric spacePort scannerSource codeElectronic mailing listResultantMedical imagingIRIS-TSpacetimeMass
Vertex (graph theory)Strategy gameSpacetimeInternetworkingAddress spaceIP addressAlgorithmRandomizationComputer clusterInternetworkingSpacetimeSocial classPort scannerNumberMappingComputer virusComputer animationProgram flowchartLecture/Conference
Execution unitInformationElasticity (physics)Object (grammar)Port scannerPort scannerServer (computing)Level (video gaming)Data recoveryProcedural programmingComputer clusterSineDatabaseMassMobile appCartesian coordinate systemDifferent (Kate Ryan album)Type theoryResultantInternetworkingGroup actionInformationTask (computing)Revision controlCommunications protocolUniform resource locatorComputer animationProgram flowchart
Elasticity (physics)Object (grammar)Port scannerInformationTelnetSession Initiation ProtocolFile Transfer ProtocolCommunications protocolRevision controlWeb serviceRippingAddress spaceOverhead (computing)Reduction of orderNumberDatabaseCoefficient of determinationAutonomous system (mathematics)BlogWebsiteIP addressInformationObject (grammar)Physical systemSupersymmetryReverse engineeringAutonomic computingPoint (geometry)CalculationBit rateMaxima and minimaRootSingle-precision floating-point formatCommunications protocolSet (mathematics)NumberRevision controlInternetworkingBitGoodness of fitFilm editingDressing (medical)Particle systemRepetitionMultiplication signGrand Unified TheoryAddress spaceSpacetimeResultantComputer animation
TelnetAddress spaceNumberSource codeOpen setPort scannerStrategy gameIPInternetworkingSpacetimePopulation densitySolid geometryRankingWeb pageInternet service providerAlpha (investment)Multiplication signSimulationResultantPerspective (visual)Source codeInternetworkingStandard deviationComplete metric spaceInternet service providerSingle-precision floating-point formatFrequencyCASE <Informatik>Strategy gameInformation securityPort scannerAddress spaceRational numberPhysical lawUniverse (mathematics)Dressing (medical)MassPoint (geometry)Web serviceRight angleRoutingPeer-to-peerIP addressLecture/ConferenceComputer animation
Hand fanInternet service providerPole (complex analysis)TelnetRecurrence relationData storage deviceComputer hardwareCache (computing)Sample (statistics)RAIDElasticity (physics)Price indexBefehlsprozessorHard disk driveServer (computing)BackupComputer hardwareInternetworkingInformation securityMoment (mathematics)InformationCommunications protocolTelnetServer (computing)Memory managementCache (computing)Bit rateSubject indexingSemiconductor memoryTouch typingRight angleData storage deviceNumberCausalityIntelligent NetworkGroup actionProcess (computing)Proper mapComputer animation
Elasticity (physics)Vertex (graph theory)Pointer (computer programming)Java appletPhysical systemSpeicherbereinigungRead-only memoryInformationProcess (computing)Elasticity (physics)Semiconductor memoryPoint (geometry)DatabaseJava appletResultantVirtual machinePointer (computer programming)Heegaard splittingFlow separationGoodness of fitStructural load32-bitDifferent (Kate Ryan album)Maxima and minimaState of matterOffice suiteBitData structureUniform resource locatorCubeAutonomous system (mathematics)Band matrixComputer animation
Digital filterExistenceMaxima and minimaSupremumServer (computing)Demo (music)Front and back endsWeb serviceData structureDifferent (Kate Ryan album)Server (computing)Content (media)Internet service providerAutonomic computingInternetworkingWeb 2.0Content delivery networkAutonomous system (mathematics)Distribution (mathematics)Multiplication signInformationAreaRing (mathematics)Flow separationWeb pageElectronic mailing listPhysical systemFigurate numberTerm (mathematics)2 (number)CircleComputer animation
Digital filterOrder (biology)Field (computer science)Dependent and independent variablesPlastikkarteSpecial unitary groupServer (computing)SoftwareData structureZoom lensAutonomic computingVideoconferencingInternetworkingTelecommunicationWeb serviceDifferent (Kate Ryan album)Film editingProgram slicingComplete metric spacePoint (geometry)Right angleDatabaseMixed realityPhysical systemDistribution (mathematics)Computer animation
Zoom lensDemo (music)Digital filterSanitary sewerFehlererkennungDrum memoryElectronic program guideMaizeChi-squared distributionInternetworkingAutonomic computingInformationData structureWeb serviceZoom lensRevision controlGoodness of fitComputer animation
VideoconferencingPresentation of a groupDreizehnServer (computing)Data Encryption StandardBackupPresentation of a groupWeb serviceState of matterAsynchronous Transfer ModeServer (computing)InformationArithmetic meanElectronic mailing listIP addressDiagramComputer animation
Server (computing)InformationServer (computing)Web 2.0Web serviceIP addressElectronic mailing listQuicksortNumberInformationFlow separationPhysical systemAutonomic computingBlogData structureRevision controlComputer animationDiagram
Revision controlInformation securityCountingComputer networkZoom lensVideoconferencingWeb serviceSystem programmingClient (computing)TelecommunicationSoftwareDrop (liquid)Interface (computing)Stack (abstract data type)Web browserDescriptive statisticsWeb 2.0Different (Kate Ryan album)Time zonePoint cloudData structureComputer clusterLecture/ConferenceComputer animation
Mountain passCountingWeb servicePoint cloudElasticity (physics)NumberServer (computing)Computer networkOperations researchPublic key certificateManufacturing execution systemSicPoint cloudInformationOperating systemServer (computing)Uniform resource locatorComputer clusterMereologyAutonomous system (mathematics)Web serviceWindowKey (cryptography)Data structureXMLComputer animationLecture/Conference
Public key certificateServer (computing)MaizeElectronic mailing listDomain nameWindowWeb servicePublic key certificateWebsiteServer (computing)Right angleValidity (statistics)Physical systemSoftwareExecution unitLecture/Conference
Alpha (investment)Self-organizationPublic key certificateOffice suiteTransport Layer SecurityVulnerability (computing)Query languageMathematical analysisServer (computing)Internet forumInclusion mapMultitier architectureMenu (computing)Firewall (computing)Vulnerability (computing)Transport Layer SecurityDifferential (mechanical device)Public key certificateMultiplication signSelf-organizationInternetworkingRevision controlMathematical analysisOnline helpPhysical systemCAN busForcing (mathematics)DatabaseRight angleMachine vision
Alphabet (computer science)Alpha (investment)InfinityComputer networkTelecommunicationLie groupSelf-organizationVirtuelles privates NetzwerkSanitary sewerDependent and independent variablesAddress spacePublic key certificateAreaPower (physics)Vulnerability (computing)NumberTelecommunicationServer (computing)Descriptive statisticsCross-correlationPoint (geometry)Physical systemInformationInternetworkingAutonomic computingFirewall (computing)SoftwareControl systemComputer fileObject (grammar)Distribution (mathematics)Bridging (networking)Public key certificateComputer animation
Virtuelles privates NetzwerkExecution unitSimulationAddress spacePublic key certificateDependent and independent variablesSanitary sewerInformationWebsiteSystem identificationDistribution (mathematics)Web serviceMathematical analysisComputer networkNetwork topologyLatent heatCommunications protocolConvex hullPay televisionPoint (geometry)PlanningChannel capacityPower (physics)Public key certificate19 (number)Port scannerAsynchronous Transfer ModeComputer animation
Digital filterInterior (topology)CountingInformationPhysical systemMereologyServer (computing)Autonomic computingFood energyResultantLecture/ConferenceComputer animation
Maxima and minimaCountingReading (process)Online helpWeb pageFood energyObservational studyConvex hullFinitary relationTerm (mathematics)View (database)Workstation <Musikinstrument>Common Intermediate LanguageContent (media)Link (knot theory)Power (physics)SinePiDigital filterEwe languageVirtuelles privates NetzwerkComa BerenicesSoftwareMoment of inertiaRevision controlElectronic meeting systemExecution unitChannel capacityMultiplication signFood energyWeb serviceLogic gateGateway (telecommunications)Electronic mailing listPhysical systemRight angleComputer animation
Computer networkExecution unitDigital filterAddressing modeTransport Layer SecuritySicServer (computing)EncryptionSuite (music)CountingRWE DeaInfinitySanitary sewerInternetworkingVideo gameGateway (telecommunications)Right angleSuite (music)EncryptionMIDIFood energyPhysical systemData structureComputer animationSource code
Digital mediaTransport Layer SecurityAddress spaceVirtuelles privates NetzwerkServer (computing)InformationWebsiteSystem identificationWeb serviceDistribution (mathematics)Mathematical analysisComputer networkNetwork topologyLatent heatCommunications protocolSpacetimeInternetworkingElectronic mailing listMultiplication signSuite (music)ResultantInformationPower (physics)Complete metric spaceSpeech synthesisCommunications protocolPort scannerWebsiteInternetworkingSource codeMathematical analysisData structureArithmetic meanRootAddress spaceVulnerability (computing)Latent heatCASE <Informatik>Single-precision floating-point formatRaw image formatBitNetwork topologyEvent horizonRoutingRemote procedure callDressing (medical)Office suiteForestGauge theoryPersonal digital assistantLecture/ConferenceComputer animation
TwitterLine (geometry)Gamma functionGreen's function1 (number)Port scannerInformationComputer animationLecture/Conference
TwitterComputer networkMultiplication signVulnerability (computing)SoftwareWeb serviceCommunications protocolInformationServer (computing)Software testingProjective planeSurfacePrice indexComplete metric spaceInternetworkingResultantStructural loadDifferent (Kate Ryan album)Limit (category theory)Message passingArchaeological field surveyCartesian coordinate systemComputer animationLecture/Conference
Matching (graph theory)Cartesian coordinate systemDatabaseRevision controlDistribution (mathematics)Vulnerability (computing)FingerprintOffice suiteState observerNumberWeb serviceWeb 2.0Patch (Unix)Channel capacityRight angleVector potentialPosition operatorLecture/Conference
Projective planePower (physics)Roundness (object)Lecture/Conference
JSONComputer animation
Transcript: English(auto-generated)