Geoscience DEVL #2 - GeoDEVL - July 18

Video in TIB AV-Portal: Geoscience DEVL #2 - GeoDEVL - July 18

Formal Metadata

Title
Geoscience DEVL #2 - GeoDEVL - July 18
Subtitle
Data and Analytic Services for the Geoscience community
Title of Series
Author
License
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
2018
Language
English

Content Metadata

Subject Area
Abstract
06.07.18 - Carsten Friedrich, Geoscience DEVL (Data enhanced Virtual Lab). In June & July's TechTalk events, representatives from each of the DEVLs will introduce their projects from a developers' perspective: the problem the project is trying to solve, the tech stacks deployed and to be developed, the approaches of their software development and community engagement while developing tools and applications. The demonstration/discussion of 8 projects are scheduled as follows: DEVL #1 June (1st): Astronomy (Robert Shen), Marine Science (Roger Proctor), Terrestrial Ecology (Gerhard Weis), and Climate (Clare Richards). DEVL #2 July (6th), we welcome speakers from: GeoScience (Carsten Friedrich), Characterisation (Lance Wilson), BioScience (Jeff Christiansen), and Culture and Communities (Sarah Nisbet, Alexis Tindall).
Loading...
Service (economics) Presentation of a group Projective plane Self-organization Analytic set Geometry
Windows Registry Web page Service (economics) Code Number Front and back ends Intrusion detection system Core dump Metropolitan area network Service (economics) Web portal Demo (music) Projective plane Content (media) Sampling (statistics) Physicalism Database Multilateration Cartesian coordinate system Landing page Software Mixed reality Website Spacetime Row (database) Geometry
Addition Collaborationism Service (economics) Presentation of a group Web portal Service (economics) Addition Software developer Debugger Projective plane Physicalism Analytic set Set (mathematics) Virtualization Bit Cartesian coordinate system Front and back ends Process (computing) Repository (publishing) Military operation Endliche Modelltheorie Traffic reporting Geometry
Web page Web 2.0 Web service Web portal Integrated development environment Electronic mailing list Physicalism Code Wave packet
Web 2.0 Scripting language Latent heat Functional (mathematics) Inversion (music) Service (economics) Analytic set Portable communications device
Software Code Physicalism Barrelled space Bit Metadata
Windows Registry Arm Service (economics) Multiplication sign
Overlay-Netz Mapping Personal digital assistant Repository (publishing) Network topology Set (mathematics) Gravitation Virtualization
Web portal Motion capture Analytic set Set (mathematics) Drop (liquid)
Windows Registry Scripting language Mobile app Computer file Data storage device Set (mathematics) Revision control Sign (mathematics) Word Web service Process (computing) Software Network topology
Default (computer science) Service (economics) Code Virtual machine Set (mathematics) Parameter (computer programming) Supercomputer Type theory Befehlsprozessor Semiconductor memory Computer configuration Network topology Mixed reality output MiniDisc Point cloud Spacetime
Email Observational study Webcast Virtual machine Bit Drop (liquid) Code Supercomputer Medical imaging Process (computing) Personal digital assistant Queue (abstract data type) Point cloud Software testing Data logger Quicksort Resultant Physical system
thanks everybody I'll present about the Geo devil work that's work that we've done in the Geo science community in devil that was the umbrella organization there is no scope at the entrance facility in Geoscience in Australia the funding as we all know comes from NZ seed nectar now a RDC Evander send it and their partners in that particular project were apart from Moscow and and were in behind the University of Adelaide the Australian National University and Cesaro and a mess up from Cesaro all right
I'll give a quick summary there are lots of little tart projects we included in the spear devil activity and they've all done amazing work so I'll give a short overview of the overall accomplishments so far number of rows down in one or two particular aspects of it which I'm most familiar with an inch over of interest to the broader community the first thing we've done is created a landing page for all the common services and data portals in the odd scope in the Geoscience space that we that we look after all feel affiliated with so that's the new page available through Leo scope website and you see all kinds of portents listed there as well as references to analytic codes and how they are linked and I'll give a little demo obsessed with bit later on that was developed in this project I think the tech talks also encouraged to talk about technology so this is in particular than angular 6 application and they'd be normal thing about that or the unusual thing about this front-end is that the content is not hard-coded arena in a database that's actually connected to a software registry that we also developed the way is also banned it see funding over the previous couple of years and all the codes that and portals that are listed there are dynamically retreated from that service and if people as soon as people register new services there and you codes will be immediately available and listed here as well the second activity was the launch
of an IDs and minting service ideas M stands for international geo sample number and the idea there is to link physical samples from the world when people go out collect rocks or draw core samples to associate them with a unique number and then this number can be used in references are talking about these samples and tracking these samples that originated as you can imagine in the geo community since its course it's a deal example number but it's reasonably broad in its in the way it works so it can be easily extended to to any physical sample that you want to associate with a unique number we propose that work and and so the opportunities there and actually offer to roll that out ISM as man service and they actually did that work there which i think is fantastic and julia Martin and her team did the great work better that is now available as an air service so the Geoscience community is the first customers rosco and we can see you scientists can mint samples there but if you're interested in your community at the air physical samples and the interested use them eating service please talk to and/or krdc about that service and how you can join that mix activity is the auspice
portal that was developed by a new with oscar and that is the web portal for to make available passive seismic data and kane us hosting around 60 terabyte of the star and this portal will make this available to community the virtual T of physics
laboratory is an data discovery and analytics tool that Oscorp operates that has been developed at become a last couple of years so this project funded some new developments they are we voting it currently was a JavaScript front-end with a Java back-end so we replace in the front end with a wooden angular front end and I think some new features yeah within that project I'll talk about this a little bit more federal as well in addition to these developments and C I did a great work to add actual data sets to make available to the community so they added about more something around 3,000 geophysics services to their repository and they're available through the US for portal or the AG Science Laboratory at your Physics Laboratory you can access this data and process the star of analytic models on that and NCI in collaboration with the University of Adelaide actually transferred about a terabyte I think of magnetic telluric datasets to NCI and there are available through B geometry physics laboratory as well I didn't fill out magnetic to lyrics because I don't know how to spell it took me about six months to learn how to pronounce it but apparently that's like there's a great achievements of all these statuses are now available there in addition to that there were some applications and presentations and outreach activities I'm not listing them all there if you're interested with the interim report for the project lists the moon and you can never lose them plus a broad overview over the the activities that we're undertaking or I have undertaken to find these projects and I'll drill down into it two of those bit more which one is the front end and of
commercial research environment for them the idea there as made to make it easy for people to go to the Oscars I see what web portals web services are available in the community what analytic codes are available there so if you want to try it out yourself you can just go
here to a BRE tour no scoped at org and you will see this page here and currently there is not that much on there yet we just released a couple of days ago but the idea is to grow that and eventually list everything in the community here and make it available so what you see here is all the web purples that are currently on the bielsko umbrella through two Physics Laboratory the discovery portal be an underworld training course based on true paternal books for the token environment and the
ideas and minting service that I mentioned before so that gives you an overview over the web portables if you
are actually looking at specific analytic functionality for example this one here called a script magnetic inversion so if you interested in that and want to know which of these epics we
support that you can click that there and you see if you want to run less you can go to the barrel to your physics lab or a tree and and actually use that code directly there that yeah that's also
somewhat details here we'll show you a bit of the metadata associated with these things but I won't go into detail there it's all backed by the software
registry that we run but that's all in the backgrounds I'm not gonna show that here Peter I don't think there's time for that so what you can do is you can
launch arm one of these services in this
case that you virtual geophysics laboratory that allows you to for example look for data sets and these data sets are not hosted in that laboratory that slings next to report of the trees I think in this case at NCI but they're also Geoscience Australia as repositories you can where they are you can overlay them over
the map so you can get a preview of these datasets so these are gravity anomaly search you can zoom into there so that's what you would expect from
most data portals where this goes further ISM be analytic capabilities that it offers so what I can do here if I find some data set that looks interesting in a one run and latex on that I can select that data set and
capture it and directly from that for liking create an analytics drop me to
sign in here to actually process process that data set directly in the version of word tree for that I submit a job the
data set I just capture the seer I can add I can upload files like in front to other web services if I meet at other data sets to that the next night it connects again to the software registry the software app store I was talking about earlier and here we find the e script that were talking about so I can
select that here again the virtual abroad tree goes to that service it discovers what are the input parameters for that service default values and I can select the data set I had here
let's get that step and mix that all I have to do now to actually execute that code has selected all the data that I've selected is to just services to where to run it we support the negatory research cloud we support Amazon Web Services and we support the region which is supercomputer at NCI you can't see nectar here because they're logged in with my gmail account instead of my account so if you log in with AF you can run an extra but I look in if you log in with the Google account or something like that you you only have the option of Amazon or of agent so if you wanted to run this on Amazon I selected here what I need to do is the select what type of virtual machine or big it should be to run on or if I want to run this on region slightly different parameters here here that just people say how many CPUs they want how many how much memory in gigabyte how much disk space the wartime I click Next here can reveal that and then I can submit
the drawer so this makes it very easy
for people to go to the virtual laboratory that's very easy to discover
datasets so that was backed by petabyte or whatever of geophysics study can browse through their search through their depending on preference and keywords very easy to find analytic codes to run on very easy to provisional month we don't need to know how to use Amazon Web seminar cloud you don't need to know how to start a virtual machine and look after it you don't need to know how to use HPC facility like Rajon sort of PBS system user and so on with all the special laboratory and all that for you in the background it knows how to start virtual machines on Amazon it knows how to put drops in Siskiyou on on Rajon and will do that so you only have to select what you want to do and goes off and does that but might take a little bit now you can see it progress here is currently in provisioning which means it's probably somewhere in the queue so just skip to some other one so once it's finished you get an email you can download the results of the drop in case the job support that you can get a preview image of of the results you get log files and so on you can then start new jobs based on that or you can download the resource to process locally that's just a short introduction to these two technologies I think that's probably in my 10 minutes so thank you very much and any testers Thank You Kirsten we will leave a keyway after all Ospreys are questions can be come - oh never
Loading...
Feedback

Timings

  299 ms - page object

Version

AV-Portal 3.21.3 (19e43a18c8aa08bcbdf3e35b975c18acb737c630)
hidden