Wikimedia Cloud Services introduction
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Title of Series | ||
| Number of Parts | 254 | |
| Author | ||
| License | CC Attribution 4.0 International: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/53234 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
| |
| Keywords |
00:00
Computer animation
00:11
Web serviceLink (knot theory)Web pageOnline chatBeta functionKeyboard shortcutGastropod shellSource codeHypermediaRoundness (object)Cloud computingProjective planeComputer virusDifferent (Kate Ryan album)Universe (mathematics)JSONComputer animation
00:55
Link (knot theory)DatabaseWikiWeb pageHeegaard splittingRegular graphFigurate numberKeyboard shortcutPhysical system2 (number)HypermediaGroup actionQuery languageLecture/Conference
01:49
WikiMeta elementLink (knot theory)Parameter (computer programming)Web pageoutputGroup actionValidity (statistics)Query languageElectronic mailing listInformationComputer configurationRevision controlPhysical lawComputer animation
02:25
Group actionMeta element1 (number)Product (business)WordReading (process)Query languageDependent and independent variablesCode
02:51
Revision controlWeb serviceString (computer science)Uniform resource locatorGroup actionSample (statistics)Web pageContent (media)Carry (arithmetic)Online chatWeb browserBeta functionDatabaseTable (information)Table (information)PasswordWeb pageMetadataLoginConnected spaceDatabaseQuery language1 (number)Product (business)Mathematical analysisWritingNamespaceResultantNumberComputer animation
03:18
Revision controlWeb pageTimestampFile formatDatabaseTable (information)Beta functionCodeInformation privacyTerm (mathematics)ExplosionInstance (computer science)Web pageResultantQuery languageElectronic mailing listWikiNumberCodeNamespaceType theorySpacetimeComputer animation
04:16
Group actionLink (knot theory)InformationBlogEmailWeb pageSource codeGradientGastropod shellDemo (music)Cellular automatonControl flowMountain passRepository (publishing)Category of beingOnline helpSpacetimeRobotType theoryComplete metric spaceCodeComputer animation
05:02
LaptopLink (knot theory)Read-only memoryComputer fileCellular automatonControl flowGastropod shellLaptopRadical (chemistry)Computer animation
05:13
MathematicsFormal languageSample (statistics)CodeVariable (mathematics)WikiGastropod shellQuicksortDatabaseSet (mathematics)Multiplication signPoint cloudProcess (computing)Cellular automatonCountingCodeWeb browserRadical (chemistry)WebsiteMathematical analysisWikiNeuroinformatikServer (computing)Error messagePasswordGastropod shellLaptopPhysical systemAverageElectronic mailing listLoginCore dumpJava appletComputer animation
07:42
Inclusion mapRevision controlServer (computing)OracleData typeStatement (computer science)outputComplete metric spaceInformationWikiQuicksortMultiplication signRight angleHash functionWikiDatabaseCore dumpPasswordMetropolitan area networkKey (cryptography)CASE <Informatik>Computer animation
08:41
Server (computing)Revision controlData typeComplete metric spaceInformationOracleoutputStatement (computer science)Ultraviolet photoelectron spectroscopyGastropod shellWeb pageJava appletComputer configurationGradientAdditionFunction (mathematics)Similarity (geometry)Personal area networkParameter (computer programming)Form (programming)StapeldateiLimit (category theory)Computer networkContent (media)PermanentComputer-generated imagerySoftware testingBeta functionUniform resource locatorSoftware developerFeedbackKeyboard shortcutLink (knot theory)Lemma (mathematics)InformationWikiDatabaseRoundness (object)WebsiteRule of inferenceElectronic visual displayWeb 2.0Process (computing)Online helpSource codeServer (computing)Right angleProxy serverPoint cloudCartesian coordinate systemComputer fileCloud computingFunction (mathematics)Projective planeSocial classDescriptive statisticsDirectory serviceMultiplication signWhiteboardInstance (computer science)SoftwareQuicksortHypermediaLimit (category theory)Domain nameCategory of beingMathematicsPhysical systemDifferent (Kate Ryan album)1 (number)Key (cryptography)Metropolitan area networkWordCASE <Informatik>View (database)Service (economics)Point (geometry)Web crawlerDoubling the cubeComputer animation
13:58
Computer animation
Transcript: English(auto-generated)
00:23
Lucas and Amir here and they want to give us a quick introduction of Project from the Vicky media foundation called cloud services and how it might be may be useful to all of us So let's give round of welcoming applause to Lucas and Amir
00:43
Thanks Yeah, hello. So we can media cloud services is basically this big collection of all kinds of different things which are Useful if you want to do technical things in the Wikimedia universe like with Wikipedia or other projects and
01:00
you get them free of charge or you can just use them and The only requirement is that you use them for something that's a kind of relevant to the mission of Wikimedia of promoting free knowledge and that kind of stuff and It's kind of split into the things that you can do with your regular Wikipedia accounts Any registered user can do and
01:21
Then there's also things you need a special account for on a different system called wiki tech and Amir is going to talk more about those Later, but first let's just look into some of the things you can do with your regular Wikimedia account And if you want to follow any of these links, there's a shortcut here. I was about to switch the next step So let's just stay here for a few seconds. Yeah
01:42
So the first thing is the API sandbox, which is if you want to use the media wiki API to Figure out what you have on a page or to make edits or any kind of stuff The API sandbox is a special page that's really useful to find out how to use the API for example, here's all the different actions I can use that say
02:03
Query is the kind of general catch-all action That's here. And then I get down here list of all the parameters I can use with query such as I want to have all the User info and What kind of user info do I want? I want options blah blah blah. I would like to have some different forward version
02:24
So it gives you all these nice inputs for figuring out exactly how to use the API what's valid What's not valid and then you can make the API request and there you get your response and we can't read anything because it's zoomed in way too much, but It's very helpful when trying to use the API and then at the end here you can see what you need to do in
02:44
your own code to make the same API request and for anything that you can't do with a Normal API. So if you want to do some kind of more expensive analysis You can often do that with quarry which is a tool that lets you write SQL queries against
03:03
Databases that are almost like the ones in production like you don't have user passwords and stuff but you have all the database tables with page metadata and Connections between them and the logs and all kinds of stuff and you can just write your SQL here Send it and you get the results. For example, here's the number of Lexi's published per day. So it's some kind of
03:26
Selecting from the page where the namespace is the Lexi namespace and grouping that by the dates and then we get something like All the way down to
03:41
September which is apparently when I ran this query there were Here there were 116 Lexi's created in this day or here someone had a list of edits to JavaScript and CSS pages on Hungarian Wikipedia so you can run these queries against any wiki you like Like this Hungarian Wikipedia one and
04:03
If you can't get by with just SQL what you also have is this thing called pause Which gives you a Jupiter instance if you've heard of that you can basically write your own Python code here and Do it in a very convenient way because there's all kinds of auto completion and helpful things
04:24
so I can just Try to copy this and run the code Then I needed a new cell below it. There we go. Thanks If I type item, I should get helpful hints what I can do with the item
04:45
If it's not hanging or something Or the tap control space. No. Oh, there we go Yeah, and that's also a very useful way to work with pi wiki bots or you can also directly get
05:02
Normal shell here and one thing oops, did I click the wrong thing? I would like to have oh, no, I don't want a bash notebook. I want a new terminal. That's what I want and Here you have for example
05:20
Database dumps in where was it public? Dumps Something public again, so if you want to do some kind of Analysis here on the data dumps you can get them here and then have all the computing time you want I guess
05:43
to analyze the wiki more thoroughly and All this is hosted in the Wikimedia cloud for you and you don't need your own server or anything Oh, yeah, I had two more examples of that for example here I use that to so there were a lot of items on Wikipedia where there was some encoding error
06:02
This should be an apostrophe like down here And instead it was this kind of eye with an accent and I hacked together some ugly Java Python code to make all of these edits and it was already logged in as well I didn't need to worry about logging in or having a password or anything So it's a very convenient way to make edits as well
06:23
Or you can build something nicer here. You can insert like markdown cells To explain what you're doing and how the code works and build nice notebooks like that which are almost self-explanatory and
06:41
Those are some of the things you can do just with your Wikimedia account and now Amir is going to talk about some other things Thanks Lucas so the thing that we can do is that Maybe some of you like me think that doing thing in browser is for kids I need to do things in terminal I need to do connected System and then you can access for a wiki tech account average. You can just make a wiki tech account in
07:05
this place called wiki tech No, no, but I do the main thing the main list Yeah, okay so in here so and then you make a wiki tech account and it gets approved quickly and then you get the shell and
07:23
Then you can just quickly go there. Where's your Yeah, and you can go to this Shell and just login and then you have access to the a big set of nodes in the cloud and you can just do Whatever you want Also, you have access to the core dumps and you have access to the replica database, let me show it to you
07:44
Hold it. Yeah. Okay. So for example, you can go to LS Okay, LS At German layout Dumps and then you can go to
08:01
Selectors Okay public and then dumps slash Public and then slash wiki data wiki and then you get oh, there's like all sorts of time and everything that I want to But if you also you can do something else is that you can just do SQL
08:21
Wiki data wiki And then Okay, and then you're inside the wiki data's database I mean it does you don't have the rights you can you cannot write to the replica because it's a replica And also it's sanitized so it doesn't have there like hash of user password and stuff like that
08:43
but still you can do just select Where is from Recent changes Limit five and
09:07
Yeah, and then you get all of the things that you want to you cannot even describe anything you want to directly into the system and then there is also we have something called the job grid so you can just
09:21
Put the cron and anything that you want to or just It's something around something directly and it goes to the big node of Cloud Kubernetes and then just runs everything that you want to in is here. There's a more information about it in here There's a like a long Help that he says like oh you run this job and then job of what it does and you can get it this
09:45
so you just need to it's a bash command you can run any bash command and Send it. Okay return me this output to the displays and the other places One thing that you can do is also there's a web server you can access everything directly so you can just put a PHP
10:03
file there and into the Apache and then Yeah, for example, this is this is an example that we built together I think To to Christmas ago But this was like you can just see this is a PHP file
10:20
the source code is available and you just copy pasted that source code into like a directory and it it was there and you Every time we click on it and you get most of the edits that happen on description wiki data That might be vandalism and we can fix it also, this is not just the only thing that you can do with this is that
10:40
You can also put a Python flask application is this the Python class And then this can be just a Python application and you can just have the files there And also node.js and Java. There's so many of them Also, you can have own database like you have something that has its own database for example quick categories in here
11:03
has jobs that Here this is This tool for its own built-in database inside our cloud services and its uses just fine You can do that as well And also there's a cloud VPS that it doesn't do any Kubernetes
11:21
It just you can make a VPS of your own and then do whatever you want with it So for example and you get a project and you get the quota. It's a slightly More limited but also you have access to the whole VPS you have pseudo rights on it You can do whatever you feel like about it. So we have like for example this project in here and it's called tools and then
11:43
there's Proxies and you can for example go into that instance and reboot it and Do whatever you want and you can make new instance and look at your quota and look at everything else there And Also, you can also make it even a wiki on one of those cloud VPS systems
12:02
Which is for example we did in here in here if you look at it It's just a wiki and the difference is that for other ones for example for the vandals and dashboard You have tools that wmf labs org and then slash Wdw vd which is the tool itself, but in here we get us our own sub domain
12:22
so which will be wiki data dash like seam dash Lua the wmf labs org and You can even put all sorts of add subdomains for the wmf labs work As long as it's not taken so you can build a media wiki instances or you can just
12:41
Completely new software anything you can put a board presser who cares and then you can use it. It's very simple You have one thing and you can help lots of experience Anything else I Don't think so most important. I would say is tool forage to run your website or
13:05
If that's not enough for you cloud VPS and then you get your own VM where you can do absolutely anything you want as long as it matches those rules and stuff and I think that's it. Are there any questions?
13:20
Hello Thank you very much for the talk. That was very quick. So maybe anybody has a question here I'll give you my microphone to ask it. I don't see any hands No, okay, I don't think we have questions But if you're just too shy to ask I think these guys always hanging around here around the wiki packer wiki
13:46
So if you have anything you want to talk about you'll find them later Okay, then give a round of applause again for Lucas and Amir
Recommendations
Series of 35 media