NGI Search and OpenWebSearch.EU projects
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Subtitle |
| |
| Title of Series | ||
| Number of Parts | 542 | |
| Author | ||
| License | CC Attribution 2.0 Belgium: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/61602 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
|
FOSDEM 2023154 / 542
2
5
10
14
15
16
22
24
27
29
31
36
43
48
56
63
74
78
83
87
89
95
96
99
104
106
107
117
119
121
122
125
126
128
130
132
134
135
136
141
143
146
148
152
155
157
159
161
165
166
168
170
173
176
180
181
185
191
194
196
197
198
199
206
207
209
210
211
212
216
219
220
227
228
229
231
232
233
236
250
252
256
258
260
263
264
267
271
273
275
276
278
282
286
292
293
298
299
300
302
312
316
321
322
324
339
341
342
343
344
351
352
354
355
356
357
359
369
370
372
373
376
378
379
380
382
383
387
390
394
395
401
405
406
410
411
413
415
416
421
426
430
437
438
440
441
443
444
445
446
448
449
450
451
458
464
468
472
475
476
479
481
493
494
498
499
502
509
513
516
517
520
522
524
525
531
534
535
537
538
541
00:00
Open setInternetworkingSystem callSoftware developerInformation privacyInformationNatural numberStandard deviationPrice indexInformation privacyOpen setInternetworkingData structureWeb 2.0Self-organizationSearch engine (computing)Flow separationCartesian coordinate systemCore dumpProjective planeSoftware developerSubject indexingInformation retrievalWeb serviceInformationProgramming paradigmMathematicsComputational visualisticsNatural numberComputer animation
02:30
System callOpen setPersonal digital assistantNatural numberNatural languageCognitionMathematical analysisVisualization (computer graphics)InformationReinforcement learningSystem programmingCharacteristic polynomialSource codePower (physics)Virtual machinePattern languageAlgorithmComputer networkGraph (mathematics)Thermal expansionFormal grammarGraph (mathematics)Semantics (computer science)Query languageScalabilityEndliche ModelltheorieContent (media)Electric generatorTerm (mathematics)Axiom of choiceGenderInformation privacyDigital rights managementSoftware testingBeta functionComputing platformStandard deviationLevel (video gaming)Process modelingOpen sourceDecision theoryInternetworkingFocus (optics)Core dumpSubject indexingCollaborationismProjective planeCollaborationismOpen setPhysical systemFlow separationWeb 2.0Computational visualistics2 (number)TouchscreenArithmetic meanProduct (business)System callPerformance appraisalLink (knot theory)Reinforcement learningAlgorithmObject (grammar)Mechanism designSemantics (computer science)BitVisualization (computer graphics)Open sourceInteractive televisionRight angleCharacteristic polynomialSpacetimePattern languagePower (physics)Numerical taxonomyContent (media)Graph (mathematics)Internet der DingeSoftwareMultiplication signVirtual machineOrder (biology)Thermal expansionSoftware developerDynamical systemComplete metric spaceSoftware testingElectric generatorInterpreter (computing)InformationCognitionInformation privacyComputing platformData conversionDifferent (Kate Ryan album)Core dumpInternetworkingEqualiser (mathematics)GenderInternet service providerVector potentialStandard deviationComputer programmingWave packetComputer animation
08:38
Trigonometric functionsGoogolSound effectNegative numberInformationFeasibility studyMachine visionMathematical analysisPrice indexOpen setCore dumpWeb serviceSupercomputerSystem callContinuous trackVolumeTrailConstraint (mathematics)FrequencyVertical directionPrototypeContent (media)MiniDiscInternetworkingWeb 2.0Point (geometry)DampingProjective planeDifferent (Kate Ryan album)Universe (mathematics)Open setSubject indexingCore dumpWave packetDevice driverNegative numberChemical equationMachine visionSystem callComputer architectureSearch engine (computing)Endliche ModelltheorieBuildingWeb crawlerOpen sourceProduct (business)Feasibility studyNatural languagePrototypeSound effectConfiguration spaceInternetworkingExterior algebraBusiness modelMathematical analysisWeb pageSoftwareTrailVertex (graph theory)Content (media)Computer animation
14:45
Program flowchart
Transcript: English(auto-generated)
00:05
So, thank you, I'm Aurora from the University of Murcia. And I'm Michael from the University of Poisson. And we will be presenting the ng-assert and op-web-search.eu projects. Two sister initiatives for a paradigm change in open search and discovery on the Internet.
00:23
We will have a common introduction and then each of us will delve in the projects that we are involved in. And a short disclaimer before we start. In the last two days at FOSTA we have heard a lot about personal lifetime projects. This is quite different because it's not personal.
00:40
These are European institutions involved and it's not lifetime. But these projects, they are just starting up and have nice ideas and require your attention and contribution. So, ng-search is a European project that will welcome entrepreneurs, tech-dapes, developers and socially engaged people.
01:03
That have challenging ideas about the way that we will search and discover information and data on the Internet. So basically we will fund projects that are focusing on several topics that I will explain in a minute.
01:20
And they are compliant with the European values of openness, transparency, privacy and trust. The applicants can be natural persons and organizations and they can apply individually or as a consortium of three members per team. Open Web Search is a project funded by the EU and has the goal of developing an open European infrastructure for a web search.
01:46
There are several research and computing centers involved. The project started in September last year and has a timeframe of three years. It's quite interesting that it's the first project which is funded by the EU and has the goal of developing Europe's own web index.
02:07
For those who don't know, a web index is a data structure which allows the fast access of web data. It is the fundamental core of all current search engines. And it enables the development of all kind of web search and web data retrieval services.
02:31
So for us, let me present you the project partners. We are Link Novain, Aarhus University, the University of Murcia, OW2 and Fundybox. These are some of our faces.
02:43
We will organize five different open calls and we welcome these innovative projects. We will provide them financial support up to 150,000 euros. We will not only provide financial but also technical, business and innovation support. The projects are expected to take 12 months.
03:03
The first open call is already closed. The evaluation is ongoing and it was a technological-based call, meaning that we were looking for finalized products. And then we will select 9 to 10 projects in the topics that you see on the screen.
03:24
On base voice assistance, on NLP, semantic analysis, social computing and data visualization. But let me delve a little bit more on the second open call topics which may cut your attention. I hope you can resonate with some of them. The second open call will open in April, the 1st of April.
03:43
It's a little bit more research-oriented but please have a look because we have plenty of space for everything. Let me explain each topic. The first one is power cognitive search by reinforcement learning. Basically we look for mechanisms of self-learning and all kinds of algorithms that can contribute to a reinforcement learning system
04:07
that is able to learn with the interactions how to choose the right data and algorithms in order to make any search more relevant towards the objective of it. Then the second topic is machine-based data, internal things data.
04:23
Basically we look for algorithms for search and pattern discovery that are adapted or that can adapt to IoT characteristics. Which means we will look for edge computing, algorithms that can deal with time series, with events, with different geo-localizations and so on.
04:45
We have also AI-based taxonomies. We look for the automatic creation and expansion of existing taxonomies that are machine-based, machine interpretable semantics by using AI techniques. Basically we want to model the dependency among new concepts.
05:03
So we want to adapt to the dynamic and dynamicity of the data. The next topic is network analysis. Basically we want to find other ways to create knowledge graphs which are an interlinked network of distributed resources that can be searched.
05:21
The objective can be to make them more scalable, to test the quality of the creative models, to create different semantics, to make them compliant with diversity and dynamicity of data and so on. Then we have AI-based search tools and content generators.
05:45
As you know, nowadays AI-based content generators are quite popular. Here I have some names that have been coming up in FOSM many times. ChuckTPT, GitHub Co-Pilot, Co-PAI. So we welcome projects that can help evaluate the privacy of these kinds of tools.
06:04
Also look for research and technological gaps on them as well as the completeness of their answers. Then we have the topic of ethics in search and discovery. We want to have projects that specifically focus on testing that the developments of search
06:23
and discovery are compliant with human rights, that they are not biased towards minorities, towards gender. So they promote equality but also they are private and they take care of that confidentiality.
06:44
Finally we have new ways of discovering and accessing information. It's a broad topic so that we don't leave anything behind. How are we going to do that? We are going to provide mentoring and advice on technologies to access, store, manage data and also on algorithms and platforms that are tailored to the projects.
07:05
We are going to leverage the ReachOut beta testing platform for beta testing campaigns. Then we are going to link the projects to different standards and promote conversations with different foundations that will be related to them. We will have a program for market readiness.
07:21
We will create workshops for pitch training so that they can try to pitch their solution or their project to potential investors and users. Business modeling, advice and coaching. As for innovation, we will give information about which kind of open source license they can have,
07:45
they can use, how to manage it and how to make their research and their solutions reproducible. So following open science principles. As to conclude from iPad, the next three years there will be five open
08:00
calls that will challenge the way that we search and discover information on the internet. We have synergies with the NGI mission of looking for a more human centric internet. These are our core values. Open source, contributions to the wider community, collaboration and open science
08:21
principles as well as transversal challenges that include sustainability and equality. I give the floor to my colleague, Ano. Thanks. So now switching to the second system project, open web search. As I said before, there are several computing and research centers involved in the project.
08:44
And it's good this way because all of these have different competences like universities or businesses. And this underlines one specific point about the project in contrary to the web index which is operated by Google for example.
09:01
This project does not follow a centralized approach but it tries to build up a web index collaboratively and distributed among several European institutions. Otherwise it would just not be possible to build up a web index from scratch.
09:24
I will keep the motivation short because it should be clear why it is a good idea to have an own web index in Europe. The first thing is the imbalance in the search engine market. There are four big global web indexes out there from big tech companies.
09:42
And this dominance of these companies has a lot of negative effects on the critical infrastructure web search so to say. And the solution is to strive for more plurality. Another thing is that web data is a driver for innovations.
10:05
And an example, just one out of many examples that has drawn a lot of attention lately is the training of large language models such as JetGPT which works on its basis with web data.
10:25
The project goals are developing the core of an open web index. So two remarks on this point. This will be done with open source and open configuration.
10:42
And it is not expected that at the end of the three years of the project there will be a production ready index. But the goal is to have an index which contains at least 50% of all text web pages. And then that can be worked on and that shows as a prototype
11:04
that it is possible to create it collaboratively and distribute it among several institutions. Another goal is to build an ecosystem around the index and make it publicly available in this way.
11:20
As I said before, it serves as a feasibility study in some way to show that it is possible to do it collaboratively. And that is why along the way it should be established a network among European infrastructure partners. The overall vision of the project is to give open access for innovators and businesses
11:45
and researchers on web data to enable them to build new business ideas for example. Or to work on their ideas on web search and web analysis.
12:03
As for the NGI search project, there are also ways to contribute to OpenWebSearch.eu through third-party calls. There will be three public calls with a fixed amount of funding. And the first of them focuses on the legal aspects of the project.
12:22
There are two tracks. The first one focuses contributions on legal and business and social aspects of web search in general. And the second track focuses on the legal compliance of the crawling. So the acquisition of the data from the internet which is then stored in the index.
12:44
This call will open on the 1st of March this year. There are also other opportunities to contribute which is covered by the upcoming calls. And this course overview of the architecture should just give you a hint on where these contributions can be located.
13:08
So if you have an idea on how to develop a search and discovery application, this can be done for example. As a vertical search engine on top of the web index infrastructure.
13:27
Or it can be a content analysis method which enriches the data which is then stored in the index. So as a conclusion, the OpenWebSearch.eu project wants to open up web search.
13:45
And strives for more plurality to give new business ideas a chance and new alternative search engines a chance. Therefore the project partners collaborate and build up a European open web index which is then publicly available.
14:09
For researchers, innovators and businesses there is the possibility to contribute. Either by developing your own business model which sets upon the open web index.
14:23
Or by involving in one of the three public calls. The first one of them, as I said, opens on the 1st of March. So thanks for your attention and we are open for questions.