Rewards and Incentives for Open Science: A global registry, a global collaboration

Video in TIB AV-Portal: Rewards and Incentives for Open Science: A global registry, a global collaboration

Formal Metadata

Rewards and Incentives for Open Science: A global registry, a global collaboration
Title of Series
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Release Date

Content Metadata

Subject Area
The Open Science Conference 2021 is the 8th international conference of the Leibniz Research Alliance Open Science. The annual conference is dedicated to the Open Science movement and provides a unique forum for researchers, librarians, practitioners, infrastructure providers, policy makers, and other important stakeholders to discuss the latest and future developments in Open Science.
okay now without further ado we have the great pleasure this morning we have two distinguished uh speakers for us first we'll be hearing from hillary hannah hoy and then second from celine heinel our first speaker with hillary and as claus said yesterday we are informal so we can go with first name basis even if we have many professors directors and doctorates but hillary i wanted to say just a few words about you and your organization hillary is with the research data alliance in beautiful italy and the research data alliance which is known as the rda is a research community organization started back in 2013 by the european commission the american national science foundation and national institute of standards and technology and the australian department of innovation so it really was a very very global innovation its mission is to build the social and technical bridges to enable open sharing of data and it continues to grow the rda has over 9 000 individual members from 137 countries absolutely fantastic success in the past couple of years today hillary will talk about rewards and incentives for open science a global registry a global collaboration the registry is currently being designed and developed in an open and collaborative way so without further ado hillary can you see and hear me okay i can david can you hear me we hear you fantastic wonderful great and i know you're in italy could you tell me exactly where you are in italy oh i'm in a tiny little village of six thousand inhabitants called kalchi which is just outside uh pisa so it's central italy okay very close to the leading tower very good and one thing that you would say in your town that you you i know it's next to pisa but in your town in your city something to see or something special about it in case yeah we're so fortunate here we have an amazing what they call i think they translated in it in english into a charter house so it's a fantastic old monastery but it has the largest uh national history uh museum in italy in it so in our tiny little village we have that uh wonderful uh place to visit wonderful i mean i love germany but one of my big reasons for loving it is being so close to italy beautiful country very good okay then without further ado two things also to our audience as we did yesterday please feel free to bring in the questions and we'll go through with that that's a great job and i think without further ado to both our speakers we have about 20 minutes for the talk and then about 10 minutes for q a so hillary please the digital stage is yours thank you
so much david uh there's my slides so uh thank you very much to the organizers for this very kind invitation to speak to you all uh this morning or this evening or wherever you are in the world thank you for joining us i saw some figures yesterday that showed a wonderful uh participation and as an organization the research data alliance that itself organizes virtual uh or on a six monthly basis we've gone virtual too and uh while the disappointing part is that we can't all sit and look at each other and i can't see your faces as i speak to see are you interested or would like me to move on and on the other hand virtual meetings are allowing um many many more people to access and to listen to the uh things that we have to say and to learn and to share experiences so that's the upside of this downside so um i would like to talk to you this morning about um a global collaboration a registry for rewards and incentives for open science or indeed we probably should be it's probably better to call it a research assessment uh registry the um so the of course i'm not alone in my my slide is moving on or not um so i'm not alone in this quest uh of course as you can see there's a powerhouse of uh directors and people ladies of course uh supporting in this volunteer effort at this moment in time um and each of us have our day jobs and things like that but why are we all doing this well as the story progresses as i talk to you after these next few minutes you'll see that there is the context and the background to why many of us are involved in it at the moment but of course um also i think i could say from having up from working with these uh wonderful group of people is also the real understanding that this is a must what we propose and what we are working together with many many others around the world to do is something that is really fundamentally required now so but i do want to give a shout out to them because it's truly as i said a volunteer effort on their behalf so
why does all of this matter well i mean you know the conference is the open science conference so i hope that i am preaching if you like to the converted about uh you know open science is really fundamental it's been talked about for many years we hear and we see that there has been lots of progress particularly with the pandemic that we are all living in and it has uh has um you know driven us to to reflect more and to actually practice it more but it's true that um you you know there's still many challenges and i think anna in her wonderful opening presentation yesterday uh presenting and giving us updates on the unesco activities show you know said that there are many many complexities there are many challenges many nuances to the whole um open science and open research aspect and one of the things that i loved or the things that i'd like to pick up it's not a quote because i'm not sure if i word it exactly but she did say that looking to the future young scientists are keen to share you know it's in their dna and we know that now they're we are they're the digital if you like um generation but career assessment and how they're valued within the institutions are not in line with the open science policies and the practices that are being proposed and that are being you know shared and i saw yesterday while i was watching the twitter feed on the open science um you and bernie who's a you know a wonderful scientist himself had that lovely quote to say you know open shared data simply data simply realizes synergies for science it's as simple as that science is best done in the open so really the uh the thing is that we all advocate for uh open science and and but again the people on the ground the scientists and the researchers involved we talk about how they need a cultural and a behavioral change but we need to support that that's on us you know those of us who are in a position to do so who are working in this field we need to help them to do that and we must practice what we preach we have to be open and we have to be transparent and we have to um allow them uh you know in the assessment in the change around rewards and incentives we must show and demonstrate and illustrate the practices uh and that are going on in the world so that they can learn from that so what are the origins um of this well open science is there's a delay here so so um the background if you like for this uh for this registry that i will talk to you about comes from of course uh work uh that was done over four years by the open science policy platform and one of the uh i extracted a quote if you like from the report which i like the the last part of it that open science must ultimately be embedded as part of a larger and more systemic effort to foster all practices and processes that enable the creation the contribution the discovery and the reuse of research knowledge in a reliable effective and equitable way and it can't research science they can't be excellent we can't ask for excellent science without these sort of attributes at their core so this uh as i said the the shift if you like to open science within this open science policy platform was set up in 2016 and by the european commission and it had a series of i think it's over 25 different stakeholders who represented many many different um pan european and indeed global in the case of the research data alliance and others um organizations to discuss um and to talk and make recommendations on open science and they in the first mandate so it was split into two mandates in 2016 and 2018 they delivered a series of recommendations and of course the challenge in adoption was already very very apparent then that the current evaluation system forces researchers to focus on the research articles and to seek publication in high impact venues and that is clearly not incentivizing open research open science behaviors and in the second mandate uh from 2018 and 2020 the focus then um in in together with other things was on the shift how to shift the focus of res rewards and incentives and to um support this uptake of next generation metrics so um the report which is really available on the internet the progress on open science towards a shared research knowledge system um and have these two fundamental recommendations which are the basis for why we talk today and why we started the work on this research assessment registry so uh the problem the platform itself called for pilots and implementations of responsible metrics and made a clear call for the creation of a registry to support these assessment and mechanism
so just why you wonder well why uh is the research data alliance involved in this david gave you a slight uh in the introduction uh to my to me this morning david mentioned the uh organization that i work for the research data alliance i am very proud and very honored to be the secretary general of a wonderful global community of over 11 and a half thousand um individuals and data practitioners from across 146 countries across the globe we have over 60 organizations who are members and who support the work but fundamentally the research data alliance is an international it's a community driven and a volunteer organization and as i said we have this global community of data practitioners and experts that are committed to the principles of open science of open research of fair data and they work together in different ways to um build these technical and social bridges and rda is founded on uh six fundamental guiding principles of openness of consensus that things are community driven that there's harmonization and inclusivity and all that's done and all that's produced and that it's not for profit and technology neutral and so the research data alliance among old group of organizations that were in the policy platform offered to spearhead and coordinate uh this work in a collaborative cooperative and co-creative way and that is how we work and that is how um we intend to support this alliance so just let me be very clear it's not the research data alliances
uh registry it is the community's registry but somebody needs to uh support it and coordinated and together with the colleagues and their organizations that i showed at the beginning and more besides um we are driving ahead with this so what already exists you know there's lots and lots of uh there are lots of things so what what really exists well we know that there are and many many high-level expert groups have been formed around different aspects and it just goes to show the complexity of the issue that we're dealing with there are many reports and surveys out there frameworks and policies that um
you know can go to support uh the the thing of course dora who are um involved the the declaration of research assessment are fundamental and have been working you know uh in for many many years on this and it's been signed as you can see their declaration by over 2000 organizations and they have a huge network of individuals that support it and at the moment indeed if you go and visit their website you'll see a wonderful series of case studies on reimagining academic assessment and stories of innovation and change which we have been compiled together with the european university association and spark europe who are involved in this as well and who you any of you who who followed yesterday would have heard vanessa's wonderful um outline of the difficult uh realm of infrastructures and sustainability uh of these fundamental infrastructures but but uh dora will by the way together with those two organizations be running a webinar on the 25th of february if you want to know more about the case studies but just to say that the dora
involvement in this is key it's fundamental it's crucial and it is very much there so that's a you know another global example i there are many many programs and policies around that we know of um and that are starting up i'm going to pick if you like on the dutch rewards and recognition program as an exemplar of national level policies and here in europe the dutch are always quite uh advanced in terms of their uh their activities and i think that you know there are a couple of things that i wanted to highlight from their program and the idea that you know a system of this type a new system of rewards and recognition and incentives um should enable diversification the vitalization of careers that it must acknowledge the independence and the qualities of individuals you know as well as their team performance and that the um that it's the quality of the work over the quantitative results that all aspects of open science should be encouraged and of course that the leadership aspects in academic uh careers and research and science are um fundamental too and it's it's it's important to value those so some interesting ideas there around programs that are doing and of course also in the dutch um national academy has the uh strategy evaluation protocol as well to support uh this and to mark it so so that's one example if you like of a program and a policy uh yesterday clifford tatum in his presentation if you were lucky enough to follow it showed this image already but i think it's worth reflecting um on again because um if you in the answer to this question of which types of academic work matter the most for research careers clearly the answer in 2009 was research publications and i'm not sure we've progressed too far from there there's something fundamentally wrong here where we practice and where we preach about open cyan and open access and unfortunately those who we are want to you know practice that are feel that it is the least important or possibly the most difficult for them to do so there is no doubt uh in our minds that uh this is you know important the time is now if not a little late but it's never never too late in in in my world so the um just a quick moment on the next one there are many uh excellent references and guides on how to start you know how to start this and what to include my remote control has gone asleep um and what not to what happened um i'm sorry i think i've lost the slides in my thing but anyway there are a large number of um indicators also available and the scientific metrics so resources you know huge number from basic to very uh um um you know complex if you like indicators that are all food for thought so um i uh so what will the registry do for us and where will it fit in to this um vast vast landscape so of course we must build on the recommendations and the existing outputs yes that were all of the i mean those few that i showed you there so it's you know we need to focus on the integrity of research projects they should be valued and not just the products and we must of course decide first on what the goals are and not uh not just what can be measured yeah because there's so much of a many unknowns in this uh we must move beyond the declarations and to practical implementations and pilots so it's great to see the policies and to see the programs uh but this must also start to be documented and you know um we must have the uptake i suppose of this is hampered by the lack of exemplars and the lack of evidence and on what works and what you know doesn't work and this is where we if you like fundamentally start from so the registry or the resources research research assessment registry the registry and rewards and incentives should be we want it to be a publicly available searchable and evidence-based online platform of the intentions and of the outcomes yeah fundamental the intentions as they started and the outcomes as they progress and are implemented of ongoing and future policy changes to the research reward and evaluation system yeah so um it is a uh i give you a sort of a sample view if you like and we're very much in the nascent stages of this um and i'll tell you where we are in the steps and in the implementation and the scoping of it but just to give an idea because it's always nice to have a picture um this open evidence based approach should of course uh be very much like a registry of things and it will um be if you like encompass stakeholders and pilots of implementations of research and rewards from across the globe as i said in uh from funders from research performing organizations and also publishers of course are the are the ones that we want to see uh provide the data and maintain it update it and of course it must also be across multiple levels so the institutional level the national level the domain specific level too so very broad very all-encompassing the um the structure if you like around the database is it would be you know a highly structured registry this is how we intend it of exemplars and to ensure
searchable uh examples so that you can find if you like examples that you're looking for that are ones that are important to you as an organization or even as a stakeholder so what sort of research and uh uh uh you know uh and rewards and incentives program runs and how in what scenario and in what context and and how was that valuable and how was it you know in this context rather than that is it something that i could look at for implementation in my scenario or in my context so and we want to ensure of course inclusivity and global so you see that many of the organizations that are now if you like volunteering and supporting us maybe are more north northern hemispheric and that's just as it happens around some of the funding that we're seeking and things like that but nothing to do with the fact that this must be global and i don't think i can say that enough and inclusive and inclusivity means also you know multilingualism which we have to um uh if you like approach and uh take into consideration uh as we develop this yes um but the successes and we want to use the successes to support we want the people to be able to support um uh you know the broader uptake and adoption by others
yeah so the goal the core goal is to capture both the intention and any subsequent outcome of each implementation so you could imagine that um we get you know the the intention is to run this program with these expectations but we also important to capture what worked and what didn't at time uh phases you know over the timeline of the of the actual program or the policy um in sufficient detail so that we are able to analyze it and share the outcomes so who are the stakeholders the key stakeholders here well we've sort of broken them into into two primary stakeholders and secondary ones as you can see there and we want it's very fundamental the success of this is the commitment by all of them and the engagement and the adoption by the funders and the institutions it's key to the success of this registry because this is an opportunity it's a golden opportunity to share the intentions the data the outcomes of the interventions and what worked and what didn't in a collaborative and open way and this is not currently available it's not available that's why we're doing it we certainly don't want to be reinventing the wheel so how will they be involved well we have sort of three steps in the involvement of the stakeholders um and through a database and the intent of course as well for uh the pre-registration if you like of intent and then the sharing and the reuse you know so it's a living registry it's um important because as i keep i can't say it enough how uh providing the updates on what works what doesn't what has been successful metrics and things allow others to then um make an assessment is it right or not right for them and to share it and also to you know not duplicate efforts in things that are going so very quickly uh finally the last slide what it is it's a mutual learning and knowledge exchange platform it's global it's open it's community driven it is not a monitoring uh platform it is not an evaluation framework okay i can't say that enough it's it's not for that there are other areas around the world for policy monitoring and things like this this is a mutual uh knowledge sharing platform so um the very quickly on the funding and the governance we're currently seeking funding in a short term for grants in short term but of course the longer term we will be analyzing and we have many people on board who are well used to the understanding around funding and longer term sustainability and different models will be chosen and of course the governance one thing is as we say as i said when i started and i leave it then at that is that it's initially managed by rda but there are other areas that we need to uh to to look into as to how this can be sustainable and structured in a correct way how what it is though it is a community governed and it will not be it would be a not for profit and adhering to the principles of open infrastructure which all of the founding and driving organizations um subscribe to so um in the next steps of course we're seeking the funding we're in the scoping phase now at the moment we are working with stakeholders and we're doing consultations with them the first one will be on the 9th of uh march which we've invited a group of funders and organizations across the globe to to
thing and we will will consult at different stages and in different ways with all stakeholders of course advocacy that this is an important thing is fundamental too and the communication and the outreach anyone who might be interested can please um in you know contact or get the link to the
uh contact us for more information there is a database that you can sign up to and to uh you know get us let us know what aspect of it you would be in uh interested in and then or send an email to the uh mail and one of the wonderful people
will pick it up and with that i will stop because i think i've run over my time um but thank you very much for your kind attention
thank you very much hillary for that very interesting presentation yeah first of all also congratulations on the continued growth of the research data alliance if i heard correctly over 11 000 members now so that's grown even uh from last year's uh statistics fantastic we had two or three questions i wanted to jump in for for you all and i had this question also yesterday when i talk to journalists sometimes they say that people these days they don't read information they swipe information basically they have a very short attention span and so when we have these kind of databases and you want to make this available you said publicly available is that something you all are looking into you've got so much interesting work going on but unfortunately people in general are having shorter and shorter attention spans so how can we get this data out to people to capture their attentions when we have a i will say loosely a swipe generation yeah absolutely yeah david it's a very good question i think and um i mean that's part of the five the the rationale behind the scoping and the stakeholder consultation um because we can't design this in a correct way uh if we don't involve all and that's not just uh i would say from the content perspective and what needs to be there and what isn't so that you can do the correct analysis on it but you're very uh it's very true the whole um interface with which we provide this will be important i think i talked about the multilingual aspect as well which is something it's not an easy thing to implement and it requires resources and that for us but we must remember that as you say people have different ways of accessing different wishes of accessing and um fundamentally we have to encompass all of those yeah yeah it's a challenge okay fantastic um we have i just got the notice we have over 200 participants viewing our discussion right now fantastic and we do have some questions coming in let me read it straight from our chat board here one question is do you see a risk if we set up open science award registries separately from the traditional science system could this lead to a split in the science system um i might not understand fully the question but i don't i would not think so um i think fundamentally so when i tried to explain the registry there the the concept is that of course those funding and those implementing and those monitoring are our primary stakeholders for this to be a success so i wouldn't see it as being a split and i think actually that's the important thing if we have a place where all of this information is available um that because we're not just talking about different nations but we're talking about different practices in different domains we had a wonderful presentation yesterday from danielle cooper now on data communities and um and the difference is of course uh from one uh discipline uh to another from one scientific domain to another and from the research data alliance i would know that myself it's uh you know so it it's not we i don't think i wouldn't see the risk and that if it's done correctly yeah okay super thank you very much i got one or two more questions and since you did run a little bit over that's no problem but i'll ask you to keep the answers brief so we can get on to our next speaker but it's all really fantastic and interesting uh next question we have i still cannot really imagine what kind of initiatives should be registered can you give one or two examples please okay so i suppose the example if i gave the example of the dutch um rewards and recognition one because i showed it in the slides yeah so they have a uh you know come out with this uh policy in this program and uh of how they wish to implement it so there will be pieces to that so let's take one of the the programs the things about um which i i like very much the you know rewarding around leadership so we would we would have a series of different pieces of information what was included in that program what were the expectations what were the goal who were the if you like recipients of this particular um you know what were the metrics and the uh how would you call it the frameworks used to monitor and to assess how successful was it wasn't successful in this area not in that so yeah i i mean i know it's difficult to see we have some examples and uh when we run some webinars it might be easier we'd be very happy to talk about it okay super two more quick questions here number one how is the registry different from dora declaration can you highlight the main differences well it's not um it's not different to dora in the sense that in fact that's why i kept i found i i underlined that dora is very very very much involved in this um dora exists and dirt as well the actual registry of all the implementations doesn't so will this be on the door our website will it be i don't know we haven't decided that yet but it's certainly going to be very very much plugged into that to the dora activities yeah yeah understood and the final question it's a long one i'll try to read through it here thanks for the mention i'm very happy to learn about your project it seems there might be a complementary dynamic between the openness profile and the rda registry what do you think about joining forces to look for potential alignment absolutely um as i said we're all about cooperation collaboration and co-creation no duplication of efforts where possible so i'd be delighted to we can take that offline very good that's that's great news yeah and the final thing i wanted to ask you and that is hillary uh we also have our speaker sessions i wanted to ask will you be available today and if so do you know exactly when i will uh i will be available for the hour so from a quarter past 12 central european time till a quarter past one so please join me there i'll be happy fantastic it is our tradition even though we're all watching from around the world in our offices and homes we give you a digital applause to our presentators thank you very much and thank you to all those who joined and listened and for the questions really fantastic and very very interesting