Hello everyone, we are back. Now Susana Miquici
is going to talk here at the station of Aneka.
She is the director of civil rights in the Autonomous
University of Madrid, and she is an author of many biographies.
and books about different subjects. Her investigations
go from 1993 to 2023 and talk about people rights,
minor protection, contractual obligations rights and public area guarantees
rights. She combines innovation and use of materials with communication.
Now she is going to present what it has to be with the activity that is developing
inside Aneka. She is going to focus on the repeal politics about open access.
Whenever you want Susana, the floor is yours.
Thank you very much.
First of all, I want to congratulate the organization AMNED
for this national congress that is so useful in this moment.
I want to thank the invitation to participate in this event. I represent
Aneka. Aneka is the national agency of evaluation of quality in Spain.
Spain is very well known, obviously. I know the public here is not just Spanish, so I am going to
talk a little bit about it so that it can be understood what Aneka has done since April 2023 till now.
In the follow up of the goals that we want to achieve for
years by different organizations related to open science.
Because Aneka as an agency is an evaluation agency of
the university teachers. It has an executive power.
Any person that wants to do a university degree in Spain,
before or after they have to ask for an evaluation to Aneka.
What Aneka wants to be able to get a positive assessment for evaluation, what Aneka asks for
and get a stabilization in the university degree or a promotion in the university degree.
What Aneka wants, they support positively and negatively.
So, their power is huge.
Aneka's power is huge. I am waiting for the presentation, the slides.
That is going to be my guide. I am going to talk in Spanish.
Practicing this bilingualism, that is one of the goals that we want to
achieve in the new criteria of assessment and accreditation of teachers.
And with the title that I have, I want to focus on two points in the paper that Aneka has had
and still keeps on having as an agent that applies European politics to support open access.
And the national strategy of open access from the
Spanish science ministry. I am going to talk about this.
And that we are achieving in this one and a half year.
Because we have a new director in Aneka, Pilar Paleque,
and she is the director since February 2023 until now.
What changes have been done, it is true that Aneka
is doing a lot, because the laws are allowing it.
I am going to try to explain without running out of time what we have been doing, what we
have achieved, what we have yet to achieve, and what problems are we finding in the way.
I am going to come down to the earth, I am going to land with all these problems that
the application of the principles of the goals have, because we can have an agreement.
But this is very difficult when we have to assess the university degrees, we have to assess the
merits of the teachers, that they ask to be a senior, an investigation senior, to get retribution,
that they ask for the necessary accreditation
to be able to apply for our university.
But I am going to focus on what we see here, but very quickly.
The national context is very important, because of what it
comes to the laws that have allowed what Aneka is doing.
I am going to refer briefly to the national
strategy of Open Science, we know it well.
ENCLAF, that is the objective plan that
we have to put during 2023 and 2027.
There are different measures that we
want to achieve at long and medium term.
I will make a spoiler, what Aneka had to achieve as an
evaluating agency in the short term has already achieved it.
We have to consolidate new measures and we have to tackle some problematic
issues, but we see that in the conclusions that we have done a lot.
The three great blocks, especially the two firsts, that
are the main big evaluation programs for university staff,
that Aneka has asked their responsibility as an evaluating agency.
First of all, I will talk about the combination of the distributed six-year
period of research, that is yearly, the last one that was published was in 2023.
In that, we have an evaluation of the six previous years of scientific
production from university staff, it could be from previous years,
but what we are assessing is the scientific production
over six years of university professors and researchers.
And the researchers for the research institutions, not only
universities, to achieve whether there is a positive evaluation,
a retributed economical complement and having a six-year period for
research or several six-year periods for research, that is essential.
All university professors that want to keep on working and
keep on being active in the university, not only teaching,
but they need to ask for a six-year period whenever it is applicable.
Secondly, I will talk about the other main program, and that is
getting the accreditation of the civil servants in the university,
that is also competency of Aneka nationally.
There are several quality agencies because of our territorial
organization, specifically for the six-year period evaluation.
and for the accreditation of the civil servant professors that work nationally,
that is necessary to get the evaluation or Aneka's accreditation or certification.
Thirdly, I will briefly talk about what is the Goara Action Plan.
It has just been released in July 2024.
It has Aneka's commitment to get what Goara is looking for.
And I will end with brief conclusions that I have named expectations and
reality, because usually reality is quite far away from expectations,
and in our case, thankfully, our expectations have been achieved and they
have been made a reality that from Aneka we feel strongly about them,
we are really proud of them, there is still a lot
of work to be done, but we are on the right path.
I will briefly start with this presentation of what is the international
context in which we have to work as an evaluating agency for quality.
I have not said that, but Aneka depends on the Ministry of
Science, it is an autonomous and evaluation organization,
but organically it is working with the Ministry for
Science, so it is an institutional organization,
and it follows the line that we have set for ourselves, at
least in this moment, by the Ministry of Science, of course,
and the main movements that there have been in the international
context in order to modify the research activity towards the future,
specifically when it comes to an evaluation of what has
been done in the past, which is the most complex thing.
Here I want to talk about this
international context that we are moving,
I want to show what are the most important points that
we have to take into account in Aneka in order to get,
to achieve this quality investigation that we
are looking for, to have as soon as possible.
First of all, one very important data is to
evaluate the diversity of the university degrees,
the data does not stop, we do not ask the same for every
person, but there is this richness in the investigation,
in the trajectories and in the academic profiles.
This means to change many things.
We are starting from a different system, a system
where the investigation was the main thing,
in opposition to the teaching, for example. So, if we want to re-valorize the
teaching and include their value in the evaluation criteria of the teachers,
we have to open to new contributions, investigation contributions, the access,
the positive evaluation of the different programs of teacher assessment,
and we have to value as well the leadership. And second, on the other
hand, the quality of the teaching, the quality of the investigation,
that are basically the two main activities
that define the teachers in the universities.
This quality does not need to be based just on
quantitative hints, but we have to look for quality hints.
A reasonable use of quality hints is what we have to achieve. And this
quality indication is going to give positive things to teachers and students.
And also innovation, creativity, and know-how
have to be important also in the evaluation.
Third, something that we have to remark is the positive evaluation
that we have to take into account in all the teacher programs,
about the personal effort and the collective effort. The
collaboration of academics has to be something to take into account,
we have to look for it, we have to support it, and
so it has to be assessed by the evaluation agencies.
Fourth, also what we are here for, specifically,
is to use open science linguistics with teachers.
ANECA is working on supporting open science so
that it is known and it serves all the society.
The results of the investigation are made by public funds.
And last of all, we must support academic leadership.
And so our criteria take into account
what the academics do in this sense.
In order to achieve all these goals that are very ambitious and
that we have been talking about for many years and asking for them.
through different national movements, the European Commission
among others, we have to change the assessment system.
And ANECA has a main power here, as I am saying,
an executive power as an organization that can,
with their assessment criteria, support the degrees in the
way that we want the degrees of the academics in Spain.
We can sum up in these three ideas that I
am talking about to finish with this slide.
It is a cultural change. It is a huge cultural change.
We need international cooperation for this.
That is why it is so important that meetings like
this today allow us to connect with each other
and have information of what is being done at all levels.
I loved, by the way, the starting conference.
And of course, we have to make all the university community to
participate, because they have to believe in what we are doing.
It is not just something about people that know
about it, but about all the university community.
In Spain, going a little bit further, we count on different
initiatives that have more or less of a legal importance.
to the first agreement, the agreement about the
change of the investigation assessment, or COCOARA,
are initiatives that gather what in right we
call soft right, because we can follow it or not,
but it depends on the voluntary. But what is important from here,
for me, in my opinion, is what we can see down on the slide,
that it are the laws that make the juridic
operators and that have to be accomplished.
They are compulsory. It is very important the law
of the science, of the technology, of innovation.
And here we remark the 2022 change, but the science law is from 2011.
So, from 2011, in Spain, with this law, it was asked
for a deposit of certain results of investigation,
but this was not accomplished. The academics did not accomplish
this law. In many cases, because they didn't even know it.
Until ANECA didn't ask for the accomplishment of
this law, asking in the six year period application.
to deposit all the results of the investigation that
is financed, the published articles in journals,
that should, from 2011, I repeat, since 2011, they should
be already gathered all the results, but they didn't.
And since 2022, all the books and chapters, but until
ANECA didn't ask for it, it was not accomplished.
And the Spanish libraries know about this.
And also, they are thankful for it.
Despite all the work that they have to do, because the law
asks for the gathering of the results of the investigation.
And this is a law that is very important,
and is based on all the work of ANECA,
and this is the organic law of the universitary system, law 2.
20.23, that is called LOFSO.
And it establishes new principles of assessment, feature assessment.
There are a lot of principles there, and that have been
developed in a new law, that is this 678.28.
23 law, that you can see down here, of accreditation.
Because ANECA, according to these laws,
ANECA must guarantee the accomplishment of these
principles, of these assessment principles,
that are in the organic law of the universitary system,
and they must give coherence in all their programs,
in all their assessment processes, to the
criteria and the merit that must be assessed,
to be able to get a positive assessment by ANECA.
I must say, talk about the Open Science National Strategy,
that has not the same law power as the other laws
I talked about, the science law or the universitary system law.
This national strategy is a document that looks
forward to achieve at a short, medium or long term.
its goals, but with no comparative power and
less power than these laws I talked about before.
This national strategy gives us all the clues
to put all the principles that are gathered
in the normative texts that I talked about.
Here we have all the ANECA programs,
on which we try to be coherent, since last year for sure.
We are on a build-up process, a program
of six years period of investigation,
this program of six years period of
scientific production, academia program,
that is how we call the accreditation process of the
teachers that want to apply to be officials in Spain.
These categories are so specific from
Spain, they do not exist in other countries,
and the teaching program, on which of
course the Open Science has a lot to say.
In this slide I try to sum up what ANECA
is. ANECA is, for sure, who writes it down,
it is a modern organization from the science
ministry, also from Spain, it is a private foundation.
for the support of innovation, and they
depend on the science ministry, of course,
and the spirit is to achieve a new way
to produce and to finance and communicate
and to assess the scientific knowledge.
I said that it is a task of ANECA
to get a new way of assessing the scientific knowledge, of course,
all the agents that ANECA goes for, this Open Science National Strategy,
but I am going to focus on what it has done as an assessment.
Its spirit, to sum it up, is to change
the paradigm from what we have to get out
and the measurement of the results of the
investigations in all the brands of knowledge.
And these would be the four goals, there
are more, of course, but to sum them up,
we already have talked about some of
these goals in the previous presentation,
and also here, black letters, it is what ANECA can work in.
We need, obviously, for the Open Science,
digital infrastructures that are solid,
we need that the data management is done under
the FAIR principles that we talked about before,
that there is an open access, publications
that are financed by public funds,
and last but not least, I am going to
talk about the new assessment mechanisms
of the investigation, of the research that
is done in the academia, in the universities.
and in the research organisms with an
accurate system of feeds and recognizements,
indications and recognizements.
The measures that we have here in this
document that you can check in the webpage
of the Science Ministry, and you have it in
Spanish and English, these measures are a lot,
and they match with this goal, and I highlighted
here the recognizement of the practices.
of Open Science in investigation and in teaching
by the agencies that assess the teachers
in the universities.
So now we are going to see what ANECA has
done to achieve these goals, these measures,
that they have to accomplish in order to guarantee
the science law, the university system law,
and the other law we talked about.
So, these would be the three main blocks
on which ANECA has worked already a lot
in support of Open Science.
First, calling for a six-year period in December 2023,
calling like every year, and writing down
the assessment criteria of the activity done
for six years by the Spanish academics.
Second, what ANECA has done in the accreditation
process of the university teachers,
what they have done so that they can get the
needed accreditation, the teachers that want
to apply or establish themselves in the
university, in the university category, or to get the cathedra.
And last, I want to talk about the action plan
of ANECA to put into practice the commitments
assumed with CUARA, as a part of CUARA.
Because as a part of CUARA, ANECA is
convinced that we have to follow this path.
And in July 2024, many measures were approved,
and it's going to be the last thing I'm going
to talk about before the conclusions.
Look at the date, December 2023, the six-year period call is approved.
And remember that in April 2023 is when the
University System Organic Law is approved.
During these months, in ANECA, we did huge
work with the help of CUARA and the assessment
of other organisms.
We did huge work for the first call to be
able to achieve all the goals of changing
the assessment and the investigation that
we're thinking of, and mainly the open science assessments.
Also, look at the date of the procedure and
criteria for accreditation, January, March
2024, just after the six-year period call.
We have to work all together since July, where
we developed our principles, and we keep on working on this.
So, without losing more time, I want to say
that in ANECA, we've tried to do everything.
that is in our hands to get the change of the
evaluation of the results of the research.
and, in general, the activity that, as academics, we have to develop.
This is the law, the norm, that is published
in the official state document, 5 December.
2023, on which assessment of the research activity is totally changed.
These changes that you can find in this law,
we can, with the assessment of a commission
that is formed by library people, science
people, many of them are here, they assess.
ANECA and they are part of this commission,
and we've modified the applications that can.
be presented inside this pack that this law
allows, and we cannot avoid it, but we've.
tried to include all the possible apports that
are now in the scientific world, contributions,
and then we have this.
Then I will develop a new index of new measures,
and I'll talk about the Open Science ones,
and they help the university students to write
down their own merits in a different way to
which what has been done in the past.
Here I sum up in this slide, even though there
is a lot more, the results are wider, it's
a pity that I cannot talk about all of them,
but I think that here are the main things,
the main innovations that affect mainly the Open Science strategy.
So, the demand of deposit of the investigation
results according to the science law, according.
to the organic system law, about the third
parties' rights, is the first time that it
is discovered in an assessment call of the
university teachers, and this was a hard work
of course to implement this, this was a huge
revolution, it created a lot of discomfort.
in the university community, the libraries had
a lot of work since December to the closing
of the call in February of the six-year period
of research, because you have to take into.
account that we received 14,000 applies of
six-year period research, and in each apply.
we can have from five to seven contributions
that have to include this data.
If they have been applied during the years
that the deposit is demanded, so that they
can be valued by the different committees.
The use of institutional repositories as an
access to documentation is something that.
ANECA has asked for as well, the planning
and narration of the relevant index, that.
is a huge opportunity for the quantitative ones,
a huge diversity of valuable contributions,
and I finish with the specific importance
that the different contributions have to the
open science, 10% is not a lot, but we have
to take into account that we analyse and we
assess and evaluate past degrees, trying to incentivise the future.
This criteria number five, from the evaluation
criteria of the research activity that are
in the 2023 resolution of criteria, we thought
a lot about this and it gave a lot of problems,
and probably in the next call we'll have to
work on this, because it's very difficult.
to connect what the contribution to open science
demands with the copyright rights and the.
Spanish law, the intellectual property law,
but I invite you to study these five criteria,
to read it, because here we can see the sum
up of the philosophy that we are looking for
in order to be able to connect with this open science and the copyright.
That is not easy, I can guarantee that.
Luckily we had the aid of Revune, the university
libraries' net, this is published in the.
webpage of ANERCA, it was published, well,
the six-year period call was published so
that the academics could know what to do,
depending on the contributions that they present
to the evaluation, whether they are journal
articles, chapters, books or whatever, with
a regime that is different, there can be restricted
access, open access, and this helped a lot,
but of course there are some disciplines,
for example mine, that it's a lot of paper,
and people from the libraries know it a lot,
they know it because they had the complaints of many researchers.
I also invite you to enter into ANERCA webpage
in the evaluation of six-year period, because
this is the data that developed the criteria
for evaluation of six-year periods, and it
reflects the weight of the open science, and
this is very important, this is very technical,
but it is what it's worth, because in order
to be able to get ten points, ten of these
points, you can just get them if you contribute
to open science, so obviously we have to do
everything possible to get these points out of
ten, or at least ten points out of a hundred
that are going to allow us to pass the evaluation.
It is not huge, because I insist we are going
backwards in the evaluation of the academic.
career, but as you can see here, you can see
what can we evaluate and assess as we do open science.
Also it is very important, I cannot forget
this, in red we have the possible punishments,
because in ANERCA something that we cannot
allow is the bad practices of publication
in journals that do not follow an assessment
process that is accurate, and this is the
path that we have yet to work on.
This is an example of the sum up that has
this resolution of 5 December 2023, these
appendix, they are the last metrical dimensions,
the ones that promote open science, it is.
not so wide, but we have some clues here about
how to get punctuation because of contributing
to open science, the diamond road, for example,
of course is something we should take into account.
Next program, briefly, is the assessment of
the university teachers, and this program.
is the program of accreditation to be able
to apply for fixed workplaces in the Spanish system.
This new procedure is designed during the
first months of 2024, it is published, of
course the creating process is wider with new evaluation criteria.
I want to highlight first the simplification
of the tasks, the agility and the presentation
of the documentation, nothing to do with what we
used to do, we look for accessible documentation.
with open access, using the institutional
documents, we trust on what the appliers ask.
for, and during the assessment we do a quality
and quantitative assessment, the merits will
get this assessment, this quality assessment
based on a reasonable use of quantitative.
indicators, and then we will evaluate the
multidisciplinary and interdisciplinary characteristics,
the characteristics of the developed
activities and also the stabilization.
As you can see, this is what Anec asks for,
as a general law now, trust me, whoever went
through the Spanish system knows how good is this.
A short CBE, we collaborate with the CIF in
the elaboration of this CBE, the declaration
of veracity and the teaching certificate,
little merits, but the quality merits so that
they can be assessed by the different commissions
that were constituted in December 2023.
This is the criteria document, it is published
with huge transparency in case you want to
read it, and I also talk about this resolution
of the Aneca director of February 2024, trying.
to get a higher quality or an effective quality
report for these people with different capacities.
And we are trying to sum up here the three
blocks of merits, how to support open science
in research, as well as in six-year period that I already talked about.
In addition, we evaluate positively, of course,
the open resources and about leadership, is
the needed merit to get to achieve the higher share in universities.
We value this leadership of exchange of
experience with society, it is very important.
And this is the transparency that we have had
in Aneca, in which the university community
talks about the criteria of the six-year period,
about accreditation criteria, and this is.
a platform that we opened with more than 3,000
participants, so that in the criteria draft
we can have a feedback, and for sure we got
this feedback, and I can assure, and in Spain.
many people know, that we follow what the university
community asks for on the published draft.
The COARA action plan, it is also in the Aneca
webpage, which is published with these measures.
that we want to start. I end up with the conclusions,
it is the expectation for the National Strategy
of Open Science from 2023 to 2027, it is a
sum up, a very schematic sum up of what we
are looking for in the assessment of the research activity.
This is what Aneca has to do, and has to activate, of course.
And as you can see, I am going to focus on the
inclusion of new indicators of Open Science,
the evaluation processes, experiment and Open
Science, interdisciplinarity and collaboration,
verification of the results, of the research
results openly and accessible, information.
in Open Science practice, and so in real life
we got this, and all our goals we achieved.
them with the new accreditation process, except
the review, we haven't done this yet, there.
is an award that is not yet finished between
Cecil and Aneca, and we need a lot of teaching
yet, we have to do a lot of teaching among
the people of UNITEC and the people that are.
going to be assessed, to get this strong commitment,
and so that all these things that we are doing work.
And I finish with these words of Antonio Machado,
"Caminante no hay camino, se hace camino al
antenna", this means that you make your path
when you go through it, and this is what we
are doing in Aneca, thank you very much.
Hello, I don't know if there is any question
in the room that you want to ask Susana?
Is there any question that you might want to ask Susana?
No?
Well, thank you very much for coming.
Ok, so thank you very much for being here,
and indeed there is still a long way to go,
we have taken great steps in the previous
convocation, and now Aneca steering
committee is quite implicated in that task.