EERAdata Wiki - User contributions [en]

WS1

2020-06-12T07:59:28Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* Normally, public funded projects count as commercial project under general copyright law
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* '''almost 80% of all public funded research data is never re-used'''
* Content of a DMP: '''1''' Roles and responsibilities, '''2''' Legal and ethical issues, '''3''' Data description, '''4''' Documentation and Data quality, '''5''' Storage and security, '''6''' Longterm preservation, '''7''' Data sharing and re-use
* 5 quick tips for developing a DMP
** Begin as early as possible and update regularly (according to H2020 at least one update at project start, midterm and end)
** Check what help you can get from your institution
** Consider online DMP tool
** Create a DMP that actually helps you. Do not treat DMP a just another bureaucratic "must do"
** Be as simple as possible but as precise as necessary. Make sure to clarify which part of your data each DMP section refers to. Large projects can have different data subsets that require different management plans.
* ''DMP tools:'' DCC DMP online [https://dmponline.dcc.ac.uk/], DMPTool [http://dmptool.org/], easydmp [https://easydmp.sigma2.no/], NSD DMP [https://dmp.nsd.no/], Data Stewardship Wizard [https://ds-wizard.org/]
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Current shortcomings of DMPs:
** Manually completed, vague, not updated, considered bureaucracy, completed last minute
** People make commitments in DMP that effect other people without previous consultation, e.g researchers stating that their institution will provide storage space without contacting responsible administration at the institution first
** Often more people involved in DMP as initially assumed, e.g secondary persons not directly involved in the project, such as administrators, legal consultants, etc.
* Currently DMP designs are often driven by the wishes of the funders and ask for information that is not strictly necessary for a well structured data management.
* The first aim of automated DMP tools would be to allow for automated retrieval of administrative data from already existing databases at the institutions (e.g. researcher profiles, Orcid-IDs, institution's profile, etc.), sparing the project members from manually re-entering this information with every new DMP.
* '' RDA DMP Common Standards:'' [https://github.com/RDA-DMP-Common/RDA-DMP-Common-Standard/blob/master/docs/links.md]
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Establish a Data Committee
* allow provision of different licenses for sub-datasets within one database
* Even though EERAData only works with already existing databases, the results of the FAIR evaluation are new data that require new licensing
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
* Promoting FAIR data: Why is FAIR open data good? How many more users, publications, etc.?
* Need for more responsible management of research investment: We are spending billions into generating data. We need to make sure that this data is valuable/ stays valuable
* Can we minimize data, e.g. avoid double collection of data?
|}

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-12T07:53:15Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* Normally, public funded projects count as commercial project under general copyright law
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* '''almost 80% of all public funded research data is never re-used'''
* Content of a DMP: '''1''' Roles and responsibilities, '''2''' Legal and ethical issues, '''3''' Data description, '''4''' Documentation and Data quality, '''5''' Storage and security, '''6''' Longterm preservation, '''7''' Data sharing and re-use
* 5 quick tips for developing a DMP
** Begin as early as possible and update regularly (according to H2020 at least one update at project start, midterm and end)
** Check what help you can get from your institution
** Consider online DMP tool
** Create a DMP that actually helps you. Do not treat DMP a just another bureaucratic "must do"
** Be as simple as possible but as precise as necessary. Make sure to clarify which part of your data each DMP section refers to. Large projects can have different data subsets that require different management plans.
* ''DMP tools:'' DCC DMP online [https://dmponline.dcc.ac.uk/], DMPTool [http://dmptool.org/], easydmp [https://easydmp.sigma2.no/], NSD DMP [https://dmp.nsd.no/], Data Stewardship Wizard [https://ds-wizard.org/]
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Current shortcomings of DMPs:
** Manually completed, vague, not updated, considered bureaucracy, completed last minute
** People make commitments in DMP that effect other people without previous consultation, e.g researchers stating that their institution will provide storage space without contacting responsible administration at the institution first
** Often more people involved in DMP as initially assumed, e.g secondary persons not directly involved in the project, such as administrators, legal consultants, etc.
* Currently DMP designs are often driven by the wishes of the funders and ask for information that is not strictly necessary for a well structured data management.
* The first aim of automated DMP tools would be to allow for automated retrieval of administrative data from already existing databases at the institutions (e.g. researcher profiles, Orcid-IDs, institution's profile, etc.), sparing the project members from manually re-entering this information with every new DMP.
* '' RDA DMP Common Standards:'' [https://github.com/RDA-DMP-Common/RDA-DMP-Common-Standard/blob/master/docs/links.md]
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Establish a Data Committee
* allow provision of different licenses for sub-datasets within one database
* Even though EERAData only works with already existing databases, the results of the FAIR evaluation are new data that require new licensing
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-12T07:45:58Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* Normally, public funded projects count as commercial project under general copyright law
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* '''almost 80% of all public funded research data is never re-used'''
* Content of a DMP: '''1''' Roles and responsibilities, '''2''' Legal and ethical issues, '''3''' Data description, '''4''' Documentation and Data quality, '''5''' Storage and security, '''6''' Longterm preservation, '''7''' Data sharing and re-use
* 5 quick tips for developing a DMP
** Begin as early as possible and update regularly (according to H2020 at least one update at project start, midterm and end)
** Check what help you can get from your institution
** Consider online DMP tool
** Create a DMP that actually helps you. Do not treat DMP a just another bureaucratic "must do"
** Be as simple as possible but as precise as necessary. Make sure to clarify which part of your data each DMP section refers to. Large projects can have different data subsets that require different management plans.
* ''DMP tools:'' DCC DMP online [https://dmponline.dcc.ac.uk/], DMPTool [http://dmptool.org/], easydmp [https://easydmp.sigma2.no/], NSD DMP [https://dmp.nsd.no/], Data Stewardship Wizard [https://ds-wizard.org/]
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Current shortcomings of DMPs:
** Manually completed, vague, not updated, considered bureaucracy, completed last minute
** People make commitments in DMP that effect other people without previous consultation, e.g researchers stating that their institution will provide storage space without contacting responsible administration at the institution first
** Often more people involved in DMP as initially assumed, e.g secondary persons not directly involved in the project, such as administrators, legal consultants, etc.
* Currently DMP designs are often driven by the wishes of the funders and ask for information that is not strictly necessary for a well structured data management.
* The first aim of automated DMP tools would be to allow for automated retrieval of administrative data from already existing databases at the institutions (e.g. researcher profiles, Orcid-IDs, institution's profile, etc.), sparing the project members from manually re-entering this information with every new DMP.
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-12T07:35:19Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* Normally, public funded projects count as commercial project under general copyright law
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* '''almost 80% of all public funded research data is never re-used'''
* Content of a DMP: '''1''' Roles and responsibilities, '''2''' Legal and ethical issues, '''3''' Data description, '''4''' Documentation and Data quality, '''5''' Storage and security, '''6''' Longterm preservation, '''7''' Data sharing and re-use
* 5 quick tips for developing a DMP
** Begin as early as possible and update regularly (according to H2020 at least one update at project start, midterm and end)
** Check what help you can get from your institution
** Consider online DMP tool
** Create a DMP that actually helps you. Do not treat DMP a just another bureaucratic "must do"
** Be as simple as possible but as precise as necessary. Make sure to clarify which part of your data each DMP section refers to. Large projects can have different data subsets that require different management plans.
* ''DMP tools:'' DCC DMP online [https://dmponline.dcc.ac.uk/], DMPTool [http://dmptool.org/], easydmp [https://easydmp.sigma2.no/], NSD DMP [https://dmp.nsd.no/], Data Stewardship Wizard [https://ds-wizard.org/]
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-12T07:29:54Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* Normally, public funded projects count as commercial project under general copyright law
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* '''almost 80% of all public funded research data is never re-used'''
* Content of a DMP: '''1''' Roles and responsibilities, '''2''' Legal and ethical issues, '''3''' Data description, '''4''' Documentation and Data quality, '''5''' Storage and security, '''6''' Longterm preservation, '''7''' Data sharing and re-use
* 5 quick tips for developing a DMP
** Begin as early as possible and update regularly (according to H2020 at least one update at project start, midterm and end)
** Check what help you can get from your institution
** Consider online DMP tool
** Create a DMP that actually helps you. Do not treat DMP a just another bureaucratic "must do"
** Be as simple as possible but as precise as necessary. Make sure to clarify which part of your data each DMP section refers to. Large projects can have different data subsets that require different management plans.
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-12T07:15:07Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Identified Issues: 2 groups of Databases: policy DBs and policy relevant DBs, Dimensions of policy: policy domain (thematic grouping) and policy scope (administrational grouping e.g. administrative level policy is aimed at)
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-11T09:57:02Z

Janpedroz: /* Agenda and notes from Day 3 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
* UC1 - Wrap up:
** Identified Issues: Often locally kept data (findability), poor maintenance of DBs (accessibility), privacy issues (re-usability), Dublin core standards often not considered, Lack of live and fresh data in many DBs, '''FAIRness assessment often subjective'''.
** Next steps: Find recipes for FAIRification, Database specific implementation of FAIRness
* UC2 - Wrap up:
** Identified Issues: lack of standardization, DBs often discuss similar topics but use different (meta-)data standards, Varying degree of information on licensing, FAIR2.1 (provenance) unclear how to be interpreted.
** Next steps: Reassess datasets with other FAIR principles than Wilkinson's, More discussion with team of other EERAData UCs, Cross country deep dive with selected DBs.
* UC3 - Wrap up:
** Identified Issues: Different metadata standards depending on domain, no unique definition of metadata/ individual preferences, lack of standards, interoperability, Increasing amount of generated data leads to increasing costs of data management.
** Next steps: How to connect to other EERAData UCs? How to connect to EERA JPs?
* UC4 - Wrap up:
** Next steps: Agree on set of keywords, FAIR principles: comparison between Wilkinson and Mons system
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-11T08:13:28Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* What is RISIS: First pan-European research infrastructure to study research and innovation dynamics and policies
** Set of interlinked databases on: Firm Innovation capabilities, R&D output, Public research and Higher Education, Policy Learning.
** Not all data accessible, but interlinking mechanisms are fully public
* While Metadata descriptions in, for instance, PDF format are not machine readable, it is also important to have a qualitative format such as PDF that is easily understandable by humans, for instance to present your data/ work to the outside.
* ''RISIS Website:'' [https://risis.eu/]
* ''RISIS Knowmak tool:'' Provides Indicators in Key Enabling Technologies and Societal Grand Challanges [https://www.knowmak.eu/]
* ''SIPER:'' Science and Innovation Policy Repository [http://datasets.risis.eu/metadata/siper]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T10:03:48Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* The Data Management Lifecycle: '''Identify''' research data -> '''Plan''' data management -> '''collect/produce & Structure & Store''' -> '''Deposit for Preservation, Cite & Share''' -> '''Dissimination'''
** AT which phase to apply the FAIR principles?
* "There is value and risk at being a first mover (regarding implementation of FAIR principles), but there is a higher risk at being a follower"
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice ( methodological, epistemological, political,...)
** There is always an interpretation, subjectivity (Data are not generated by a machine)
** there is always a discussion
* preliminary issues of FAIRness:
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specificity of how we do research in the humanities
** services and tools need to be sustainable
** Time consuming and no incentive or reward to apply FAIR principles

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T09:41:48Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Alternative interpretation of FAIR data: Reusability of Data is the final goal with Findability, Accessibility and Interoperability being prerequisites for Reusability. Reusability of Data for multiple purposes multiplies the value of the Data
* Open data = available data <-> FAIR data = findable data
* '''Issue:''' How to make data findable but safe (in regards to data protection, competitive advantages, etc)?
** '''Solution:''' Create a searchable data catalogue of '''distributed''' data
* How to create a taxonomy?
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider research community
*** "top-down" approach
*** + clearly defined, controlled vocabulary
*** - static, unable to adapt to new trends
** Taxonomy based of author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** "bottom-up" approach
*** + adaptable, able to track new trends
*** - Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* ''IRP Wind Website:'' [https://www.irpwind.eu/]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* Bulleted list item
* 2
* Links

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T09:16:48Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) for a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* Bulleted list item
* 2
* Links

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T09:15:48Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* The attributes of a data object can be '''data''' or '''metadata''', depending on the context
* "An Ontology is a '''formal''' (= machine readable) '''representation''' (= concepts, properties, relations, functions, constraints, axioms are explicitly defined) of the '''knowledge''' (= domain specific) of a '''community''' (= consensual) of a '''purpose''' (= question driven)."
* Definition of FAIR data:
** Findable: unique names, human-readable descriptions
** Accessible: URL, accessible via API
** Interoperable: typed, extensible schema -> ontologies
** reusable: hierarchical schema -> data-analztics
* ''NOMAD Meta Info:'' [https://metainfo.nomad-coe.eu]

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* Bulleted list item
* 2
* Links

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD: https://open-power-system-data.org/
* ENTSO-E Transparency Platform https://transparency.entsoe.eu/
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T08:44:14Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]
* Further Links copied from Conference chat:
** ''Working Group on Rewards'': [https://ec.europa.eu/research/openscience/index.cfm?pg=rewards_wg]
** ''Open Science Policy Platform'': [https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-policy-platform]
** ''Clarivate Data Citation index'': [https://clarivate.com/webofsciencegroup/solutions/webofscience-data-citation-index/]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* Bulleted list item
* 2
* Links

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* Bulleted list item
* 2
* Links

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD
* ENTSO-E Transparency Platform
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T08:38:53Z

Janpedroz: /* Agenda and notes Day 1 */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

[[File:Selection 187.png|800px|Workshop concept of EERAdata]]

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:''' This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda and notes Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “'''EERAdata - Towards Utopia for low carbon energy research'''”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]. Main points:
* In the energy system the data revolution offers prospects, but we are fare away from harvesting them. The time researchers spent with data governance (finding, cleaning, revising of formats) and bureaucracy exceeds time spent on exciting stuff (thinking, creating new insights, collaborating, and discussing with others) by far.
* There is a lack of joint standards and common metadata formats to support researchers in finding and reusing heterogeneous data. Machine-actionability is also an issue.
* The vision of developing a one-stop-entry point for energy research is clear before our eyes: being able to search for data, access rich metadata, choose & select datasets, crunch data real-time online, being able to link to "My-researcher-space", a platform that offers a personalized workspace for data analysis, paper writing, and research collaboration.
|-
| 10.20-12.15 || '''Online lectures''':
“'''The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories'''” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]. Main points:
* Goal and vision of EOSC: Enable researchers to access data across domains and disciplines as easy as possible, support locating the relevant data. All European data should be available to researchers, but this does not mean that all data is stored centrally. Instead, databases should be interconnected.
* FAIR maturity evaluations: Close to 100 repositories have been tested using an automated tool. Most of them only score with 0.10 out of 1.
* ''FAIR Evaluation Tool:'' [https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/collections/new/evaluate]
* ''EOSC Website:'' [https://www.eosc-portal.eu/]

“'''OpenAIRE: Open Access Infrastructure for Research in Europe'''”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]. Main points:
* Goal and vision of OpenAIRE: To "Bridge the worlds where Science is performed and where Science is published", by monitoring, accelerating and supporting Open access research and publishing.
* OpenAIRE consists of 50 European partners, including 34 National Open Access Desks (NOADs, that provide support on issues related to Open Science Policies, Open Science Infrastucture, Open research Data and Open Access to publications
* Lessons learned: "Research is global, support is local". Regional differences in culture and maturity of open access infrastructure require support strategies specifically tailored to each region.
* ''OpenAIRE Website:'' [https://www.openaire.eu]
* ''OpenAIRE Connect:'' Platform that allows to connect with the research community of a specific research field [https://connect.openaire.eu/]
* ''OpenAIRE Provide:'' platform that allows open access publishing of Data [https://provide.openaire.eu]

A short break of 15 min -

“'''Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools'''”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]. Main points:
* Bulleted list item
* 2
* Links

“'''Metadata practices from IRP Wind'''”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':

“'''Humanities and data: for a community-driven path towards FAIRness'''”, Elena Giglia, UNITO. Re-using presentation held at the Open Science Conference 2020 in Berlin. Presentation stored at zenodo. Link: [https://zenodo.org/record/3776849#.XthYBnYza90]. Main points:
* Bulleted list item
* 2
* Links

“'''RISIS - An e-Infrastructure for the STI-Policy research community'''”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]. Main points:
* Bulleted list item
* 2
* Links
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL. What is the take-to-day-2 message for your use cases?
* ''Use case 1:'' The main issue for us is re-usability. We need to assess the databases that were chosen previously. Learn from best practices.
* ''Use Case 2:'' Our main issue is privacy/ sensitivity of data. Security should come first. There is a tradeoff between universal metadata language and domain-specific language.
* ''Use case 3:'' Linguistics is a problem. As soon as we change the application of the material, we also change related metadata. Find similarities of already existing metadata.
* ''Use case 4:'' We face different languages and terminologies. The range of interpretation of the same terms is broad. We should address low hanging fruits but also aim at cracking hard nuts to improve FAIR/O principles.
* ''General:'' EERAData is probably more about asking the right questions to the energy research community than providing the right answers. There are already a lot of answers out there, we need to link them to our data issues. We envision being able to suggest low carbon energy metadata standards for and with the research community. Colleagues working on the EERAdata platform will join in on all use case discussions on day 2.
* Motto: '''"'''Ontology is a formal representation of the matured knowledge of a community on a specific purpose'''"'''.
|}

== Agenda Day 2 ==
=== News of the day before ===

Not energy, but an inspiring connection: Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...
[[File:Selection 186.png|thumb|Perhaps unexpected, or perhaps even not: DNA helps to puzzle pieces of Qumran role. DNA taken from animal skins that were used to write on ...]]

=== FAIR data and FAIR METADATA - DISCUSSIONS in use cases, parallel sessions ===
Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update the preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* from 15 Joint recordings of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

=== Issues identified across use cases ===

{| class="wikitable"
|-
! '''Use case 1''' !! '''Use case 2''' !! '''Use case 3''' !! '''Use case 4'''
|-
| [[UC1|Buildings efficiency]] || [[UC2|Power transmission & distribution networks]] || [[UC3|Material solutions for low carbon energy]] || [[UC4|Low carbon energy and energy efficiency policies]]
|-
|
[[File:UC1 logo.jpg|thumb]]
||
[[File:UC 2 logo.jpg|thumb]]
||
[[File:UC 3 logo.jpg|thumb]]
||
[[File:UC 4 logo.jpg|thumb]]
|-
|colspan="4" style="text-align:center"|'''Gaps & challenges per use case in a nutshell'''
|-
|
* qualitative nature of data limiting interoperability
* data availability issues for time-series
* multiplicity and scattered nature of data sources (households, industries, utility companies, municipalities)
||
* Lack of standardization for metadata taxonomy and common vocabulary
* Ambiguity on licensing issues for various types of energy data
* Lack of unique identifier for energy data in most databases
||
* microscopic use cases resembling the existing one about PV
* link between microscopic and macroscopic materials (e.g., turbine blades)
* metadata for applications of materials
* linking to other fields
||
* heterogeneous data make standardization difficult
* policies are a topic linked to all use cases in EERAdata
* metadata for images (e.g., maps) underdeveloped
* complexity of complete provenance information
* language and terminology are an issue (e.g., records instead of data)
* stark discrepancy between FAIR assessment results by humans and machines
|-
|
Use case 1: Continuously updated summary page [[UC1]],
* Detailed notes from WS1: [[WS1UC1]]
* Detailed notes from WS2: [[WS2UC1]]
* Detailed notes from WS3: [[WS3UC1]]
* Detailed notes from WS4: [[WS4UC1]]
* Detailed notes from WS5: [[WS5UC1]]
* Detailed notes from WS6: [[WS6UC1]]
||
Use case 2: Continuously updated summary page [[UC2]],
* Detailed notes from WS1: [[WS1UC2]]
* Detailed notes from WS2: [[WS2UC2]]
* Detailed notes from WS3: [[WS3UC2]]
* Detailed notes from WS4: [[WS4UC2]]
* Detailed notes from WS5: [[WS5UC2]]
* Detailed notes from WS6: [[WS6UC2]]
||
Use case 3: Continuously updated summary page [[UC3]],
* Detailed notes from WS1: [[WS1UC3]]
* Detailed notes from WS2: [[WS2UC3]]
* Detailed notes from WS3: [[WS3UC3]]
* Detailed notes from WS4: [[WS4UC3]]
* Detailed notes from WS5: [[WS5UC3]]
* Detailed notes from WS6: [[WS6UC3]]
||
Use case 4: Continuously updated summary page [[UC4]],
* Detailed notes from WS1: [[WS1UC4]]
* Detailed notes from WS2: [[WS2UC4]]
* Detailed notes from WS3: [[WS3UC4]]
* Detailed notes from WS4: [[WS4UC4]]
* Detailed notes from WS5: [[WS5UC4]]
* Detailed notes from WS6: [[WS6UC4]]
|}

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Special session - FAIR data evaluation by machine ===
15.30 - 16.00 Andreas Jaunsen, Nordforsk. Presentation of the results from an automated FAIR evaluation for selected repositories suggested by the use cases.

'''The proposed list of databases to check:'''
* EUR-Lex: https://eur-lex.europa.eu/homepage.html?locale=en
* JRC: https://data.jrc.ec.europa.eu/
* IEA: https://www.iea.org/policies/about
* Nomad database: https://www.nomad-coe.eu/index.php?page=nomad-repository
* OPSD
* ENTSO-E Transparency Platform
* ExCEED - European Energy Efficient building district Database https://dashboard.exceedproject.eu/
* EU Building Stock Observatory: https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en

'''Results'''
Note: 22 indicators with the FAIR Maturity Evaluation Service are tested. 0 stands for "failing the test", 1 stands for "standing the test".

Most of them are a mix of web-pages (of repositories). Thus, a random dataset from a few of them was selected.

{| class="wikitable"
|-
! Database link !! Result link !! Result across 22 indicators !! Aggregate result across FAIR categories
|-
| https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:JOC_1999_093_R_0001_01|| https://fair.etais.ee/evaluation/4842 || 1001100001010110000000 || 37.50% 40.00% 28.57% 0.00% 31.82%
|-
| https://data.jrc.ec.europa.eu/dataset/93d07f10-7757-485f-bb8e-3160536b97f8 || https://fair.etais.ee/evaluation/4843 || 1001110011110110011100 || 0.00% 80.00% 71.43% 0.00% 59.09%
|-
| https://onlinelibrary.wiley.com/doi/abs/10.1002/aenm.201902830 || https://fair.etais.ee/evaluation/4844 || 1000000001010000000000 || 12.50% 40.00% 0.00% 0.00% 13.64%
|-
| https://doi.org/10.25832/conventional_power_plants/2018-12-20 || https://fair.etais.ee/evaluation/4845 || 1101110011110110011100 || 62.50% 80.00% 71.43% 0.00% 63.64%
|-
|}

See also: https://www.rd-alliance.org/groups/fair-data-maturity-model-wg and https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/

== Agenda and notes from Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.00 || '''Discussion''' lead by WP2. '''Report from use case experiences''' (by use case leaders). Wrap up.
|-
| 12-12.30 || Presentation "'''Some pitfalls in data base licenses'''", Carsten Hoyer-Klick, DLR - German Aerospace Center. Main points:
* Data bases can be proteced by general copyright law or data base generation right or both
* Data base generation right just need substantial invesment
* If no license is applied to the data base, general copyright and data base generation right apply, which are very restrictive
* Data bases should be published with suitable persmissive licenses (e.g. CC-BY)
* https://open-power-system-data.org/legal
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
Presentation “'''Introduction to DMP and best practices'''” by Trond Kvamme, NSD.
Link: [http://eeradata.webfactional.com/WS1/dmp_eera_final.pdf]
Main points:
* Bulleted list item
* 2
* Links
Presentation on '''Machine-actionable DMPs''' by Tomasz Miksa, TU Vienna.
Link: [http://eeradata.webfactional.com/WS1/2020-RDA-Norway.pdf]
Main points:
* Bulleted list item
* 2
* Links
Discussion of '''[[DMP|EERAdata DMP draft]]''' (August, HVL). Main points:
* Bulleted list item
* 2
* Links
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

== WS1 through the lense of an artist ==
Day 1 presentations
<gallery>
Selection 188.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 189.png|D2
Selection 189.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 190.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 191.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 192.png|The EERAdata workshop seen by artist Barbara Bellier
Selection 193.png|The EERAdata workshop seen by artist Barbara Bellier
</gallery>

WS1

2020-06-10T08:07:49Z

Janpedroz: /* Agenda and notes Day 1 */

WS1

2020-06-10T07:46:37Z

Janpedroz: /* Agenda and notes Day 1 */

UC4

2020-06-04T07:40:02Z

Janpedroz: /* List of selected databases */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| The COMETS Inventory aims to track European Collective action initiatives (CAIs) for the energy transition. It is being developed as part of the EU Horizon 2020 COMETS project. The Database currently contains around 3700 entries of CAIs with information on their Legal form, area of activity, address, membership numbers, financial aspects, etc. It further includes roughly 7000 entries on energy production units owned by the CAIs, with information of the date of installation, location, energy type, installed capacity, etc. One goal in building this inventory is to build a knowledge base for well-informed policy development on European and national levels.
|| We own the database and therefore have it easier to exercise FAIRification and opening activities. The Database if further still in development, allowing FAIRification already in the initial phases of the database development, compared to retrospectively FAIRifying already existing databases.
|| 0% FAIR, as still under development. Currently only accessible locally by the COMETS consortium. Current issues:
* Defining relevant initiatives: varying legal forms in each country
* Clear definition of area of activities
|| Provide all administrative and structural metadata. To a certain degree provide provenance information. Issue regarding provenance information will be the technical question of how to link the provenance information to the actual database entries. Descriptive metadata: develop ontology for metadata.

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. || F - easy; A - easy; I – some problems can be identified (The database contains a description and metadata. Metadata are not always actual and sometime in national language, it's collecting data hub); R - fulfill || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || None, but intended to have: Deep descriptive metadata by ontology || None || none, but aiming for ontology || currently excel headers, but RDF intended
|-
| IEA Policy database [https://www.iea.org/policies] || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| EUR-Lex [https://eur-lex.europa.eu/homepage.html] || Metadata including: a unique identifier; title and references; dates eg. date of last review and date of initial creation date; classification (structural); summarized and linked document(s); miscellaneous information like "Author", "Form", "Additional information" + procedure detailed information; authentic language and other ||These are fully sufficient metadata || Example || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/]|| Administrative, Descriptive, Structural, Rights || Extensive metadata in form of basic metadata and full metadata || Findable (F.1; F.2; F.3 – YES; F.4 – N/A); Accessible (A.1 – YES; A.2 – N/A); Interoperable (I.1; I.2; I.3 – YES); Reusable (R.1 – YES) || Thesaurus || xml, plain text, RDF, xml, csv, etc.
|}

UC4

2020-06-03T15:07:09Z

Janpedroz: /* Metadata assessments */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| The COMETS Inventory aims to track European Collective action (CAI) initiatives for the energy transition. It is being developed as part of the EU Horizon 2020 COMETS project. The Database currently contains around 3700 entries of CAIs with information on their Legal form, area of activity, address, membership numbers, financial aspects, etc. It further includes roughly 7000 entries on energy production units owned by the CAIs, with information of the date of installation, location, energy type, installed capacity, etc. One goal in building this inventory is to build a knowledge base for well-informed policy development on European and national levels.
|| We own the database and therefore have it easier to exercise FAIRification and opening activities. The Database if further still in development, allowing FAIRification already in the initial phases of the database development, compared to retrospectively FAIRifying already existing databases.
|| 0% FAIR, as still under development. Currently only accessible locally by the COMETS consortium. Current issues:
* Defining relevant initiatives: varying legal forms in each country
* Clear definition of area of activities
|| Provide all administrative and structural metadata. To a certain degree provide provenance information. Issue regarding provenance information will be the technical question of how to link the provenance information to the actual database entries. Descriptive metadata: develop ontology for metadata.

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. || F - easy; A - easy; I – some problems can be identified (The database contains a description and metadata. Metadata are not always actual and sometime in national language; R - fulfill || Example
|-
| Example || Example || Example || Example || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS [Link to database 1|Database 1]] || Which types of metadata are covered? Administrative, descriptive, structural, provenance of data, etc.? || Summarize: Is it rich or basic metadata provided for each of the types? || Check the Wilkinson criteria for metadata and summarize here. In case more space is needed, link to a section of [[WS1UC4]]. || What framework is used, e.g., controlled vocabulary, taxonomy, thesaurus, ontology? || How are metadata implemented? As xml, plain text, RDF, etc.
|-
| IEA Policy database || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || None, but intended to have: Deep descriptive metadata by ontology || None || none, but aiming for ontology || currently excel headers, but RDF intended
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|}

UC4

2020-06-03T15:01:42Z

Janpedroz: /* List of selected databases */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| The COMETS Inventory aims to track European Collective action (CAI) initiatives for the energy transition. It is being developed as part of the EU Horizon 2020 COMETS project. The Database currently contains around 3700 entries of CAIs with information on their Legal form, area of activity, address, membership numbers, financial aspects, etc. It further includes roughly 7000 entries on energy production units owned by the CAIs, with information of the date of installation, location, energy type, installed capacity, etc. One goal in building this inventory is to build a knowledge base for well-informed policy development on European and national levels.
|| We own the database and therefore have it easier to exercise FAIRification and opening activities. The Database if further still in development, allowing FAIRification already in the initial phases of the database development, compared to retrospectively FAIRifying already existing databases.
|| 0% FAIR, as still under development. Currently only accessible locally by the COMETS consortium. Current issues:
* Defining relevant initiatives: varying legal forms in each country
* Clear definition of area of activities
|| Provide all administrative and structural metadata. To a certain degree provide provenance information. Issue regarding provenance information will be the technical question of how to link the provenance information to the actual database entries. Descriptive metadata: develop ontology for metadata.

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. || F - easy; A - easy; I – some problems can be identified (The database contains a description and metadata. Metadata are not always actual and sometime in national language; R - fulfill || Example
|-
| Example || Example || Example || Example || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS [Link to database 1|Database 1]] || Which types of metadata are covered? Administrative, descriptive, structural, provenance of data, etc.? || Summarize: Is it rich or basic metadata provided for each of the types? || Check the Wilkinson criteria for metadata and summarize here. In case more space is needed, link to a section of [[WS1UC4]]. || What framework is used, e.g., controlled vocabulary, taxonomy, thesaurus, ontology? || How are metadata implemented? As xml, plain text, RDF, etc.
|-
| IEA Policy database || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|}

UC4

2020-06-03T14:42:10Z

Janpedroz: /* List of selected databases */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| The COMETS Inventory aims to track European Collective action (CAI) initiatives for the energy transition. It is being developed as part of the EU Horizon 2020 COMETS project. The Database currently contains around 3700 entries of CAIs with information on their Legal form, area of activity, address, membership numbers, financial aspects, etc. It further includes roughly 7000 entries on energy production units owned by the CAIs, with information of the date of installation, location, energy type, installed capacity, etc. One goal in building this inventory is to build a knowledge base for well-informed policy development on European and national levels.
|| We own the database and therefore have it easier to exercise FAIRification and opening activities. The Database if further still in development, allowing FAIRification already in the initial phases of the database development, compared to retrospectively FAIRifying already existing databases.
|| 0% FAIR, as still under development. Currently only accessible locally by the COMETS consortium. Current issues:
* Defining relevant initiatives: varying legal forms in each country
* Clear definition of area of activities
|| What FAIR/O target was decided?

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. || F - easy; A - easy; I – some problems can be identified (The database contains a description and metadata. Metadata are not always actual and sometime in national language; R - fulfill || Example
|-
| Example || Example || Example || Example || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS [Link to database 1|Database 1]] || Which types of metadata are covered? Administrative, descriptive, structural, provenance of data, etc.? || Summarize: Is it rich or basic metadata provided for each of the types? || Check the Wilkinson criteria for metadata and summarize here. In case more space is needed, link to a section of [[WS1UC4]]. || What framework is used, e.g., controlled vocabulary, taxonomy, thesaurus, ontology? || How are metadata implemented? As xml, plain text, RDF, etc.
|-
| IEA Policy database || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|}

UC4

2020-06-03T14:37:53Z

Janpedroz: /* List of selected databases */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| The COMETS Inventory aims to track European Collective action (CAI) initiatives for the energy transition. It is being developed as part of the EU Horizon 2020 COMETS project. The Database currently contains around 3700 entries of CAIs with information on their Legal form, area of activity, address, membership numbers, financial aspects, etc. It further includes roughly 7000 entries on energy production units owned by the CAIs, with information of the date of installation, location, energy type, installed capacity, etc. One goal in building this inventory is to build a knowledge base for well-informed policy development on European and national levels.
|| We own the database and therefore have it easier to exercise FAIRification and opening activities. The Database if further still in development, allowing FAIRification already in the initial phases of the database development, compared to retrospectively FAIRifying already existing databases.
|| 0% FAIR, as still under development. Currently only accessible locally by the COMETS consortium.
|| What FAIR/O target was decided?

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. || F - easy; A - easy; I – some problems can be identified (The database contains a description and metadata. Metadata are not always actual and sometime in national language; R - fulfill || Example
|-
| Example || Example || Example || Example || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS [Link to database 1|Database 1]] || Which types of metadata are covered? Administrative, descriptive, structural, provenance of data, etc.? || Summarize: Is it rich or basic metadata provided for each of the types? || Check the Wilkinson criteria for metadata and summarize here. In case more space is needed, link to a section of [[WS1UC4]]. || What framework is used, e.g., controlled vocabulary, taxonomy, thesaurus, ontology? || How are metadata implemented? As xml, plain text, RDF, etc.
|-
| IEA Policy database || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|}

WS1UC4

2020-06-03T14:11:01Z

Janpedroz: /* COMETS */

This page provides space for notes from workshop discussions of use case 4 during Day 2 of WS1.

== Interactive elements ==
The discussions can also benefit from considering the EERAdata storyboard and/or slido comments. See [[WS1#Interactive_elements]]

== Notes from the morning session ==
The morning session is dedicated to database discussions with the aim to select 3-5 databases from below's list of databases for further examination. The [[UC3#List_of_selected_databases|first table of the WIKI page]] is filled out by noon.

* The workshop has started with the short introduction round to enable peaople to know something about each other, especially of the specific institutions day-to-day approach to data use.
* Later on the base for further works was presented:
# screeening the databases --> names, short descriptions, rationale for preliminary choosing the database
# checking the datbases proposed already, adding new, if needed.
# discussion and evaluation of databases - to choose the most suitable one for further works

Segmenting databases into 2 categories:
# policy relevant databases, eg. COMETS, EU Merci, PETA4
# policy databases, eg. IEA Policy database, EUR-Lex, OECD, RES-Legal, MURE

From both categories, the most suitbale databases may be chosen. This will enable us to have a full spectrum - how energy policies may use both types of databases.

Chosen databases - after morning discussion
# COMETS
# EUR-Lex
# IEA Policy database
# JRC

The evaluation using a tool developed by Mark Wilkinson will be carried out on EUR-Lex, IEA and JRC during afternoon sesion. In this time will be also assesing databases has already chose by metadata aspects

=== Draft list of databases ===
The databases that had been identified as containing data in relation to low carbon energy and energy efficiency policy:

#[https://www.copernicus.eu/en Copernicus]
#[https://datacite.org DataCite]
#[https://www.vs.inf.ethz.ch/res/show.html?what=eco-data ECO data set]
#[https://energydata.info/ EnergyData]
#[https://www.resourceefficient.eu/en#explore-content EREK]
#[http://www.eumerci-portal.eu/web/guest/home EU Merci]
#[https://eur-lex.europa.eu/homepage.html?locale=en EUR-Lex]
#[https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en?redir=1 European Buildings Stock Observatory]
#[https://www.iea.org/policies IEA Policies database]
#[https://www.irena.org/Statistics/View-Data-by-Topic/Energy-Transition/REmap-Energy-Demand-and-Supply-by-Sector IRENA, REmap]
#[http://resourceirena.irena.org/gateway/ IRENA, Resource]
#[https://data.jrc.ec.europa.eu/ JRC-database hub]
#[https://ec.europa.eu/jrc/en/publication/jrc-idees-integrated-database-european-energy-sector-methodological-note JRC-IDEES: Integrated Database of the European Energy Sector: Metodological note]
#[https://ec.europa.eu/jrc/en/publication/eur-scientific-and-technical-research-reports/monitoring-ri-low-carbon-energy-technologies JRC: Monitoring R&I in Low-Carbon Energy Technologies
#[https://magic-nexus.eu/metadata-repository MAGIC]
#[https://data.nrel.gov/ NREL data]
#[https://odin.jrc.ec.europa.eu/odin/index.jsp ODIN: Online Data & Information Network for Energy]
#[https://data.oecd.org/ OECD data]
#[https://oeil.secure.europarl.europa.eu/oeil/home/home.do OEIL]
#[https://openei.org/wiki/Main_Page OPENEI]
#[https://heatroadmap.eu/peta4/ PETA4]
#[https://www.proquest.com/ PROQuest]
#[https://www.reeep.org/reegleinfo REEEP]
#[https://www.re3data.org/ Re3data.org]
#[http://www.res-legal.eu/home/ RES LEGAL]
#[https://setis.ec.europa.eu/publications/setis-research-innovation-data SETIS research and innovation data]
#[https://zenodo.org/ ZENODO]
#[https://cordis.europa.eu/project/id/837722 H2020 project COMETS] - EU-wide inventory of collective action initiatives in the low carbon energy transition
#[https://ec.europa.eu/info/sites/info/files/business_economy_euro/banking_and_finance/documents/200309-sustainable-finance-teg-final-report-taxonomy_en.pdf] - EU taxonomy for green innovation companies
#MURE (Mesures d'Utilisation Rationnelle de l'Energie)database [http://www.measures-odyssee-mure.eu/]

=== Discussion on the choice of databases: ===
* From GIG, apart from IEA Policy database, there will be also a proposition of EUR-Lex, DataCite, EU Merci, OECD, and probably also JRC-database.
* @ IUE and ENEA: each of you please suggest 2 other databases and prepare for them a description and an explanation - why we should choose them for further evaluation. Material please put in the Wiki.
* @ all: for databases that you suggested please complete the questionnaire from AIT in OO ([https://energydata.onlyoffice.eu/Products/Files/doceditor.aspx?fileid=5413183] and put answers into the folder in OO [https://energydata.onlyoffice.eu/products/projects/tmdocs.aspx?prjID=236894#1976709] until Friday 29.05.

==== COMETS database: EU-wide inventory of collective action initiatives in the energy transition ====
''Description of database:''
The inventory is a multi-country database of collective action initiatives (e.g., energy cooperatives, eco-villages, community energy projects, and other citizen-led energy projects). For each initiative, the country, the date of foundation/cancellation, the evolution of members and renewable energy units, installation capacities, fields of engagement, legal form, website, address, source, etc. is collected. The entries are sourced from a variety of national, regional, and European registers and websites.

''Rationale for choosing this database'':
*The database is of policy relevance. Its data interpretation is highly dependent on changes in the legal and policy frameworks across Europe.
*We own the database and therefore have it easier to exercise FAIRification and opening activities.
*The database is being created in a parallel running European project and we would not like that the database ends in the graveyard of dead EU project databases.
*We aim at opening the database to the low carbon research community within the next two years.
*We are interested to explore the options for opening while ensuring that our work in building the database is appropriately acknowledged. This is relevant for later EERAdata discussion. Here, we already started discussing with e3s and tJP of EERAdata.
*We can use synergies with another parallel EU project and have the possibility to assign rich metadata to every single entry, by also using the expertise of researchers from the COMETS project.
*The database itself has a relatively simple structure, however, the inventory contains heterogeneous and dynamic data. Thus, it helps us to investigate how to approach FAIRification for such data. This is a particular challenge for UC4.
*Sources of the COMETS database are coming in a variety of European languages, all brought together in an English database. Thus, it helps us to investigate the relevance of languages for FAIRification and opening activities. This is also a particular challenge for UC4.
*We aim at uploading this database as an example for EERAdata to EOSC. We hope to create a best practice example for a FAIR and open database. Currently, it is F - non-existing, A - non-existing., I - partly as one can, e.g., go to the currently published papers to access the original sources. But it is not machine-actionable. R - no, because it is currently not open.

''Reference:'' Wierling, A.; Schwanitz, V.J.; Zeiß, J.P.; Bout, C.; Candelise, C.; Gilcrease, W.; Gregg, J.S. [https://www.mdpi.com/2071-1050/10/9/3339 Statistical Evidence on the Role of Energy Cooperatives for the Energy Transition in European Countries]. Sustainability.

==== IEA Policy database ====
''Description of the database:''
A worldwide database of past, future and planned policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999.

''Rationale for choosing this database:''
* A popular, recognized, and world-wide database hosted by a reputable institution.
* Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database,
* Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2).

==== EU Taxonomy for green innovation companies ====
''Description of the database:''
The EU Taxonomy is a tool to help investors, companies, issuers, and project promoters navigate the transition to a low-carbon, resilient and resource-efficient economy. The Taxonomy sets performance thresholds (referred to as ‘technical screening criteria’) for economic activities which: • make a substantive contribution to one of six environmental objectives (Figure 1); • do no significant harm (DNSH) to the other five, where relevant; • meet minimum safeguards (e.g., OECD Guidelines on Multinational Enterprises and the UN Guiding Principles on Business and Human Rights). The performance thresholds will help companies, project promoters and issuers access green financing to improve their environmental performance, as well as helping to identify which activities are already environmentally friendly. In doing so, it will help to grow low-carbon sectors and decarbonise high-carbon ones. The EU Taxonomy is one of the most significant developments in sustainable finance and will have wide-ranging implications for investors and issuers working in the EU, and beyond.

''Rationale for choosing this database:''
* It is low-hanging fruit because taxonomy is already in place.
* We could use this taxonomy to see how it aligns with our other assessments (and with other use cases)
* The taxonomy will be enacted in a year from now, so we can provide timely feedback

''Reference:'' [[https://ec.europa.eu/info/sites/info/files/business_economy_euro/banking_and_finance/documents/200309-sustainable-finance-teg-final-report-taxonomy_en.pdf]]

==== EUR-Lex ====
''Description of the database:''
EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952.

''Rationale for choosing this database:''
* It is available in all of the EU’s 24 official languages
* It is updated daily, which confirms the validity of the documents
* Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc.
* It is the open and highly recognizable European Union’s database directly related to policy
* Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”.

==== EU MERCI ====
''Description of the database:''
The database contains data on the implementation of energy efficiency measures in the manufacturing industry. For nearly 3000 companies from 4 European countries (Austria, Italy, Poland, United Kingdom), the following information has been collected: size of the company, year of implementation of the measure, type of support received (white certificates), statistical classification of economic activities, according to NACE, applied processes and ways to save energy and total final energy savings achieved by the implemented measures.
The database contains data also on low-carbon policies, examples of business action to reduce emissions, etc.
The database includes data for the 2005-2017 period. Besides the database, also a library, sector reports and static analyses of different countries were made available.

''Rationale for choosing this database:''
* The database contains good practices that can be used by other actors willing to implement energy efficiency measures,
* Disadvantages of the database: It includes data from the 2005-2017 period, with no updates (no newer examples)

==== OECD database ====
''Description of the database:''
OECD database makes available data related to agriculture, development, economy, education, energy, environment, finance, government, health, innovation and technology, jobs and society. In each of these areas the database contains, inter alia, data on legal issues. In the area of energy, data can be assigned thematically to: primary energy supply, crude oil production, electricity generation, renewable energy, nuclear power plants, crude oil import prices.
The data comes from over 130 countries around the world. The database allows sharing data in the form of indicators, maps and tables. The data is collected and made available since 1960.

''Rationale for choosing this database:''
* It is a popular, well recognised worldwide database, maintained by a reputable institution,
* Since we are not able to analyze all the databases that we would like to - the selection of the OECD database would indirectly allow us to take into account several other, selected databases because it contains data from: the IEA database - International Energy Agency (https://www.iea.org/) and Nuclear Energy Agency (http://www.oecd-nea.org/).

==== ISTAT energy data ====
'' Description of the database: ''
I.Stat is the warehouse of statistics currently produced by the Italian National Institute of Statistics.Statistics are searchable by theme. The system is also consultable by keyword. Data are presented in multidimensional tables which users can export in xls, csv formats. Acting on variables, reference periods and the arrangement of heads and sides, moreover, it is possible to obtain custom tables.
Through a web service that allows direct machine-to-machine questioning, organizations, as well as private citizens, can form specific query data, download results. The service is accessible at the following address: https://www.istat.it/it/metodi-e-strumenti/web-service-sdmx

'' Rationale for choosing this database: ''
* It’s a complete overview of energy consumption in Italy in all sectors of the society.

==== SETIS Innovation and Research data ====
'' Description of the database: ''
The level of investment in R&I in terms of both private (expenditure by businesses and industry) and public (Member States' national programmes and instruments), and trends in patents, for the Integrated SET Plan Actions.

'' Rationale for choosing this database: ''
The Integrated SET Plan needs to be underpinned by an effective monitoring and reporting scheme that supports the development and implementation of the European R&I Agenda. SETIS plays a central role in the successful implementation of the Integrated SET Plan 10 key actions. In particular, the enhanced SETIS follows the objectives below:
* To monitor R&I activities, investments and technology progress in Europe;
* To contribute to the identification of gaps in the implementation of the actions;
* To report on the overall progress towards the common goals set out in the integrated SET-Plan;
* To contribute to assessing the impact of the SET-Plan on European competitiveness;
* To make recommendations for actions that could further increase the effectiveness of the European R&I Strategy.

==== ENERGISE Online Database ====
'' Description of the database: ''
The Database is an output of the H2020 Energise Project. The project aims at testing household and community-level initiatives to reduce energy consumption through energy cultures. An output of the project forms the database that contains data on 1067 energy initiatives from 30 European countries.

'' Rationale for choosing this database: ''
* The database contains recent information on a considerable number of (1067) initiatives pertaining to household and community-level energy policies. Thus, its representativeness is for European countries is high.
* Since the focus of the EERAdata project is mainly concerning the European Union countries, this database is a good fit in terms of scope.
* The database hosts information that would be gathered from national sources of each country, hence may be considered as a repository for national databases.

==== MURE Online Database ====
'' Description of the database: ''
MURE (Mesures d'Utilisation Rationnelle de l'Energie) is a comprehensive database that lists energy efficiency policies and measures regarding the Member States of the European Union. It allows for the analysis of policies based on topics, policy interaction, policy scoring, impact evaluation, as well as successful policies. The information is accessible by query in the database. The contributors are French Environment and Energy Management Agency, European Energy Network, and the H2020 program of the European Union.

Relates to the Odyssee database on energy-efficiency indicators and energy consumption.

Reference: [http://www.measures-odyssee-mure.eu Odyssee-MURE project]

'' Rationale for choosing this database: ''
* A comprehensive database including energy efficiency policies and measures in the European Union member states.
* Since the focus of the EERAdata project is mainly concerning the European Union countries, this database is a good fit in terms of scope.
* The database hosts information that would be gathered from national sources of each country, hence may be considered as a repository for national databases.
* The database pertains to both Uses Case 4 on Energy Policies and Use Case 1 on Buildings Efficiency.

==== JRC-database hub: Joint Research Centre Data Catalogue ====
'' Description of database: ''
The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate
'' Rationale for choosing this database: ''
* It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related
* It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union.
* The database enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data.
* The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,
* Sources of the database are coming in a variety of European languages, all brought together in an English database. Thus, it helps to investigate the relevance for FAIRification and opening activities.
* The database is cross-use case relevant, as it contains policies and measures also for other use cases.

==== DataCite - an international not-for-profit organization aiming to improve data citation ====
'' Description of database: ''
The main aim of DataCite is to provide the means to create, find, cite, connect, and use research. The primary service provided by DataCite is the registration of DOI tags. In addition, DataCite is constantly developing additional services related to DOI and related metadata, as following:
* DataCite Search (https://search.datacite.org/) - allows to search the database of DOI metadata registered in DataCite.
* DataCite Profiles (https://profiles.datacite.org/) - allows for automatic data transfer between the DataCite and ORCID systems, facilitating the update of personal profiles of researchers in ORCID with information about objects for which DOIs have been registered in DataCite.
* DataCite Statistics (https://stats.datacite.org/) - a service presenting statistical data on the number of registered DOI, their metadata records and the use of this information.
* DataCite OAI-PMH Provider (https://oai.datacite.org/) - an access interface to metadata collected in DataCite using the OAI-PMH protocol.
In addition, DataCite is involved in international projects and initiatives related to sharing and quoting research data, such as:
* the worldwide Registry of Research Data Repositories - Re3Data (https://www.re3data.org/).
* The Initiative for Open Citations (I4OC) = a collaboration between scholarly publishers, researchers, and other interested parties to promote the unrestricted availability of scholarly citation data and to make these data available.

'' Rationale for choosing this database: ''
* The inventory contains heterogeneous and dynamic data. Thus, it helps us to investigate how to approach FAIRification for such data.
* DataCite provides an integrated search interface, where it is possible to search and filter a relevant metadata gathered
* Sources of the database are coming in a variety of European languages. Thus, it helps to investigate the relevance for FAIRification and opening activities.
* The database may be cross-use case relevant, as it contains DOIs and citations relevant also for other use cases.

== Notes from the afternoon session ==
The afternoon session is dedicated to discussing metadata for the selected databases. The aim of the afternoon session is to fill out [[UC3#Metadata_assessments|table 2 of the wiki page for the use case]] and to decide what to report back from the use case to the plenary session the next day (again, see the WIKI template for a suggested structure). Thus, at the end of the day, the WIKI page for the use case is complete.

=== Assessment of metadata for databases ===
# IEA Policy database
# COMETS
# JRC database hub
# EUR-Lex

==== IEA Policy database ====

* preliminary assessment of level of implementation of FAIR/O principles: F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards.
* Metadate seems to be spread.
* Discussion on understanding of 100% fulfillement, on the example: In ideal database all country names would be linked to official registry --> you could go for all information. It would be 100% FAIR. Are any bases like that? Example on country information, which should be easily available automatically, for example ISO code for the country. IEA policy database is not fully like that.
* difficulties even in defining "policy" = everything (every official document) which is published in official governmental page.
* testing on the example of Poland and National Energy Efficency Action Plan for Poland: link to the official governmental page, not the direct link to the official document or to the official country law. When information about the date of update - should be also a linked to the local page (to ensure that the is a possibility to check at the source, if the policy has been already updated.
* if metadata doesn't provide the possibility of reachning the sources (if the documents are there, but you don't have an opportunity to get to the official, legal document).

==== COMETS ====
* information on collective actions initiatives for the energy transition for all EU countries.
* 3700 initiatives in selected European countries - Germany, Belgium, Czech Republic, Switzerland, Danmark,
* based on the internet desk research, business registers, national electricity production statistics, individual websites etc.
* energy production units / electriciity facilitiation units - including more than 6000
* within the project in six countries (DE, ES, BE, PL, EE, NL) they are conducting survey about the development and values (export, import). The data from it will be also included into the database/.
* as it's still under development - FAIRness is 0% for now.
* from COMETS project perspective, an important step for FAIRification is to facilitate by categorization, what and how specific activities are currently being implemented in different countries, categorization of them, taxonomy.

==== General conclusions ====

* discussion on Wilkinson FAIR priniciples --> if there are any databases which are 100% in accordance to these principles. 100% is an utopia. We only can make a hierarchy, which databases are matching these criteria better, or worse.
* in Mons system - it's more clear that you have to achieve specific level, to be able to go further.

* two possible approaches: (1) start of absolute lowest datasets and try to FAIRify those, and later on move "up". (2) on the other hand FAIRification of database which are more complex is leading us to results / conlcussions available also for less complicated databases.

* importance of formats of data. It is important that the format of the data to be entered in specific entry is strictly defined (example - the date: need of clear definitions - what's to include: year, month, day specific?) Similarly - with longitude, latitute. If it's not done in advance, later on it takes much work to manually change it and put into right format. On the other hand - potentially - making a very specific description - may exclude some data, which are available but in different standards - for ecxample between EU and American standards.
* every entry has its provenence, with information how the entry hhas been changed, when, etc. Basically all entries should have their own metadata.

* two dimensions of policies:
1) policy domain (topic of the policy)
2) policy perspective / the level of goverment (for whom it's developed = local regional, national, international level, etc)

==== directions in building taxonomy ====
* Example to be watched: EU taxonomy for green innovation companies
* UC4 taxomnomy needs to match to higher level = overall level of the projects. To make sure, that the complete taxonomy is

Proposed logical aspects / steps:
# starting on agreement of keywords + the glossry, to ensure common understanding.
# taking into consideration two dimensions of policies: (1) policy domain and (2) policy level of goverment
# coordinationg with other use cses: UC4 is affecting other use cases, so our keywords should not only match, but sometimes should be even taken from other use cases.

== What to report back to the plenary on Day 3? ==
* Databases selected (names and short reasoning)
* Main insights from discussions
* Suggested next steps
* Other issues

UC4

2020-06-03T13:23:51Z

Janpedroz: /* Metadata assessments */

== Low carbon energy and energy efficiency policies ==
=== General description of use case ===
The motivation for this use case is the significant role of policies, laws, and regulations in catalyzing the transformation of the energy system towards greenhouse gas and energy efficiency. They provide the ground for accelerating research and innovation, incentivizing behavioral changes, and safeguarding the necessary transformation processes. Through their texts and specifications, policies, laws, and regulations are not only defining the space for the application of energy technologies and low carbon energy materials, but they also provide the framework for market activities in general. An example is the enabling of new actors to appear on the energy market (e.g. prosumers, community energy, and energy cooperatives). Currently, a new role for data on low carbon energy and energy efficiency policies is emerging. The need to provide documentation on compliance with regulations is starkly increasing in complexity as integrated monitoring and assessment across fields and economic sectors are increasing. This not only refers to international compliance requirements (e.g. National Greenhouse Gas Inventories, Intended Nationally Determined Contributions, Progress Reports for Sustainable Development Goals), but also to the level of companies whose produces have to adhere to given standards and documentation has to be provided for the entire supply chain (c.f. Ly et al. 2015 on a review of business process compliance approaches). Machine-actionability of relevant policy databases from local to global scale is therefore key for automated tracking, compilation, and inter-comparison with peers. Here, new business opportunities are arising. Overall, the state about the application of FAIR principles is still in its infancy. Openness is by nature less of an issue for this use case, but a specific challenge originates from mixed data formats, which include texts as well as number formats. Examples of databases from which EERAdata starts the use case activities include the IEA policy & measures databases, SETIS research, and innovation data, ResLegal, JRC in-house methodology for Monitoring R&I in Low-Carbon Energy Technologies, InnovationDB or activities, and tools developed in H2020 project ODYSSEE-MURE

== List of selected databases ==
During the first workshop (see notes from Day 2), the following databases were selected to analyze and improve their compliance with FAIR and Open data principles:
{| class="wikitable"
|-
! Name of database !! Short description !! Reasoning of choice !! Current state of FAIR/O principles !! Target of FAIR/O to achieve within EERAdata
|-
| COMETS [https://cordis.europa.eu/project/id/837722]
|| Write a short description, e.g., "Database 1 is about XXX, containing XXX data, covering the period xxx."
|| Summarize shortly the main reasons, why this DB was chosen. Link to the discussion page of [[WS1UC4]].
|| What is the current FAIR/O state for this database. Summarize here. In case more space is needed, link to a section of the discussion page of [[WS1UC4]].
|| What FAIR/O target was decided?

|-
| IEA Policy Database [https://www.iea.org/policies] || Database of policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999. || • A popular, recognized, and world-wide database hosted by a reputable institution. • Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, • Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2). || F - easy;
A - easy;
I – quite ok (The database contains a description and metadata. Metadata are always available on IEA Policy database webside in English, but the document is linked to the page where it was published. So the language availability of a document depends on the publisher. Practically, many times the documents are available only in national language. Sometimes there is no link)
R - it seems to be ok || Example
|-
| EUR-Lex [https://eur-lex.europa.eu] || EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952|| • It is available in all of the EU’s 24 official languages • It is updated daily, which confirms the validity of the documents • Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc. • It is the open and highly recognizable European Union’s database directly related to policy • Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”. || Example || Example
|-
| JRC database hub [https://data.jrc.ec.europa.eu/] || The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate ||• It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related • It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union. • Enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data. • The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,* Sources of the database are coming in a variety of European languages, all brought together in an English database. • Is cross-use case relevant, as it contains policies and measures also for other use cases. Example || Example || Example
|-
| Example || Example || Example || Example || Example
|}

== Metadata assessments ==
Databases above were assessed with respect to their current meta practices. The table below summarizes the current state and issues identified during WS 1:
{| class="wikitable"
|-
! Name of database !! Type of metadata provided !! Extend of metadata provided !! Level of implementation of FAIR/O principles !! Frameworks for metadata used !! Technical implementation of metadata
|-
| COMETS [Link to database 1|Database 1]] || Which types of metadata are covered? Administrative, descriptive, structural, provenance of data, etc.? || Summarize: Is it rich or basic metadata provided for each of the types? || Check the Wilkinson criteria for metadata and summarize here. In case more space is needed, link to a section of [[WS1UC4]]. || What framework is used, e.g., controlled vocabulary, taxonomy, thesaurus, ontology? || How are metadata implemented? As xml, plain text, RDF, etc.
|-
| IEA Policy database || administrative, descriptive, rights, structural || Administrative - intrinsic; Descriptive - extrinsic; Rights - intrinsic; Structural - intrinsic || F4 - yes; A1 - yes, A2 - yes (only depends on EU policy); I1 - yes; I2 - fulfilled, I3 - fulfilled; R1.1 - yes; R1.2 - no; R1.3 - not fulfilled, not even the DC standards. || thesaurus || LOD (linking open data) and plain text
|-
| COMETS Inventory || Administrative - partly (source of information, Tracking of updates); Rights - to be defined soon || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|-
| Example || Example || Example || Example || Example || Example
|}

WS1UC4

2020-06-03T09:38:15Z

Janpedroz: /* Notes from the morning session */

This page provides space for notes from workshop discussions of use case 4 during Day 2 of WS1.

== Interactive elements ==
The discussions can also benefit from considering the EERAdata storyboard and/or slido comments. See [[WS1#Interactive_elements]]

== Notes from the morning session ==
The morning session is dedicated to database discussions with the aim to select 3-5 databases from below's list of databases for further examination. The [[UC3#List_of_selected_databases|first table of the WIKI page]] is filled out by noon.

* The workshop has started with the short introduction round to enable peaople to know something about each other, especially of the specific institutions day-to-day approach to data use.
* Later on the base for further works was presented:
# screeening the databases --> names, short descriptions, rationale for preliminary choosing the database
# checking the datbases proposed already, adding new, if needed.
# discussion and evaluation of databases - to choose the most suitable one for further works

Segmenting databases into 2 categories:
# policy relevant databases, eg. COMETS, EU Merci, PETA4
# policy databases, eg. IEA Policy database, EUR-Lex, OECD, RES-Legal, MURE

From both categories, the most suitbale databases may be chosen. This will enable us to have a full spectrum - how energy policies may use both types of databases.

=== Draft list of databases ===
The databases that had been identified as containing data in relation to low carbon energy and energy efficiency policy:

#[https://www.copernicus.eu/en Copernicus]
#[https://datacite.org DataCite]
#[https://www.vs.inf.ethz.ch/res/show.html?what=eco-data ECO data set]
#[https://energydata.info/ EnergyData]
#[https://www.resourceefficient.eu/en#explore-content EREK]
#[http://www.eumerci-portal.eu/web/guest/home EU Merci]
#[https://eur-lex.europa.eu/homepage.html?locale=en EUR-Lex]
#[https://ec.europa.eu/energy/topics/energy-efficiency/energy-efficient-buildings/eu-bso_en?redir=1 European Buildings Stock Observatory]
#[https://www.iea.org/policies IEA Policies database]
#[https://www.irena.org/Statistics/View-Data-by-Topic/Energy-Transition/REmap-Energy-Demand-and-Supply-by-Sector IRENA, REmap]
#[http://resourceirena.irena.org/gateway/ IRENA, Resource]
#[https://data.jrc.ec.europa.eu/ JRC-database hub]
#[https://ec.europa.eu/jrc/en/publication/jrc-idees-integrated-database-european-energy-sector-methodological-note JRC-IDEES: Integrated Database of the European Energy Sector: Metodological note]
#[https://ec.europa.eu/jrc/en/publication/eur-scientific-and-technical-research-reports/monitoring-ri-low-carbon-energy-technologies JRC: Monitoring R&I in Low-Carbon Energy Technologies
#[https://magic-nexus.eu/metadata-repository MAGIC]
#[https://data.nrel.gov/ NREL data]
#[https://odin.jrc.ec.europa.eu/odin/index.jsp ODIN: Online Data & Information Network for Energy]
#[https://data.oecd.org/ OECD data]
#[https://oeil.secure.europarl.europa.eu/oeil/home/home.do OEIL]
#[https://openei.org/wiki/Main_Page OPENEI]
#[https://heatroadmap.eu/peta4/ PETA4]
#[https://www.proquest.com/ PROQuest]
#[https://www.reeep.org/reegleinfo REEEP]
#[https://www.re3data.org/ Re3data.org]
#[http://www.res-legal.eu/home/ RES LEGAL]
#[https://setis.ec.europa.eu/publications/setis-research-innovation-data SETIS research and innovation data]
#[https://zenodo.org/ ZENODO]
#[https://cordis.europa.eu/project/id/837722 H2020 project COMETS] - EU-wide inventory of collective action initiatives in the low carbon energy transition
#[https://ec.europa.eu/info/sites/info/files/business_economy_euro/banking_and_finance/documents/200309-sustainable-finance-teg-final-report-taxonomy_en.pdf] - EU taxonomy for green innovation companies

=== Discussion on the choice of databases: ===
* From GIG, apart from IEA Policy database, there will be also a proposition of EUR-Lex, DataCite, EU Merci, OECD, and probably also JRC-database.
* @ IUE and ENEA: each of you please suggest 2 other databases and prepare for them a description and an explanation - why we should choose them for further evaluation. Material please put in the Wiki.
* @ all: for databases that you suggested please complete the questionnaire from AIT in OO ([https://energydata.onlyoffice.eu/Products/Files/doceditor.aspx?fileid=5413183] and put answers into the folder in OO [https://energydata.onlyoffice.eu/products/projects/tmdocs.aspx?prjID=236894#1976709] until Friday 29.05.

==== COMETS database: EU-wide inventory of collective action initiatives in the energy transition ====
''Description of database:''
The inventory is a multi-country database of collective action initiatives (e.g., energy cooperatives, eco-villages, community energy projects, and other citizen-led energy projects). For each initiative, the country, the date of foundation/cancellation, the evolution of members and renewable energy units, installation capacities, fields of engagement, legal form, website, address, source, etc. is collected. The entries are sourced from a variety of national, regional, and European registers and websites.

''Rationale for choosing this database'':
*The database is of policy relevance. Its data interpretation is highly dependent on changes in the legal and policy frameworks across Europe.
*We own the database and therefore have it easier to exercise FAIRification and opening activities.
*The database is being created in a parallel running European project and we would not like that the database ends in the graveyard of dead EU project databases.
*We aim at opening the database to the low carbon research community within the next two years.
*We are interested to explore the options for opening while ensuring that our work in building the database is appropriately acknowledged. This is relevant for later EERAdata discussion. Here, we already started discussing with e3s and tJP of EERAdata.
*We can use synergies with another parallel EU project and have the possibility to assign rich metadata to every single entry, by also using the expertise of researchers from the COMETS project.
*The database itself has a relatively simple structure, however, the inventory contains heterogeneous and dynamic data. Thus, it helps us to investigate how to approach FAIRification for such data. This is a particular challenge for UC4.
*Sources of the COMETS database are coming in a variety of European languages, all brought together in an English database. Thus, it helps us to investigate the relevance of languages for FAIRification and opening activities. This is also a particular challenge for UC4.
*We aim at uploading this database as an example for EERAdata to EOSC. We hope to create a best practice example for a FAIR and open database. Currently, it is F - non-existing, A - non-existing., I - partly as one can, e.g., go to the currently published papers to access the original sources. But it is not machine-actionable. R - no, because it is currently not open.

''Reference:'' Wierling, A.; Schwanitz, V.J.; Zeiß, J.P.; Bout, C.; Candelise, C.; Gilcrease, W.; Gregg, J.S. [https://www.mdpi.com/2071-1050/10/9/3339 Statistical Evidence on the Role of Energy Cooperatives for the Energy Transition in European Countries]. Sustainability.

==== IEA Policy database ====
''Description of the database:''
A worldwide database of past, future and planned policies and measures thematically related to reduce greenhouse gas emissions, improve energy efficiency and support the development and deployment of renewables and other clean energy technologies. It contains data from IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database, along with information on CCUS and methane abatement policies. Data are collected from governments, partner organizations and IEA analysis since 1999.

''Rationale for choosing this database:''
* A popular, recognized, and world-wide database hosted by a reputable institution.
* Since we are not able to analyze all the databases that we would like to - the selection of the IEA Policy database would indirectly allow us to take into account several other, selected databases because it contains data from: IEA/IRENA Renewable Energy Policies and Measures Database, the IEA Energy Efficiency Database, the Addressing Climate Change database, and the Building Energy Efficiency Policies (BEEP) database,
* Cross-use case relevance, as it contains policies and measures also for buildings efficiency (UC1) and for power transmission and distribution networks (UC2).

==== EU Taxonomy for green innovation companies ====
''Description of the database:''
The EU Taxonomy is a tool to help investors, companies, issuers, and project promoters navigate the transition to a low-carbon, resilient and resource-efficient economy. The Taxonomy sets performance thresholds (referred to as ‘technical screening criteria’) for economic activities which: • make a substantive contribution to one of six environmental objectives (Figure 1); • do no significant harm (DNSH) to the other five, where relevant; • meet minimum safeguards (e.g., OECD Guidelines on Multinational Enterprises and the UN Guiding Principles on Business and Human Rights). The performance thresholds will help companies, project promoters and issuers access green financing to improve their environmental performance, as well as helping to identify which activities are already environmentally friendly. In doing so, it will help to grow low-carbon sectors and decarbonise high-carbon ones. The EU Taxonomy is one of the most significant developments in sustainable finance and will have wide-ranging implications for investors and issuers working in the EU, and beyond.

''Rationale for choosing this database:''
* It is low-hanging fruit because taxonomy is already in place.
* We could use this taxonomy to see how it aligns with our other assessments (and with other use cases)
* The taxonomy will be enacted in a year from now, so we can provide timely feedback

''Reference:'' [[https://ec.europa.eu/info/sites/info/files/business_economy_euro/banking_and_finance/documents/200309-sustainable-finance-teg-final-report-taxonomy_en.pdf]]

==== EUR-Lex ====
''Description of the database:''
EUR-Lex is online database that provides the official and most comprehensive access to EU Law and legal documents such as treaties, legal acts from EU institutions, preparatory documents related to EU legislation, EU case-law, international agreements, EFTA documents, references to national case-law related to EU law. EUR-Lex has access to all editions of the Official Journal of the European Union (OJ) since the first of December 1952.

''Rationale for choosing this database:''
* It is available in all of the EU’s 24 official languages
* It is updated daily, which confirms the validity of the documents
* Each document in EUR-Lex is supported by detailed information such as: relations with other legal documents, case-law interpretations, dates of adoption or entry into force etc.
* It is the open and highly recognizable European Union’s database directly related to policy
* Most documents in EUR-Lex, regardless of their language, receive a unique identifier - CELEX number, so all documents have a designed structure and each type of document corresponds to a so-called “a descriptor”.

==== EU MERCI ====
''Description of the database:''
The database contains data on the implementation of energy efficiency measures in the manufacturing industry. For nearly 3000 companies from 4 European countries (Austria, Italy, Poland, United Kingdom), the following information has been collected: size of the company, year of implementation of the measure, type of support received (white certificates), statistical classification of economic activities, according to NACE, applied processes and ways to save energy and total final energy savings achieved by the implemented measures.
The database contains data also on low-carbon policies, examples of business action to reduce emissions, etc.
The database includes data for the 2005-2017 period. Besides the database, also a library, sector reports and static analyses of different countries were made available.

''Rationale for choosing this database:''
* The database contains good practices that can be used by other actors willing to implement energy efficiency measures,
* Disadvantages of the database: It includes data from the 2005-2017 period, with no updates (no newer examples)

==== OECD database ====
''Description of the database:''
OECD database makes available data related to agriculture, development, economy, education, energy, environment, finance, government, health, innovation and technology, jobs and society. In each of these areas the database contains, inter alia, data on legal issues. In the area of energy, data can be assigned thematically to: primary energy supply, crude oil production, electricity generation, renewable energy, nuclear power plants, crude oil import prices.
The data comes from over 130 countries around the world. The database allows sharing data in the form of indicators, maps and tables. The data is collected and made available since 1960.

''Rationale for choosing this database:''
* It is a popular, well recognised worldwide database, maintained by a reputable institution,
* Since we are not able to analyze all the databases that we would like to - the selection of the OECD database would indirectly allow us to take into account several other, selected databases because it contains data from: the IEA database - International Energy Agency (https://www.iea.org/) and Nuclear Energy Agency (http://www.oecd-nea.org/).

==== ISTAT energy data ====
'' Description of the database: ''
I.Stat is the warehouse of statistics currently produced by the Italian National Institute of Statistics.Statistics are searchable by theme. The system is also consultable by keyword. Data are presented in multidimensional tables which users can export in xls, csv formats. Acting on variables, reference periods and the arrangement of heads and sides, moreover, it is possible to obtain custom tables.
Through a web service that allows direct machine-to-machine questioning, organizations, as well as private citizens, can form specific query data, download results. The service is accessible at the following address: https://www.istat.it/it/metodi-e-strumenti/web-service-sdmx

'' Rationale for choosing this database: ''
* It’s a complete overview of energy consumption in Italy in all sectors of the society.

==== SETIS Innovation and Research data ====
'' Description of the database: ''
The level of investment in R&I in terms of both private (expenditure by businesses and industry) and public (Member States' national programmes and instruments), and trends in patents, for the Integrated SET Plan Actions.

'' Rationale for choosing this database: ''
The Integrated SET Plan needs to be underpinned by an effective monitoring and reporting scheme that supports the development and implementation of the European R&I Agenda. SETIS plays a central role in the successful implementation of the Integrated SET Plan 10 key actions. In particular, the enhanced SETIS follows the objectives below:
* To monitor R&I activities, investments and technology progress in Europe;
* To contribute to the identification of gaps in the implementation of the actions;
* To report on the overall progress towards the common goals set out in the integrated SET-Plan;
* To contribute to assessing the impact of the SET-Plan on European competitiveness;
* To make recommendations for actions that could further increase the effectiveness of the European R&I Strategy.

==== ENERGISE Online Database ====
'' Description of the database: ''
The Database is an output of the H2020 Energise Project. The project aims at testing household and community-level initiatives to reduce energy consumption through energy cultures. An output of the project forms the database that contains data on 1067 energy initiatives from 30 European countries.

'' Rationale for choosing this database: ''
* The database contains recent information on a considerable number of (1067) initiatives pertaining to household and community-level energy policies. Thus, its representativeness is for European countries is high.
* Since the focus of the EERAdata project is mainly concerning the European Union countries, this database is a good fit in terms of scope.
* The database hosts information that would be gathered from national sources of each country, hence may be considered as a repository for national databases.

==== Mure Online Database ====
'' Description of the database: ''
MURE (Mesures d'Utilisation Rationnelle de l'Energie) is a comprehensive database that lists energy efficiency policies and measures regarding the Member States of the European Union. It allows for the analysis of policies based on topics, policy interaction, policy scoring, impact evaluation, as well as successful policies. The information is accessible by query in the database. The contributors are French Environment and Energy Management Agency, European Energy Network, and the H2020 program of the European Union.

'' Rationale for choosing this database: ''
* A comprehensive database including energy efficiency policies and measures in the European Union member states.
* Since the focus of the EERAdata project is mainly concerning the European Union countries, this database is a good fit in terms of scope.
* The database hosts information that would be gathered from national sources of each country, hence may be considered as a repository for national databases.
* The database pertains to both Uses Case 4 on Energy Policies and Use Case 1 on Buildings Efficiency.

==== JRC-database hub: Joint Research Centre Data Catalogue ====
'' Description of database: ''
The JRC Science Hub aims to gradually integrate and aggregate all of the European Commission's science related activities, tools, laboratories, facilities, databases and networks. The inventory is wide range of the compilation of databases development of software and modelling tools. Published on the basis of open data principles with clear descriptions for each entry. The tools and databases are categorised by name and acronym, but can be filtered by research area, keyword and JRC institute responsible for the coordination of the particular entry. It contains, inter alia, databases related to energy and transport and climate
'' Rationale for choosing this database: ''
* It’s the open and highly recognizable European Union’s database directly related to different related aspects also energy policy related
* It’s data interpretation is highly dependent on changes in the legal and policy frameworks across European Union.
* The database enhances the transparency and openness of the JRC and further enables the open access policy of scientific research data.
* The information and links provided in the metadata are maintained in distributed and heterogeneous information systems. Although the datasets are maintain and links and information are updated,
* Sources of the database are coming in a variety of European languages, all brought together in an English database. Thus, it helps to investigate the relevance for FAIRification and opening activities.
* The database is cross-use case relevant, as it contains policies and measures also for other use cases.

==== DataCite - an international not-for-profit organization aiming to improve data citation ====
'' Description of database: ''
The main aim of DataCite is to provide the means to create, find, cite, connect, and use research. The primary service provided by DataCite is the registration of DOI tags. In addition, DataCite is constantly developing additional services related to DOI and related metadata, as following:
* DataCite Search (https://search.datacite.org/) - allows to search the database of DOI metadata registered in DataCite.
* DataCite Profiles (https://profiles.datacite.org/) - allows for automatic data transfer between the DataCite and ORCID systems, facilitating the update of personal profiles of researchers in ORCID with information about objects for which DOIs have been registered in DataCite.
* DataCite Statistics (https://stats.datacite.org/) - a service presenting statistical data on the number of registered DOI, their metadata records and the use of this information.
* DataCite OAI-PMH Provider (https://oai.datacite.org/) - an access interface to metadata collected in DataCite using the OAI-PMH protocol.
In addition, DataCite is involved in international projects and initiatives related to sharing and quoting research data, such as:
* the worldwide Registry of Research Data Repositories - Re3Data (https://www.re3data.org/).
* The Initiative for Open Citations (I4OC) = a collaboration between scholarly publishers, researchers, and other interested parties to promote the unrestricted availability of scholarly citation data and to make these data available.

'' Rationale for choosing this database: ''
* The inventory contains heterogeneous and dynamic data. Thus, it helps us to investigate how to approach FAIRification for such data.
* DataCite provides an integrated search interface, where it is possible to search and filter a relevant metadata gathered
* Sources of the database are coming in a variety of European languages. Thus, it helps to investigate the relevance for FAIRification and opening activities.
* The database is cross-use case relevant, as it contains DOIs and citations relevant also for other use cases.
* it's not a database in the literal sense of the word, but rather an 'access facilitator' to data.

== Notes from the afternoon session ==
The afternoon session is dedicated to discussing metadata for the selected databases. The aim of the afternoon session is to fill out [[UC3#Metadata_assessments|table 2 of the wiki page for the use case]] and to decide what to report back from the use case to the plenary session the next day (again, see the WIKI template for a suggested structure). Thus, at the end of the day, the WIKI page for the use case is complete.

* Bulleted list item

== What to report back to the plenary on Day 3? ==
* Databases selected (names and short reasoning)
* Main insights from discussions
* Suggested next steps
* Other issues

Talk:WS1UC4

2020-06-03T09:07:40Z

Janpedroz:

* Perhaps, we should decide initially, if we want to only focus on databases that actually contain information on policies or if we want to include databases that include information that is not directly related to policies, but can provide information that is useful for the development of policies? E.g. The COMETS database does not contain information on policies directly, but the information contained in the COMETS database could be valuable for policy development.

WS1

2020-06-02T13:45:52Z

Janpedroz: /* Discussion/ to-do list for work in use cases */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:'''

This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “EERAdata - Towards Utopia for low carbon energy research”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]
|-
| 10.20-12.15 || '''Online lectures''':
* “The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]
* “OpenAIRE: Open Access Infrastructure for Research in Europe”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]
A short break of 15 min -
* “Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]
* “Metadata practices from IRP Wind”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':
* “Humanities and data: for a community-driven path towards FAIRness”, Elena Giglia, UNITO.
* “RISIS - An e-Infrastructure for the STI-Policy research community”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL.
|}

=== Notes from Day 1 ===
==== Welcome and Introduction ====
* Introduction by Valeria:
** What is the project EERAdata about
** In the energy system the data revolution speeds up
** Data on:
*** Wheather patterns
** more and more application are becomign available
*** digital twins: steering nuclear plants just from the scree
** Buildings get energy passports
** era of digital reporting and compliance arises
** Importance of linking across different formats and topics
**time spent as aresearcher: Large amount of time spent on data sorting, formatting, searching, etc
* Valeria invites everyone again to write down their story connected to energy data on the EERAdata storyboard (see Link on Main page WIKI)
** This will be valuable in moving forward with the ideas for the EERAdata project
*Valerias personal starting point regarding EERAData:
** Work in towards enabling FAIR and open data for the low carbon energy research community
* We hope to add what we learn in this 3 days to the EERA WIKI
** guidance platform for low carbon energy researchers
* at the end we hope we come to a set of meta data standards for energy data
* what could be the utopia for energy data researcher:
** emagine lookign for citizen led initiatives in PV
** search for keyworkds on a website -> and recieve a list of datasets related to this topic
** for all those datasets:
*** see amount of initiatives available
*** when where they updated the last time
*** links provided to access the data
*** are the certified as FAIR/O and who is certifying institution
*** refine search with specific filter options
*** information on the quality/ data collection and processing methodology
*** option for simple data analysis operations
*** -> get an overview over richness of data
** -> we are still very far away from this utopia
* Goals of this Workshop:
** listen to various best practices
** day 2: discuss the provided examples
** day 3: presentation of findings from day 2 discussions
** day 3 afternoon: Data management plans (DMPs)

==== The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories ====
* '''notes incoplete, will be added later'''
**What is the EOSC:
*** goal:
**** enable reserachers to access data across domains and disciplines as easy as possible
**** locating the relevant data
*** vision:
**** all european data shoud be available to research
**** does not mean that all data is stored centrally, but that all databases are interconnected
* WP 4 members: include all nordic countries
* How can we improve datasets:
** source code:
***
* recommendations:
* evaluations:
** why do we evaluate repositories?
*** what is the level of FAIRness?
*** about 10 datasets per repository
*** FAIR score
*** Positive highlights:
****
*** FAIR score of all evaluated datasets:
**** majority at 0.10 out of 1
* coming tasks:
**
**
* question from Valeria: would it be possible to use their scoring system to assess one of the EERAdata datasets?
** Answer:

==== OpenAIRE: Open Access Infrastructure for Research in Europe ====
* Introduction into OPENAIRE:
** 2007 pilot publications
**
* Openaire is bridging the 2 worlds where science is performed and published
* In practice:
** services that monitor, assess and accelerate open science
** facilitate research communities adoption of open science
* who is openaire:
** 50 partners all over europe
** experts in open science in every EU member states
** regional coordinators
** topical coordinators working on policies for open science
** openaire is an infrastucture
** last phase of openaire: citizen science
*** openaire end in 12/2020
** 4 regions: North-, east-, west-, south europe
** large diferences in needs from country to country
*** -> find best solutions to develop open science for each country
** connections to open science community in North america, Japan, ...
* openaire has published set of guidelines in cooperation with international network:
* provided services:
** providing policy advice
** training and support
** open science infrastructure
** How to achieve FAIRness in sharing resreach data?
** guidelines on how to provide open access to publications, not only data
* How we support:
** Helpdesk: questions, FAQ
**
**
* Openaire provides guides for:
** researchers
** content providers
** funders
* Webinars:
* outreach:
** 230 webinars
** 22 NOADS are involved in EOSC WGs
* explore portal:
** search interface for all content available through Openaire
*** 40M publications: shows most crucial metadata
** EERADATA record:
*** for now, no information, as no data has been collected from repositories yet
* Openaire connect project:
** gateway for reserach communities
** allows research communities to build a gateway that collects different data relevant to your research community
* COVID-19 research community:
** ca 3200 research datasets
** 113 relates projects
* OpenAIRE provide:
** allows connection of repositories to openAIRE
* Zenodo: repository developed by openaire that allows institutions to publish their reserach output
* AGROS: machines readable data repository

* comment from Andreas Jaunsen: today, research projects spent roughly 80% of their research time on data gathereing/ processing
**-> open access aims to reduce this by only having to precess the data once

* Carsten Hoyer comments:
** create a metadata catalogue
** link the provenance information of data
*** -> track who has done what with the data

* Question from August:
* Rich metadata: search specifically for the research question for one on paper? How could this be achieved?
** openaire explore: works as normal search engine -> high "noise" (unwanted search results)

* incentives for researchers to provide rich metadata?
** Use of commen ontology allows for more refined serach results

==== Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools ====
* Key message:
**
* FAIR: Findable, Accessible, Interoperable, Reusable
** Findable:
*** Uniqueness of the date
** accessible:
*** URL, accessible vi API
** Interoperability:
** reusability: Metadata should be as desciptive as possible
* NOMAD-FAIRDI Workshop:
** Shared metadata and data formats for big-data driven material science
* Data object:
** Metadata:
*** Unique identifier, Structure of the data, Method
*** should contain information of teh full provenance of the data:
**** where does it come from? Another database? A calculation? etc?
*** '''Definition:'''
* NOMAD Respository structure:
** Nomad Repository
** Conversion Layer
** The archive
*** Three access points:
****
* Computational material sciences:
**
* Ontology:
*
* Questions:
** what happens to metadate when you physically go from one structure to a combined structure? How do you combine the metadate of the two initial structures?
***
** from EERAData perspective: in material for low carbon energy use case, what could be valuable contribution of EERAData to reserach community?
*** Ontologies are driven by the use cases.
*** summarizing: Excersizing a fine grain use case such as solar PV. Linking different levels of metadata. Further develop metadata at the use case level. How to link across use cases?

==== Metadata practices from IRP Wind ====
* Starting point was the inability to find information
* This presentation is about research data
* digital objects can be assets due to competitive advantages that the digital objects provides
* Interpretion of FAIR: F A and I data results in R data
** Reusable data multiplies the value of the data
* '''"Data should be as opeb as possible but as closed as neccessary"'''
* Issue: How to make data findable but safe
** Misstrust/ fear that own data might be missused/ one looses the competitive advantage
* Issue: Data findability
** Datasets are organized in different ways
**
* IRP Metadate and taxonomies:
** Base metadate as defined by Dublin core standards
** Additional non-Dublin Core taxonomies
* Creating a taxonomy:
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider reserach community
** Author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** Pros: Allows tracking of trends
*** Cons: Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* Virtual libraries:
** Two aspects: Seach engine (metadata) and Data storage (data)
*** Linked databases allow being searched centrally, but data is stored decentrally
* conclusion:
** Purpose of a web data portal is to (1) connect safely data owners and users and (2) inform on availability of Data, not neccessarily provide direct access to data

* Discussion:
** How to create and maintain metadata? How to allow dynamic updates of data? How to deal with language issues (non-native speaketors, translation,...)?
** Third option to create taxonomies: Use machines or algorithms to link the different taxonomy development approaches?
** General metadata standards exist, what is needed are domain specific metadata
** Two seperate categrories: Metadata and vocabolaries

==== Humanities and data: for a community-driven path towards FAIRness ====
* Humanities are often a bit neglected in the data community
* Who is ALLEA?
*Who is Co-operas?
** implementation network
** goal: taking care of the whole cycle of humanities reserach from data gathering to publishing
* Data management life cycle:
** Identification
** Planning
** Gathering
** maintaining, processing
** dissimination
* FAIR Data in humanities?
** currently, the FAIR principles will persist in shaping the data landscape in humanities
*'''"There is risk and value in being a first mover, but there is more risk in being a follower"'''
* Is data still a dirty word in the SSH?
** In the humanities, we all use Data, even if we are not aware of it
** Data in humanities is more prone to interpretation than in STEM disciplines -> harder to grasp
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice
** There is always an interpretation
** there is always a dicussion
* Data pillars:
** Data are so divers that it is impossible to converge on a common definition
*** to define data, go as deep as possible into reserach practices
* risk of oversimplification
* preliminary issues of FAIRness:
** In which step and how should FAIR principles be applied?
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specifities of how we do research in the humanities
** services and tools need to be sustainable
* Findability:
** metadate needs to be seperated from data
** maintain richness of metadata
**
* difficulties in humanities:
** data in humanities are linked to cultural, political aspects
* Nest steps:
** Data stewardship wizard for SSH
* '''Accessible does not equate to open'''
* interoperability:
** data is often so closely tailored to a specific project, that interoperability in impossible
* reusability:
** Copyright is still an issue
** need of legal advice
** In the end, reuse is the final aim of FAIRness
** reusability is also a measure of the impact of your data
* mindshift:
** currently everything is closed, except for a few daring frontrunners
** in future, everything should be open, except for a few absolutely neccessary cases.

==== RISIS - An e-Infrastructure for the STI-Policy research community ====
* RISIS:
** within social sciences
** strong connection to economics
** Measuring innovation: long tradition of using quantitative indicators and qualitative models
** started in 2014
** focuss on linking R&I datasets
** harmonizing of Organization names (Organization are main objects of study in this project)
* Datasets:
** firm innovation capabilities
** R&D output databases
** Public research and higher education
** Database on policy learning
* need to adapt to new developments within research communities
* RISIS Knowmak tool:
** openly and freely present indicators in R&I gathered from RISIS datasets
* RISIS dataset portal
** Check metadata of available datasets
** choose relevant datasets
** fill out data access aplication form
** application will be assessed by external reviewers
** if approved, acces is granted

* Discussion:
** How do you integrate your datasets with other datasets (e.g. business registers, national industry sector classifications)
*** bussiness registers often not open, but need purchasing, hence integration often not possible
*** external classifications (e.g. industry sector classifications) are often included, but a inetrnal ontology was also developed
** Are the metadata desciptions machien readable? Or only available as PDF?
*** Yes they are also available as machine readable formats, but PDF as qualitative version is imprtant for external presentation

==== Discussion/ to-do list for work in use cases ====
* Questions:
** What is the take home message for you?
**

* Use case 1:
** main goal is the re-usability
** we need to assess the databases that were chosen previously
** best preactices: EOSC,

* Use Case 2:
** Main issue in this use case is privacy/ sensitivity
** '''security comes first'''
** Tradeoff between unsiversal metadata language and domain specific language

* Use case 3:
** Linguistics is a problem
** As soon as we change the application of material/ material data, we change/need to change the metadata
** Find similarities of already existing metadata

* Use case 4:
** big challange regarding the linguistic problem
*** Diferent language
*** Different interpretation of same terms
** Pick low hanging databases that are far away from FAIR principles

* EERAData is probably more about asking the right questions than providing the right answers, there are already a lot of answers out there
* Interests of HVL:
** Assess FAIRness of our own COMETS database
** Assess how EERAdata adheres to new EU funding requirements

* Outcome of first and second workshop is hopefully some drafts for low carbon energy metadata standards, which can be reviewed by experts

* EERAdata platform responsibles will join in on all use case discussions on second WS day
* '''"Ontology is a formal represenation of the knowledge of a community on a specific purpose"'''

== Agenda Day 2 ==
METADATA - DISCUSSIONS in use cases, parallel sessions. Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* 15-17 Joint recording of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Notes from Day 2 ===
* Use case 1 - Summary: [[UC1]], Detailed notes: [[WS1UC1]]
* Use case 2 - Summary: [[UC2]], Detailed notes: [[WS1UC2]]
* Use case 3 - Summary: [[UC3]], Detailed notes: [[WS1UC3]]
* Use case 4 - Summary: [[UC4]], Detailed notes: [[WS1UC4]]

== Agenda Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.30 || '''Discussion''' lead by WP2. Report from use case experiences (by use case leaders). Wrap up.
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
* Presentation “Introduction to DMP and best practices” by Trond Kvamme, NSD
* Presentation on machine-actionable DMPs by Tomasz Miksa, TU Vienna
* Discussion of EERAdata DMP draft (August, HVL)
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

WS1

2020-06-02T12:31:21Z

Janpedroz: /* RISIS - An e-Infrastructure for the STI-Policy research community */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:'''

This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “EERAdata - Towards Utopia for low carbon energy research”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]
|-
| 10.20-12.15 || '''Online lectures''':
* “The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]
* “OpenAIRE: Open Access Infrastructure for Research in Europe”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]
A short break of 15 min -
* “Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]
* “Metadata practices from IRP Wind”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':
* “Humanities and data: for a community-driven path towards FAIRness”, Elena Giglia, UNITO.
* “RISIS - An e-Infrastructure for the STI-Policy research community”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL.
|}

=== Notes from Day 1 ===
==== Welcome and Introduction ====
* Introduction by Valeria:
** What is the project EERAdata about
** In the energy system the data revolution speeds up
** Data on:
*** Wheather patterns
** more and more application are becomign available
*** digital twins: steering nuclear plants just from the scree
** Buildings get energy passports
** era of digital reporting and compliance arises
** Importance of linking across different formats and topics
**time spent as aresearcher: Large amount of time spent on data sorting, formatting, searching, etc
* Valeria invites everyone again to write down their story connected to energy data on the EERAdata storyboard (see Link on Main page WIKI)
** This will be valuable in moving forward with the ideas for the EERAdata project
*Valerias personal starting point regarding EERAData:
** Work in towards enabling FAIR and open data for the low carbon energy research community
* We hope to add what we learn in this 3 days to the EERA WIKI
** guidance platform for low carbon energy researchers
* at the end we hope we come to a set of meta data standards for energy data
* what could be the utopia for energy data researcher:
** emagine lookign for citizen led initiatives in PV
** search for keyworkds on a website -> and recieve a list of datasets related to this topic
** for all those datasets:
*** see amount of initiatives available
*** when where they updated the last time
*** links provided to access the data
*** are the certified as FAIR/O and who is certifying institution
*** refine search with specific filter options
*** information on the quality/ data collection and processing methodology
*** option for simple data analysis operations
*** -> get an overview over richness of data
** -> we are still very far away from this utopia
* Goals of this Workshop:
** listen to various best practices
** day 2: discuss the provided examples
** day 3: presentation of findings from day 2 discussions
** day 3 afternoon: Data management plans (DMPs)

==== The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories ====
* '''notes incoplete, will be added later'''
**What is the EOSC:
*** goal:
**** enable reserachers to access data across domains and disciplines as easy as possible
**** locating the relevant data
*** vision:
**** all european data shoud be available to research
**** does not mean that all data is stored centrally, but that all databases are interconnected
* WP 4 members: include all nordic countries
* How can we improve datasets:
** source code:
***
* recommendations:
* evaluations:
** why do we evaluate repositories?
*** what is the level of FAIRness?
*** about 10 datasets per repository
*** FAIR score
*** Positive highlights:
****
*** FAIR score of all evaluated datasets:
**** majority at 0.10 out of 1
* coming tasks:
**
**
* question from Valeria: would it be possible to use their scoring system to assess one of the EERAdata datasets?
** Answer:

==== OpenAIRE: Open Access Infrastructure for Research in Europe ====
* Introduction into OPENAIRE:
** 2007 pilot publications
**
* Openaire is bridging the 2 worlds where science is performed and published
* In practice:
** services that monitor, assess and accelerate open science
** facilitate research communities adoption of open science
* who is openaire:
** 50 partners all over europe
** experts in open science in every EU member states
** regional coordinators
** topical coordinators working on policies for open science
** openaire is an infrastucture
** last phase of openaire: citizen science
*** openaire end in 12/2020
** 4 regions: North-, east-, west-, south europe
** large diferences in needs from country to country
*** -> find best solutions to develop open science for each country
** connections to open science community in North america, Japan, ...
* openaire has published set of guidelines in cooperation with international network:
* provided services:
** providing policy advice
** training and support
** open science infrastructure
** How to achieve FAIRness in sharing resreach data?
** guidelines on how to provide open access to publications, not only data
* How we support:
** Helpdesk: questions, FAQ
**
**
* Openaire provides guides for:
** researchers
** content providers
** funders
* Webinars:
* outreach:
** 230 webinars
** 22 NOADS are involved in EOSC WGs
* explore portal:
** search interface for all content available through Openaire
*** 40M publications: shows most crucial metadata
** EERADATA record:
*** for now, no information, as no data has been collected from repositories yet
* Openaire connect project:
** gateway for reserach communities
** allows research communities to build a gateway that collects different data relevant to your research community
* COVID-19 research community:
** ca 3200 research datasets
** 113 relates projects
* OpenAIRE provide:
** allows connection of repositories to openAIRE
* Zenodo: repository developed by openaire that allows institutions to publish their reserach output
* AGROS: machines readable data repository

* comment from Andreas Jaunsen: today, research projects spent roughly 80% of their research time on data gathereing/ processing
**-> open access aims to reduce this by only having to precess the data once

* Carsten Hoyer comments:
** create a metadata catalogue
** link the provenance information of data
*** -> track who has done what with the data

* Question from August:
* Rich metadata: search specifically for the research question for one on paper? How could this be achieved?
** openaire explore: works as normal search engine -> high "noise" (unwanted search results)

* incentives for researchers to provide rich metadata?
** Use of commen ontology allows for more refined serach results

==== Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools ====
* Key message:
**
* FAIR: Findable, Accessible, Interoperable, Reusable
** Findable:
*** Uniqueness of the date
** accessible:
*** URL, accessible vi API
** Interoperability:
** reusability: Metadata should be as desciptive as possible
* NOMAD-FAIRDI Workshop:
** Shared metadata and data formats for big-data driven material science
* Data object:
** Metadata:
*** Unique identifier, Structure of the data, Method
*** should contain information of teh full provenance of the data:
**** where does it come from? Another database? A calculation? etc?
*** '''Definition:'''
* NOMAD Respository structure:
** Nomad Repository
** Conversion Layer
** The archive
*** Three access points:
****
* Computational material sciences:
**
* Ontology:
*
* Questions:
** what happens to metadate when you physically go from one structure to a combined structure? How do you combine the metadate of the two initial structures?
***
** from EERAData perspective: in material for low carbon energy use case, what could be valuable contribution of EERAData to reserach community?
*** Ontologies are driven by the use cases.
*** summarizing: Excersizing a fine grain use case such as solar PV. Linking different levels of metadata. Further develop metadata at the use case level. How to link across use cases?

==== Metadata practices from IRP Wind ====
* Starting point was the inability to find information
* This presentation is about research data
* digital objects can be assets due to competitive advantages that the digital objects provides
* Interpretion of FAIR: F A and I data results in R data
** Reusable data multiplies the value of the data
* '''"Data should be as opeb as possible but as closed as neccessary"'''
* Issue: How to make data findable but safe
** Misstrust/ fear that own data might be missused/ one looses the competitive advantage
* Issue: Data findability
** Datasets are organized in different ways
**
* IRP Metadate and taxonomies:
** Base metadate as defined by Dublin core standards
** Additional non-Dublin Core taxonomies
* Creating a taxonomy:
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider reserach community
** Author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** Pros: Allows tracking of trends
*** Cons: Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* Virtual libraries:
** Two aspects: Seach engine (metadata) and Data storage (data)
*** Linked databases allow being searched centrally, but data is stored decentrally
* conclusion:
** Purpose of a web data portal is to (1) connect safely data owners and users and (2) inform on availability of Data, not neccessarily provide direct access to data

* Discussion:
** How to create and maintain metadata? How to allow dynamic updates of data? How to deal with language issues (non-native speaketors, translation,...)?
** Third option to create taxonomies: Use machines or algorithms to link the different taxonomy development approaches?
** General metadata standards exist, what is needed are domain specific metadata
** Two seperate categrories: Metadata and vocabolaries

==== Humanities and data: for a community-driven path towards FAIRness ====
* Humanities are often a bit neglected in the data community
* Who is ALLEA?
*Who is Co-operas?
** implementation network
** goal: taking care of the whole cycle of humanities reserach from data gathering to publishing
* Data management life cycle:
** Identification
** Planning
** Gathering
** maintaining, processing
** dissimination
* FAIR Data in humanities?
** currently, the FAIR principles will persist in shaping the data landscape in humanities
*'''"There is risk and value in being a first mover, but there is more risk in being a follower"'''
* Is data still a dirty word in the SSH?
** In the humanities, we all use Data, even if we are not aware of it
** Data in humanities is more prone to interpretation than in STEM disciplines -> harder to grasp
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice
** There is always an interpretation
** there is always a dicussion
* Data pillars:
** Data are so divers that it is impossible to converge on a common definition
*** to define data, go as deep as possible into reserach practices
* risk of oversimplification
* preliminary issues of FAIRness:
** In which step and how should FAIR principles be applied?
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specifities of how we do research in the humanities
** services and tools need to be sustainable
* Findability:
** metadate needs to be seperated from data
** maintain richness of metadata
**
* difficulties in humanities:
** data in humanities are linked to cultural, political aspects
* Nest steps:
** Data stewardship wizard for SSH
* '''Accessible does not equate to open'''
* interoperability:
** data is often so closely tailored to a specific project, that interoperability in impossible
* reusability:
** Copyright is still an issue
** need of legal advice
** In the end, reuse is the final aim of FAIRness
** reusability is also a measure of the impact of your data
* mindshift:
** currently everything is closed, except for a few daring frontrunners
** in future, everything should be open, except for a few absolutely neccessary cases.

==== RISIS - An e-Infrastructure for the STI-Policy research community ====
* RISIS:
** within social sciences
** strong connection to economics
** Measuring innovation: long tradition of using quantitative indicators and qualitative models
** started in 2014
** focuss on linking R&I datasets
** harmonizing of Organization names (Organization are main objects of study in this project)
* Datasets:
** firm innovation capabilities
** R&D output databases
** Public research and higher education
** Database on policy learning
* need to adapt to new developments within research communities
* RISIS Knowmak tool:
** openly and freely present indicators in R&I gathered from RISIS datasets
* RISIS dataset portal
** Check metadata of available datasets
** choose relevant datasets
** fill out data access aplication form
** application will be assessed by external reviewers
** if approved, acces is granted

* Discussion:
** How do you integrate your datasets with other datasets (e.g. business registers, national industry sector classifications)
*** bussiness registers often not open, but need purchasing, hence integration often not possible
*** external classifications (e.g. industry sector classifications) are often included, but a inetrnal ontology was also developed
** Are the metadata desciptions machien readable? Or only available as PDF?
*** Yes they are also available as machine readable formats, but PDF as qualitative version is imprtant for external presentation

==== Discussion/ to-do list for work in use cases ====
* Bulleted list item

== Agenda Day 2 ==
METADATA - DISCUSSIONS in use cases, parallel sessions. Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* 15-17 Joint recording of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Notes from Day 2 ===
* Use case 1 - Summary: [[UC1]], Detailed notes: [[WS1UC1]]
* Use case 2 - Summary: [[UC2]], Detailed notes: [[WS1UC2]]
* Use case 3 - Summary: [[UC3]], Detailed notes: [[WS1UC3]]
* Use case 4 - Summary: [[UC4]], Detailed notes: [[WS1UC4]]

== Agenda Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.30 || '''Discussion''' lead by WP2. Report from use case experiences (by use case leaders). Wrap up.
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
* Presentation “Introduction to DMP and best practices” by Trond Kvamme, NSD
* Presentation on machine-actionable DMPs by Tomasz Miksa, TU Vienna
* Discussion of EERAdata DMP draft (August, HVL)
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

WS1

2020-06-02T12:02:23Z

Janpedroz: /* Humanities and data: for a community-driven path towards FAIRness */

The first workshop of EERAdata is organized as an online webinar and hackathon from June, 2-4, 2020.

== Objective ==
* Learn about FAIR and open data practices in the energy and other research communities;
* Choose selected databases to be investigated in use cases. Discuss and summarize the reasons for selection.
* Analyze the state of FAIR/O principles for the selected database (with the help of the questionnaire and FAIR/O assessment tools).
* Evaluate the state of FAIR/O principles for the metadata of selected databases.
* Suggest general principles for the design of metadata (use-case- and domain-specific),
* Discuss top-level metadata adhering to FAIR/O principles (use-case- and domain-specific),
* Learn about the FAIRification of Data Management Plans (DMP).

== Read aheads ==

'''Obligatory:'''
* M. D. Wilkinson et al., “The FAIR Guiding Principles for scientific data management and stewardship,” Scientific Data, vol. 3, p. 160018, Mar. 2016. https://doi.org/10.1038/sdata.2016.18
* B. Mons et al., “Cloudy, increasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud,” Information Services & Use, vol. 37, no. 1, pp. 49–56, Jan. 2017. https://doi.org/10.3233/ISU-170824
* EOSC HLEG (2018). Final report and recommendations of the Commission 2nd High Level Expert Group on the European Open Science Cloud (EOSC). Prompting an EOSC in practice. Available online: https://publications.europa.eu/en/publication-detail/-/publication/5253a1af-ee10-11e8-b690-01aa75ed71a1 (accessed: 18.07.2019).

'''Suggested read on the history of metadata:'''
Metadata - Shaping Knowledge from Antiquity to the Semantic Web by Richard Gartner, https://www.springer.com/gp/book/9783319408910

== Join and collaborate interactively! ==
The workshop is a hackathon! EERAdata is evolving jointly only! Join the discussions and work together online:
* [[Main_Page#Getting_started_with_EERAdata_wiki|EERAdata WIKI]]
* [[WS1#EERAdata_story_board|EERAdata storyboard]]
* [https://github.com/valeria6856/EERAdata EERAdata@github]
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]
* Post your questions and comments on slido: https://app.sli.do/event/wrz7iwdh - OR go to [https://www.sli.do/ slido.com] and enter the event code: 23069

=== EERAdata story board ===
'''Objective:''' collect views from participants regarding energy data, energy metadata, FAIR/O problems etc. to support discussions, identification of gaps & needs (WP2) and elements to design the platform (WP3).

'''Questions:'''
* Q#1: What is your user story regarding FAIR/O energy data?
* Q#2: What is your user story regarding metadata?

Template to answer: As a <stakeholder>, I want <goal> so that <reason>.

'''How to post a story?'''
# Click on the link: https://padlet.com/janaschwanitz/aciywzt9fs1h70m2
# Click on plus at the right bottom to add a story.
# Choose as title depending on the question one wants to answer. Choose for Q#1: FAIR/O data, or for Q#2: metadata. In the example above, the title “metadata” was chosen.
# Type your sentence to let us know where the gaps and hopes are: The template is: As a <stakeholder>, I want <goal> so that <reason>.

'''Example:''' As a data-driven energy researcher, I want utopia - i.e. one-stop access to all relevant metadata -, so that I can browse available data, check where they are from and whether I can trust them when reusing.

'''How to comment a story?'''
* One can rate stories by clicking on a number of stars.
* One can comment stories as well as comments with words.
* It is anonymous commenting and adding of stories, as long as one does not login into one's personal profile at padlet.com.

=== EERAdata wiki - How to? ===
The easiest way is you simply start writing and editing. You can '''install an easy editor''' by doing what is described in the picture to the right.
[[File:Install easy editor.png|thumb|How to install an easy editor]]

Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software.
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Localisation#Translation_resources Localise MediaWiki for your language]
* [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Combating_spam Learn how to combat spam on your wiki]

=== EERAdata on github ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://github.com/valeria6856/EERAdata EERAdata@github]

=== EERAdata @ Research Gate ===
Link here and share your thoughts and issues! Note, work in progress.
* [https://www.researchgate.net/project/Towards-a-FAIR-and-open-data-ecosystem-in-the-low-carbon-energy-research-community EERAdata@ResearchGate]

=== Just have fun! ===
==== Metadata memory game ====
'''Read before playing:'''

This is a little memory game where players need to '''identify triples''', that is three tiles that belong to one data set. All of them relate to low carbon energy. Some tiles have the form of a picture, others show metadata descriptions (in various formats) and some are even sound files. So, the game is to have fun, while learning about metadata. Try out if you can find all triples. Note if you have opened 3 tiles and they do not match, all will automatically close. Just as you know it from a real-life memory game.
[http://eeradata.webfactional.com/memory/memory.html '''Link''']

== Agenda Day 1 ==
Builds on read aheads. Online talks and discussions. Space for interaction with participants after each presentation. Moderated discussion of collected comments.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10.00-10.20 || '''Welcome and introduction''' with workshop goals and procedures: “EERAdata - Towards Utopia for low carbon energy research”, Valeria Jana Schwanitz, HVL & PI EERAdata. Link: [http://eeradata.webfactional.com/WS1/EERAdata_WS1.pdf]
|-
| 10.20-12.15 || '''Online lectures''':
* “The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories” - Andreas Jaunsen, Nordforsk & EOSC-Nordic. Link: [http://eeradata.webfactional.com/WS1/EOSC-Nordic_FAIR_data_presentation_2_June_2020.pdf]
* “OpenAIRE: Open Access Infrastructure for Research in Europe”, Ilaria Fava, OpenAIRE. Link: [http://eeradata.webfactional.com/WS1/20200602_OpenAIRE-EERAdata.pdf]
A short break of 15 min -
* “Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools”, Luca Ghiringhelli, FHI Berlin. Link: [http://eeradata.webfactional.com/WS1/Ghiringhelli_FAIRmetadata_EERAdata.pdf]
* “Metadata practices from IRP Wind”, Anna Maria Sempreviva, DTU. Link: [http://eeradata.webfactional.com/WS1/EERAdata_Sempreviva.pdf]
|-
| 12.15-13.00 || ''Lunch Break''. Play the EERAdata game “Utopia and metadata”. Or any time.
|-
| 13.00-14.00 || '''Online lectures''':
* “Humanities and data: for a community-driven path towards FAIRness”, Elena Giglia, UNITO.
* “RISIS - An e-Infrastructure for the STI-Policy research community”, Thomas Scherngell, AIT. Link: [http://eeradata.webfactional.com/WS1/RISIS2_eera_data.pdf]
|-
| 14.00-14.30 || ''Break'' - Game “Utopia and metadata”. Or any time.
|-
| 14.30-16.00 || '''Discussion''' to compile a to-do list for work in use cases on the second day. Serves as a guiding and aligning process. Lead by WP2, August Wierling/Valeria, HVL.
|}

=== Notes from Day 1 ===
==== Welcome and Introduction ====
* Introduction by Valeria:
** What is the project EERAdata about
** In the energy system the data revolution speeds up
** Data on:
*** Wheather patterns
** more and more application are becomign available
*** digital twins: steering nuclear plants just from the scree
** Buildings get energy passports
** era of digital reporting and compliance arises
** Importance of linking across different formats and topics
**time spent as aresearcher: Large amount of time spent on data sorting, formatting, searching, etc
* Valeria invites everyone again to write down their story connected to energy data on the EERAdata storyboard (see Link on Main page WIKI)
** This will be valuable in moving forward with the ideas for the EERAdata project
*Valerias personal starting point regarding EERAData:
** Work in towards enabling FAIR and open data for the low carbon energy research community
* We hope to add what we learn in this 3 days to the EERA WIKI
** guidance platform for low carbon energy researchers
* at the end we hope we come to a set of meta data standards for energy data
* what could be the utopia for energy data researcher:
** emagine lookign for citizen led initiatives in PV
** search for keyworkds on a website -> and recieve a list of datasets related to this topic
** for all those datasets:
*** see amount of initiatives available
*** when where they updated the last time
*** links provided to access the data
*** are the certified as FAIR/O and who is certifying institution
*** refine search with specific filter options
*** information on the quality/ data collection and processing methodology
*** option for simple data analysis operations
*** -> get an overview over richness of data
** -> we are still very far away from this utopia
* Goals of this Workshop:
** listen to various best practices
** day 2: discuss the provided examples
** day 3: presentation of findings from day 2 discussions
** day 3 afternoon: Data management plans (DMPs)

==== The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories ====
* '''notes incoplete, will be added later'''
**What is the EOSC:
*** goal:
**** enable reserachers to access data across domains and disciplines as easy as possible
**** locating the relevant data
*** vision:
**** all european data shoud be available to research
**** does not mean that all data is stored centrally, but that all databases are interconnected
* WP 4 members: include all nordic countries
* How can we improve datasets:
** source code:
***
* recommendations:
* evaluations:
** why do we evaluate repositories?
*** what is the level of FAIRness?
*** about 10 datasets per repository
*** FAIR score
*** Positive highlights:
****
*** FAIR score of all evaluated datasets:
**** majority at 0.10 out of 1
* coming tasks:
**
**
* question from Valeria: would it be possible to use their scoring system to assess one of the EERAdata datasets?
** Answer:

==== OpenAIRE: Open Access Infrastructure for Research in Europe ====
* Introduction into OPENAIRE:
** 2007 pilot publications
**
* Openaire is bridging the 2 worlds where science is performed and published
* In practice:
** services that monitor, assess and accelerate open science
** facilitate research communities adoption of open science
* who is openaire:
** 50 partners all over europe
** experts in open science in every EU member states
** regional coordinators
** topical coordinators working on policies for open science
** openaire is an infrastucture
** last phase of openaire: citizen science
*** openaire end in 12/2020
** 4 regions: North-, east-, west-, south europe
** large diferences in needs from country to country
*** -> find best solutions to develop open science for each country
** connections to open science community in North america, Japan, ...
* openaire has published set of guidelines in cooperation with international network:
* provided services:
** providing policy advice
** training and support
** open science infrastructure
** How to achieve FAIRness in sharing resreach data?
** guidelines on how to provide open access to publications, not only data
* How we support:
** Helpdesk: questions, FAQ
**
**
* Openaire provides guides for:
** researchers
** content providers
** funders
* Webinars:
* outreach:
** 230 webinars
** 22 NOADS are involved in EOSC WGs
* explore portal:
** search interface for all content available through Openaire
*** 40M publications: shows most crucial metadata
** EERADATA record:
*** for now, no information, as no data has been collected from repositories yet
* Openaire connect project:
** gateway for reserach communities
** allows research communities to build a gateway that collects different data relevant to your research community
* COVID-19 research community:
** ca 3200 research datasets
** 113 relates projects
* OpenAIRE provide:
** allows connection of repositories to openAIRE
* Zenodo: repository developed by openaire that allows institutions to publish their reserach output
* AGROS: machines readable data repository

* comment from Andreas Jaunsen: today, research projects spent roughly 80% of their research time on data gathereing/ processing
**-> open access aims to reduce this by only having to precess the data once

* Carsten Hoyer comments:
** create a metadata catalogue
** link the provenance information of data
*** -> track who has done what with the data

* Question from August:
* Rich metadata: search specifically for the research question for one on paper? How could this be achieved?
** openaire explore: works as normal search engine -> high "noise" (unwanted search results)

* incentives for researchers to provide rich metadata?
** Use of commen ontology allows for more refined serach results

==== Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools ====
* Key message:
**
* FAIR: Findable, Accessible, Interoperable, Reusable
** Findable:
*** Uniqueness of the date
** accessible:
*** URL, accessible vi API
** Interoperability:
** reusability: Metadata should be as desciptive as possible
* NOMAD-FAIRDI Workshop:
** Shared metadata and data formats for big-data driven material science
* Data object:
** Metadata:
*** Unique identifier, Structure of the data, Method
*** should contain information of teh full provenance of the data:
**** where does it come from? Another database? A calculation? etc?
*** '''Definition:'''
* NOMAD Respository structure:
** Nomad Repository
** Conversion Layer
** The archive
*** Three access points:
****
* Computational material sciences:
**
* Ontology:
*
* Questions:
** what happens to metadate when you physically go from one structure to a combined structure? How do you combine the metadate of the two initial structures?
***
** from EERAData perspective: in material for low carbon energy use case, what could be valuable contribution of EERAData to reserach community?
*** Ontologies are driven by the use cases.
*** summarizing: Excersizing a fine grain use case such as solar PV. Linking different levels of metadata. Further develop metadata at the use case level. How to link across use cases?

==== Metadata practices from IRP Wind ====
* Starting point was the inability to find information
* This presentation is about research data
* digital objects can be assets due to competitive advantages that the digital objects provides
* Interpretion of FAIR: F A and I data results in R data
** Reusable data multiplies the value of the data
* '''"Data should be as opeb as possible but as closed as neccessary"'''
* Issue: How to make data findable but safe
** Misstrust/ fear that own data might be missused/ one looses the competitive advantage
* Issue: Data findability
** Datasets are organized in different ways
**
* IRP Metadate and taxonomies:
** Base metadate as defined by Dublin core standards
** Additional non-Dublin Core taxonomies
* Creating a taxonomy:
** Expert elicitation: Group of experts creates a taxonomy which is then reviewed by wider reserach community
** Author keywords: Map keywords used by authors along similarities in meaning, frequency of usage
*** Pros: Allows tracking of trends
*** Cons: Mix of disciplines, models, etc; Many errors and ambiguities; single generic words with a broad range of possible interpretations.
* Virtual libraries:
** Two aspects: Seach engine (metadata) and Data storage (data)
*** Linked databases allow being searched centrally, but data is stored decentrally
* conclusion:
** Purpose of a web data portal is to (1) connect safely data owners and users and (2) inform on availability of Data, not neccessarily provide direct access to data

* Discussion:
** How to create and maintain metadata? How to allow dynamic updates of data? How to deal with language issues (non-native speaketors, translation,...)?
** Third option to create taxonomies: Use machines or algorithms to link the different taxonomy development approaches?
** General metadata standards exist, what is needed are domain specific metadata
** Two seperate categrories: Metadata and vocabolaries

==== Humanities and data: for a community-driven path towards FAIRness ====
* Humanities are often a bit neglected in the data community
* Who is ALLEA?
*Who is Co-operas?
** implementation network
** goal: taking care of the whole cycle of humanities reserach from data gathering to publishing
* Data management life cycle:
** Identification
** Planning
** Gathering
** maintaining, processing
** dissimination
* FAIR Data in humanities?
** currently, the FAIR principles will persist in shaping the data landscape in humanities
*'''"There is risk and value in being a first mover, but there is more risk in being a follower"'''
* Is data still a dirty word in the SSH?
** In the humanities, we all use Data, even if we are not aware of it
** Data in humanities is more prone to interpretation than in STEM disciplines -> harder to grasp
* What is data in the humanities:
** Never "raw" data
** Data is always an expression of the method
** there is always a choice
** There is always an interpretation
** there is always a dicussion
* Data pillars:
** Data are so divers that it is impossible to converge on a common definition
*** to define data, go as deep as possible into reserach practices
* risk of oversimplification
* preliminary issues of FAIRness:
** In which step and how should FAIR principles be applied?
** what language?
** Lack of skills among researchers
** registry of existing tools
** need to preserve specifities of how we do research in the humanities
** services and tools need to be sustainable
* Findability:
** metadate needs to be seperated from data
** maintain richness of metadata
**
* difficulties in humanities:
** data in humanities are linked to cultural, political aspects
* Nest steps:
** Data stewardship wizard for SSH
* '''Accessible does not equate to open'''
* interoperability:
** data is often so closely tailored to a specific project, that interoperability in impossible
* reusability:
** Copyright is still an issue
** need of legal advice
** In the end, reuse is the final aim of FAIRness
** reusability is also a measure of the impact of your data
* mindshift:
** currently everything is closed, except for a few daring frontrunners
** in future, everything should be open, except for a few absolutely neccessary cases.

==== RISIS - An e-Infrastructure for the STI-Policy research community ====
* Bulleted list item
==== Discussion/ to-do list for work in use cases ====
* Bulleted list item

== Agenda Day 2 ==
METADATA - DISCUSSIONS in use cases, parallel sessions. Work in use cases on databases and metadata, led by use case leaders. Suggested outline:

* '''10-12 Discuss and update preliminary state of FAIR/O for the use case.''' Use the prepared draft of databases to check compliance with FAIR principles (tools: WP3 questionnaire and others). Compare the assessment results for each database. Observe and discuss agreements and differences across the evaluation tools. Generate the overall picture for FAIR/O compliance for the use case to pin down the state of art. Let’s see if we come to the same result as in our initial assessment for the application (traffic lights). Continuously make notes to report later on results. Select a responsible person. Objective: select 3-5 databases per use case. Discuss which databases to select. One to cover use-case specific challenges; and one with cross-use case relevance, and one a low hanging fruit for which it would be relatively easy to improve the current FAIR/O status.
* 13-15 Joint brainstorming to discuss FAIR/O state of the metadata for the selected use cases. Evaluate: What is the current description of metadata? How extensive are they? Is only administrative information provided? Or richer context description? What frameworks for metadata are used: taxonomy? thesaurus? ontology? How is the metadata information technically implemented: plain text file? xml? rdf? ... Identify use case specific issues with metadata - What are the gaps? What is perceived as a hard nut to crack? Pay special attention to the metadata of the databases and fill out the table provided WP2. Continuously make notes to report results the next day! Select a responsible person!
* 15-17 Joint recording of lessons learned. Create and/or update the WIKI for the use case with literature, gaps, best practices, FAIR/O discussion, metadata discussion, suggested next steps, .... Get your head around what to report next day! Plan for 20 min. See the links to WIKI page templates below (Notes from Day 2).

Note: This schedule is a suggestion. Adjust and organize breaks as needed.

=== Notes from Day 2 ===
* Use case 1 - Summary: [[UC1]], Detailed notes: [[WS1UC1]]
* Use case 2 - Summary: [[UC2]], Detailed notes: [[WS1UC2]]
* Use case 3 - Summary: [[UC3]], Detailed notes: [[WS1UC3]]
* Use case 4 - Summary: [[UC4]], Detailed notes: [[WS1UC4]]

== Agenda Day 3 ==
Reporting experience from use case applications. Prepare the next workshop on workflows and metadata. Introduction and discussion of data management plans.

{| class="wikitable"
|-
! Time slot !! Topic
|-
| 10-12.30 || '''Discussion''' lead by WP2. Report from use case experiences (by use case leaders). Wrap up.
|-
| 12.30-13.30 || ''Lunch break''
|-
| 13.30-15.00 || '''Data Management Plans'''
* Presentation “Introduction to DMP and best practices” by Trond Kvamme, NSD
* Presentation on machine-actionable DMPs by Tomasz Miksa, TU Vienna
* Discussion of EERAdata DMP draft (August, HVL)
* Short break of 15 min
|-
| 15.15-16.00 || '''Wrap up''' of workshop with feedback from invited experts.
|}

=== Notes from Day 3 ===
* Bulleted list item

WS1

2020-06-02T11:33:30Z

Janpedroz: /* Metadata practices from IRP Wind */

WS1

2020-06-02T10:19:00Z

Janpedroz: /* Community-driven metadata and ontologies for Materials Science and their key role in artificial-intelligence tools */

WS1

2020-06-02T09:30:41Z

Janpedroz: /* OpenAIRE: Open Access Infrastructure for Research in Europe */

WS1

2020-06-02T08:49:11Z

Janpedroz: /* The EOSC Nordic: machine-actionable FAIR maturity evaluations & the FAIRification of data repositories */

WS1

2020-06-02T08:25:11Z

Janpedroz: /* Welcome and Introduction */

WS1

2020-06-01T09:39:51Z

Janpedroz: /* Notes from Day 1 */

WS1

2020-06-01T09:37:17Z

Janpedroz: /* Notes from Day 1 */