Skip to content

GitLab

Commit fb5e6c1c authored by Martin Necasky's avatar Martin Necasky
Browse files

Projects for practical lectures

parent 2a1aa641
Expand all Hide whitespace changes
Inline Side-by-side
structurizr-projects/national-open-data-catalog/docs/01-roadmap.md 0 → 100644
View file @ fb5e6c1c
## Roadmap
This document describes the architecture of the National Open Data Catalog (NODC).
It is intended for primarily for the NODC development team and secondary for the publishers who operate their own local open data catalogs harvested by NODC.
\ No newline at end of file
structurizr-projects/national-open-data-catalog/docs/02-context.md 0 → 100644
View file @ fb5e6c1c
## Context
NODC stores metadata records about all open data sets published by individual open data publishers in Czechia and enables open data consumers to search for metadata records and view their details.
Open data publishers do not register metadata records about their data sets directly to NODC.
They operate their own local open data catalogs where they manage their records.
NODC harvests the records from the local catalogs registered in the registry of local open data catalogs on a regular basis (daily).
European Open Data Catalog uses NODC as a single source of truth about open data sets in Czechia.
![](embed:nationalCatalogSystemContextDiagram)
\ No newline at end of file
structurizr-projects/national-open-data-catalog/eula.properties 0 → 100644
View file @ fb5e6c1c
#
#Tue Sep 28 16:14:17 UTC 2021
eula-20210622=true
structurizr-projects/national-open-data-catalog/logs/structurizr.log 0 → 100644
View file @ fb5e6c1c
2021-09-28 16:13:50,620 INFO [ContextLoaderListener] ***********************************************************************************
2021-09-28 16:13:50,622 INFO [ContextLoaderListener] _____ _ _ _
2021-09-28 16:13:50,623 INFO [ContextLoaderListener] / ____| | | | (_)
2021-09-28 16:13:50,624 INFO [ContextLoaderListener] | (___ | |_ _ __ _ _ ___| |_ _ _ _ __ _ _____ __
2021-09-28 16:13:50,625 INFO [ContextLoaderListener] \___ \| __| '__| | | |/ __| __| | | | '__| |_ / '__|
2021-09-28 16:13:50,626 INFO [ContextLoaderListener] ____) | |_| | | |_| | (__| |_| |_| | | | |/ /| |
2021-09-28 16:13:50,627 INFO [ContextLoaderListener] |_____/ \__|_| \__,_|\___|\__|\__,_|_| |_/___|_|
2021-09-28 16:13:50,627 INFO [ContextLoaderListener]
2021-09-28 16:13:50,628 INFO [ContextLoaderListener] Structurizr Lite
2021-09-28 16:13:50,631 INFO [ContextLoaderListener] Build: 2502
2021-09-28 16:13:50,634 INFO [ContextLoaderListener] Built: 2021-09-23T12:00:29Z
2021-09-28 16:13:50,666 INFO [ContextLoaderListener] Structurizr DSL: v1.14.0
2021-09-28 16:13:50,667 INFO [ContextLoaderListener]
2021-09-28 16:13:50,668 INFO [ContextLoaderListener] Memory: used=58MB; free=197MB; total=256MB; max=256MB
2021-09-28 16:13:50,668 INFO [ContextLoaderListener] ***********************************************************************************
2021-09-28 16:14:17,289 ERROR [FileSystemWorkspaceComponent] com.structurizr.dsl.StructurizrDslParserException: The software system "storage" does not exist at line 17: systemContext storage "storageSystemContextDiagram" {
2021-09-28 16:23:19,852 WARN [View] There is no layout information for the element named Local Open Data Catalog on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:19,853 WARN [View] There is no layout information for the element named European Open Data Catalog on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:19,853 WARN [View] There is no layout information for the element named Consumer on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:19,854 WARN [View] There is no layout information for the element named Publisher on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:20,376 WARN [View] There is no layout information for the element named Local Open Data Catalog on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:20,377 WARN [View] There is no layout information for the element named European Open Data Catalog on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:20,378 WARN [View] There is no layout information for the element named Consumer on view nationalCatalogSystemContextDiagram
2021-09-28 16:23:20,378 WARN [View] There is no layout information for the element named Publisher on view nationalCatalogSystemContextDiagram
2021-09-28 17:32:36,150 WARN [ViewSet] Could not find a matching view for "Czech National Open Data Catalog (NODC) - Containers" ... diagram layout information may be lost.
2021-09-28 17:32:36,511 WARN [ViewSet] Could not find a matching view for "Czech National Open Data Catalog (NODC) - Containers" ... diagram layout information may be lost.
2021-09-28 17:41:36,887 WARN [View] There is no layout information for the element named Consumer on view nationalCatalogContainerDiagram
2021-09-28 17:46:28,253 WARN [View] There is no layout information for the element named Metadata Harvestor on view nationalCatalogContainerDiagram
2021-09-28 17:46:28,255 WARN [View] There is no layout information for the element named Local Open Data Catalog on view nationalCatalogContainerDiagram
2021-09-28 17:46:28,624 WARN [View] There is no layout information for the element named Metadata Harvestor on view nationalCatalogContainerDiagram
2021-09-28 17:46:28,626 WARN [View] There is no layout information for the element named Local Open Data Catalog on view nationalCatalogContainerDiagram
2021-09-28 17:53:20,769 WARN [View] There is no layout information for the element named Registry of local open data catalogs on view nationalCatalogSystemContextDiagram
2021-09-28 17:53:21,052 WARN [View] There is no layout information for the element named Registry of local open data catalogs on view nationalCatalogSystemContextDiagram
2021-09-28 17:56:44,260 ERROR [FileSystemWorkspaceComponent] com.structurizr.dsl.StructurizrDslParserException: The element/relationship "*," does not exist at line 75: include *, publisher
2021-09-28 17:59:49,908 WARN [View] There is no layout information for the element named Registry of local open data catalogs on view nationalCatalogContainerDiagram
2021-09-28 17:59:50,185 WARN [View] There is no layout information for the element named Registry of local open data catalogs on view nationalCatalogContainerDiagram
2021-09-28 18:18:50,369 WARN [ViewSet] Could not find a matching view for "Czech National Open Data Catalog (NODC) - NODC Server - Components" ... diagram layout information may be lost.
2021-09-28 18:18:50,724 WARN [ViewSet] Could not find a matching view for "Czech National Open Data Catalog (NODC) - NODC Server - Components" ... diagram layout information may be lost.
2021-09-28 18:30:15,198 WARN [View] There is no layout information for the element named Metadata Index on view serverComponentDiagram
2021-09-28 18:30:15,199 WARN [View] There is no layout information for the element named Metadata Storage on view serverComponentDiagram
2021-09-28 18:30:15,199 WARN [View] There is no layout information for the element named NODC Web Front-end on view serverComponentDiagram
2021-09-28 18:30:15,464 WARN [View] There is no layout information for the element named Metadata Index on view serverComponentDiagram
2021-09-28 18:30:15,464 WARN [View] There is no layout information for the element named Metadata Storage on view serverComponentDiagram
2021-09-28 18:30:15,465 WARN [View] There is no layout information for the element named NODC Web Front-end on view serverComponentDiagram
structurizr-projects/national-open-data-catalog/workspace.dsl 0 → 100644
View file @ fb5e6c1c
workspace "Public Data Space" "This workspace documents the architecture of the Public Data Space which enables public institutions in Czechia to share public data among each other in a guaranteed way." {
model {
nationalCatalog = softwareSystem "Czech National Open Data Catalog (NODC)" "Stores and presents metadata records about data sets and harvests meta data from local open data catalogs." {
webFrontend = container "NODC Web Front-end" "Provides all functionality for browsing and viewing metadata records to open data consumers via their web browser" {
}
server = container "NODC Server" "Implements all business functionality for browsing and viewing metadata records and provides it via a JSON/HTTPS API." {
listAPI = component "Record List API" "Provides API for getting a list of metadata records according to specified search parameters via a JSON/HTTPS API."
detailAPI = component "Record Detail API" "Provides API for getting a detail of a given metadata record via a JSON/HTTPS API."
searchController = component "Records Search Controller" "Implements and provides business functionality related to searching for metadata records"
detailController = component "Record Detail Controller" "Implements and provides business functionality related to viewing details of metadata records"
distributionModel = component "Distribution Model" "Internal model of distribution metadata"
datasetModel = component "Dataset Model" "Internal model of dataset metadata"
recordIndexGateway = component "Metadata Index Gateway" "Provides access to a metadata records index"
recordDetailGateway = component "Metadata Detail Gateway" "Provides access to a metadata records store"
codeListAccess = component "Code List Gateway" "Provides access to code lists and their items via HTTPS dereferencing Web IRIs."
}
recordIndex = container "Metadata Index" "Index for fast searching in metadata records" "Apache SOLR via JSON/HTTPS"
recordStorage = container "Metadata Storage" "Storage of metadata records" "CouchDB via JSON/HTTPS"
harvestor = container "Metadata Harvestor" "Harvests metadata records from local open data catalogs" "LinkedPipes ETL"
!docs docs
}
localCatalog = softwareSystem "Local Open Data Catalog" "Stores metadata records about data sets of a given provider and provides API for national open data catalog." "Existing System"
euCatalog = softwareSystem "European Open Data Catalog" "Stores and presents metadata records about data sets from different EU countires and harvests meta data from national open data catalogs." "Existing System"
localCatalogRegistry = softwareSystem "Registry of local open data catalogs" "SPARQL endpoint for reading locations of registered local open data catalogs which need to be harvested." "Existing System"
consumer = person "Consumer" "An actor who searches for data sets and accesses them for various purposes." "Consumer"
# relationships to/from software systems
consumer -> nationalCatalog "Searchers for metadata records in"
consumer -> euCatalog "Searchers for metadata records in"
nationalCatalog -> localCatalog "Harvests metada records from"
euCatalog -> nationalCatalog "Harvests metadata records from"
nationalCatalog -> localCatalogRegistry "Reads registered local open data catalogs from"
localCatalog -> localCatalogRegistry "Is registered in"
# relationships to/from containers
consumer -> webFrontend "Searches for metadata records and views their details with"
webFrontend -> server "Uses to deliver functionality"
server -> recordIndex "Uses for fast retrieval of metadata records lists"
server -> recordStorage "Uses for fast retrieval of metadata records details"
harvestor -> localCatalog "Harvests metadata records from"
harvestor -> recordIndex "Uses to reset metadata records index. The whole index is always replaced"
harvestor -> recordStorage "Uses to persists harvested metadata records. All records are always replaced"
harvestor -> localCatalogRegistry "Uses to read locations of registered local open data catalogs"
# relationships to/from components
webFrontend -> listAPI "Makes API calls to" "JSON/HTTPS"
webFrontend -> detailAPI "Makes API calls to" "JSON/HTTPS"
listAPI -> searchController "Uses to access search business functionality"
detailAPI -> detailController "Uses to access detail business functionality"
searchController -> datasetModel "Uses to access metadata about datasets"
detailController -> datasetModel "Uses to access metadata about datasets"
detailController -> distributionModel "Uses to access metadata about distributions"
datasetModel -> recordIndexGateway "Uses to retrieve list of metadata records with given values of selected properties"
datasetModel -> recordDetailGateway "Uses to retrieve detailed metadata"
distributionModel -> recordDetailGateway "Uses to retrieve detailed metadata"
datasetModel -> codeListAccess "Uses to retrieve code list items labels and descriptions"
distributionModel -> codeListAccess "Uses to retrieve code list items labels and descriptions"
recordIndexGateway -> recordIndex "Provides access to"
recordDetailGateway -> recordStorage "Provides access to"
}
views {
systemContext nationalCatalog "nationalCatalogSystemContextDiagram" {
include *
}
container nationalCatalog "nationalCatalogContainerDiagram" {
include *
}
component server "serverComponentDiagram" {
include *
}
theme default
styles {
element "Existing System" {
background #999999
color #ffffff
}
element "Consumer" {
background #999999
color #ffffff
}
}
}
\ No newline at end of file
structurizr-projects/national-open-data-catalog/workspace.json 0 → 100644
View file @ fb5e6c1c
This diff is collapsed.
structurizr-projects/public-data-space/docs/01-context.md 0 → 100644
View file @ fb5e6c1c
## Context
Here is a description of the storage system of the Public Data Space.
![](embed:storageSystemContextDiagram)
\ No newline at end of file
structurizr-projects/public-data-space/eula.properties 0 → 100644
View file @ fb5e6c1c
#
#Thu Sep 23 18:44:14 UTC 2021
eula-20210622=true
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment