Community Catalog Record Maintenance
From Datafedwiki
Go to AQ uFIND
Contents |
Title: Community Catalog Record Maintenance
Outcome: Consistent AQ Community Catalog records that are updated each time the AQ Community Catalog record template changes.
Status: InProgress
Description:Before records enter the comm. cat they are matched to the AQ Cat. template to ensure that all fields are present. If they aren't, the record is not inserted. As the AQ Com Cat template evolves, the entire catalog is periodically checked. If the record is missing a section of the AQ template a the template is added and the record is flagged to be updated.
Tasks:
Add new task for objective:
[edit] Community Catalog Record Documentation
[edit] Catalog Record Addition/Modification
- WMS GetCapabilities generated
- GetCapabilities to ISO maker creates ISO record
- Validate with ISO Schema
- Validate against AQ Comm. Cat. Record maker
- Save into AQ Com. Cat. folder
- (immediately temporarily updates uFIND with new layers)
- GEOSS Clearinghouse harvests
- uFIND queries clearinghouse for AQ Comm Cat records
- uFIND pulls out facets into table and allows faceted search.
- Edit record pulls ISO record into metadata maker, allows changes on all parts of ISO record, validates record and saves back to WAF
- (immediate updates to uFIND with changes are visable, flagged that not in clearinghouse yet)
[edit] Community Catalog Bugs
- Non-Datafed records were not updated at all with placeholder for new instrument facet.
- Vertical is missing from DataFed GetCapabilities keywords.
[edit] Potential Changes to uFIND
- In order to avoid facet overload - we should consider that some facets might be hierarchical. Two that I think are:
- Dataset > Parameter (since parameter isn't a uniform term)
- Platform > Instrument
- May be good to start by showing facets and options and not showing the entire set of results
- Show in () # of results available for each facet option i.e. domain: Aerosol (500); Emission (5)...
- include search terms at the top of the page
- sort by last queried term
- Add general full text search box at top?
[edit] ComCat Registration Documentation
Modify Image edit ppt and reupload: Image:Metadata Flow to uFIND.ppt
The AQ Comm Catalog entries are controlled by the AQ Com Cat Template. The template determines fields needed for editor, metadata database fields, and is used to make the ISO record. The fields in the AQ Community Catalog were picked to fulfill several criteria: Metadata needed for: data access through WMS/WCS, OGC CSW Queryable and Returnable fields, OGC CSW ISO 19115 profile (essentially, ISO 19115 Core elements) and then the AQ Community-specific metadata facets that are used to aid users in finding the relevant data.
Metadata needed for discovery and description is stored in the Metadata Database (MDB), which includes all info needed for ISO 19115 record creation and all information used for finding/accessing data in uFIND. The MDB is a repository for all DataFed dataset metadata and any other dataset registered in uFIND.
Entry through Machine Interface: [FLAG: need way to distinguish what is for GEOSS and what is not]. The metadata database has a machine interface that allows transfer from one database to the MDB. Will allow distributed collections of metadata to be collected and shown through one interface without the need to re-register multiple places.
Entry through Wild WMS: Wild WMS will be registered using a smart metadata editor. The editor is 'smart' because it extracts as much metadata as possible from GetCap doc and then the person registering the dataset can change/fill in the additional metadata needed. [FLAG: Currently Kari pulls info for uFIND from ISO and then overwrites ISO with GetCap if that is different - how do we handle this?] [FLAG: Will all wild registration go to the AQ Community uFIND?]
From the MDB the service, "DB to ISO Converter", creates ISO doc using the template and DB as inputs. The ISO doc is validated.
One key benefit of this method is that whenever the template changes all of the records registered (datafed/non) can be re-produced again.
NOTE: Since we are moving to store all metadata in DB needed for ISO and AQ ComCat - maybe consider service interface to database (CSW?)
| Description | [Sorry, string representation Before records enter the comm. cat they are matched to the AQ Cat. template to ensure that all fields are present. If they aren't, the record is not inserted. As the AQ Com Cat template evolves, the entire catalog is periodically checked. If the record is missing a section of the AQ template a the template is added and the record is flagged to be updated. is too long for this site.] |
| Outcome | Consistent AQ Community Catalog records that are updated each time the AQ Community Catalog record template changes. + |
| Status | InProgress + |
| Title | Community Catalog Record Maintenance + |
