Relaton CLI (relaton-cli): Relaton Command-line Interface
Commands
Each command has an option --verbose (the short form is -v). Use the option to get warnings in the commands output.
The following commands are provided.
relaton concatenate
$ relaton concatenate Source-Directory Relaton-Collection-File -t TITLE -g ORGANIZATION
Iterates through all the Relaton files (YAML and XML) in Source-Directory, and concatenates them into a Relaton Collection file. The extension of the Collection file can be set using the Relaton-Collection-File file name (i.e, if it uses an extension of yaml, a Relaton YAML file will be created; if rxl, a Relaton XML file will be created, or via the -x [ext] (or --extension) option.
For each Relaton input file in the Source-Directory, if a document file with the same base name is identified (i.e. an XML, HTML, PDF or DOC
file) a link to that file is inserted.
If the TITLE or ORGANIZATION options are given, they are added to the Collection-File output as the
title and author of the Relaton-Collection-File document.
relaton split
$ relaton split Relaton-Collection-File Relaton-File-Directory -x rxl
Splits a Relaton-Collection-File into multiple files in the Relaton-File-Directory, and it also
suports an additional -x or --extension options to use different extension.
relaton fetch
$ relaton fetch CODE -t TYPE -f FORMAT -y YEAR -r RETRIES --all-parts --keep-year --no-cache
Fetch the Relaton XML entry corresponding to the document identifier CODE.
-
YEARis optional and specifies the year of publication of the standard. -
FORMATis optional, and specifies the output format; the recognized values forFORMATarexml(default), yaml,bibtex. -
TYPEis optional and specifies the standards class library to be used, that the identifier is part of. The recognized values forTYPEare:3GPP,BIPM,CCTF,CCDS,CGPM,CIPM,JCRB,JCGM,BSI,BS,PD,CC,CCSDS,CEN,EN,ENV,CWA,HD,CR,CIE,DOI,ECMA,ETSI,CN,GB,GB/T,GB/Z,IANA,IEC,CISPR,IEV,IEEE,ANSI,NACE,AIEE,ASA,IRE,IETF,RFC,BCP,FYI,STD,I-D,IHO,ISBN,ISO,ISO/IEC,ITU,JIS,TR,NIST,NBS,NISTGCR,ITL Bulletin,JPCRD,NISTIR,CSRC,FIPS,OASIS,OGC,OMG,UN,W3C,XEP,PLATEAU. -
RETRIESis optional, number of network retries (default 1). -
--all-partsfetch all parts. -
--keep-yearundated reference should return an actual reference with year. -
--no-cachedo not use cache.
relaton fetch-data
$ relaton fetch-data DATASET -o DIR -f FORMAT
Fetch all the documents from a DATASET source and save them to a folder DIR in the format FORMAT.
The following datasets are available:
-
nist-tech-pubs- https://github.com/usnistgov/NIST-Tech-Pubs/releases/download/May2024/allrecords-MODS.xml -
cie-techstreet- https://www.techstreet.com/cie/searches/31156444 -
calconnect-org- https://standards.calconnect.org/relaton/index.yaml -
ogc-naming-authority- https://raw.githubusercontent.com/opengeospatial/NamingAuthority/master/incubation/bibliography/bibliography.json -
ieee-rawbib- looks for the IEEE dataset in the local./ieee-rawbibdirectory. The dataset could be downloaded from https://github.com/ietf-ribose/ieee-rawbib repository -
w3c-tr-archive- looks for the W3C archive dataset in local./w3c-tr-archivedirectory. The dataset could be downloaded from https://github.com/relaton/w3c-tr-archive repository -
iana-registries- https://github.com/ietf-ribose/iana-registries -
status-smg-3GPP- updates previously downloaded data if a new archive is available in ftp://www.3gpp.org/Information/Databases/ -
status-smg-3GPP-force- download data from the latest archive in ftp://www.3gpp.org/Information/Databases/ -
ietf-rfcsubseries- https://www.rfc-editor.org/rfc-index.xml (<bcp-entry>,<fyi-entry>,<std-entry>) -
ietf-internet-drafts- looks for the Internet-Drafts dataset in the local./bibxml-idsdirectory. The dataset could be downloaded usingrsync -avcizxL rsync.ietf.org::bibxml-ids ./bibxml-idscommand. -
ietf-rfc-entries- https://www.rfc-editor.org/rfc-index.xml (<rfc-entry>) -
oasis-open- https://www.oasis-open.org/standards/ -
bipm-data-outcomes- looks for the BIPM dataset in the local./bipm-data-outcomesdirectory. The dataset could be downloaded from https://github.com/metanorma/bipm-data-outcomes repository -
si-brochure- looks for the SI-Brochure dataset in the local./bipm-si-brocuredirectory. The dataset could be downloaded from https://github.com/metanorma/bipm-si-brochure repository -
ecma-standards- https://www.ecma-international.org/publications/standards/ -
etsi-csv- https://www.etsi.org/ -
plateau-handbooks- https://www.mlit.go.jp/plateau/_next/data/1.3.0/libraries/handbooks.json -
plateau-technical-reports- https://www.mlit.go.jp/plateau/_next/data/1.3.0/libraries/technical-reports.json -
jis-webdesk- https://webdesk.jsa.or.jp/books/W11M0270
Options:
-
DIR- folder name to store documents (default./data). -
FORMAT- format in which the documents are saved. Possible formats are:yaml,xml,bibxml(defaultyaml).
relaton extract
$ relaton extract Metanorma-XML-Directory Relaton-XML-Directory -x EXTENSION
Iterate through all the Metanorma XML files in Metanorma-XML-Directory, and extract the bibdata
element from each. Save the bibdata element for each file to Relaton-XML-Directory, as the Relaton XML
description for that file. If a document identifier is present in bibdata, it is used as the name of the
file; otherwise, the original file name is used. The filename is suffixed with EXTENSION; by default,
.rxl is used.
relaton xml2html
$ relaton xml2html <relaton-xml> [<stylesheet>] [<html-template-dir>]
Render a Relaton Collection XML as an HTML file. Used to generate an HTML index of standards.
-
relaton-xmlis the Relaton Collection XML file. -
stylesheetis the CSS stylesheet to be used to style the output. For the CSS styling of each bibliographic element, see below. -
html-template-diris a directory containing HTML Liquid Template files into which the bibliographic entries are to be inserted. There are two templates necessary:-
Index template (
index.liquid)-
The HTML Template file
_index.liquidrecognizes the following parameters: -
css: where the CSS stylesheetstylesheetis injected -
title: the Title of the collection,./relaton-collection/titleinrelaton-xml -
author: the Author of the collection,./relaton-collection/contributor[role/@type = 'author']/organization/nameinrelaton-xml -
content: the list of resources generated by the script
-
-
Individual bibliographic entries template (
_document.liquid)-
This template recognizes attributes of a bibliographic entry (
document) that follow the naming convention of Relaton YAML; e.g.document.htmlis the HTML URI for the document.
-
-
The default stylesheet and templates are given (which also demonstrates the structure) in the templates directory.
Sample HTML output for a bibliographic entry:
<div class="document">
<div class="doc-line">
<div class="doc-identifier">
<h2>
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.html">CC/R 3101</a>
</h2>
</div>
<div class="doc-type-wrap">
<div class="doc-type report">report</div>
</div>
</div>
<div class="doc-title">
<h3>
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.html">CalConnect XLIII -- Position on the European Union daylight-savings timezone change</a>
</h3>
</div>
<div class="doc-info cancelled">
<div class="doc-stage cancelled">cancelled</div>
<div class="doc-dates">
<div class="doc-updated">2019-10-17</div>
</div>
</div>
<div class="doc-bib">
<div class="doc-bib-relaton">
<a href="csd/cc-r-3101.xml">Relaton XML</a>
</div>
</div>
<div class="doc-access">
<div class="doc-access-button-html">
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.html">HTML</a>
</div>
<div class="doc-access-button-pdf">
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.pdf">PDF</a>
</div>
<div class="doc-access-button-doc">
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.doc">Word</a>
</div>
<div class="doc-access-button-xml">
<a href="http://calconnect.org/pubdocs/CD0507%20CalDAV%20Use%20Cases%20V1.0.xml">XML</a>
</div>
</div>
</div>
relaton yaml2xml
$ relaton yaml2xml YAML -o OUTPUT-DIRECTORY -x RELATON_EXTENSION -p PREFIX -r LIBRARY
Convert a Relaton YAML file (filename.yaml) into a Relaton XML file (filename.xml). If the Relaton YAML file specifies multiple bibliograph items, and OUTPUT-DIRECTORY is nominated, also convert the file into a list of Relaton XML files for each entry, stored in that directory. The document identifier is used as the name of each Relaton XML file; the Relaton XML filename is suffixed with RELATON_EXTENSION (default .rxl) and prefixed with PREFIX (default empty). Any libraries that need to be required for the conversion are specified in LIBRARY as a space-delimited list.
A Relaton Collection YAML file contains some initial metadata and a list of metadata about each bibliographic entry:
root:
author: The Calendaring and Scheduling Consortium
title: CalConnect Standards Registry
items:
- technical_committee: PUBLISH
docid:
type: CC
id: CC 36000
primary: true
type: standard
title:
type: main
content: Standardization documents -- Vocabulary
docstatus:
stage: proposal
date:
type: issued
value: 2018-10-25
- technical_committee: DATETIME
docid:
type: CC
id: CC 34000
primary: true
type: standard
title:
type: main
content: Date and time -- Concepts and vocabulary
docstatus:
stage: proposal
date:
type: issued
value: 2018-10-25
A Relaton YAML file describing an individual bibliographic entry is limited to metadata specific to that entry. Flavor gems have additional fields. The Relaton YAML illustrates the common fields supported by all flavor gems.
relaton xml2yaml
$ relaton xml2yaml XML -o OUTPUT-DIRECTORY -x RELATON_EXTENSION -p PREFIX -r LIBRARY
Convert a Relaton XML file (filename.xml or filename.rxl) into a Relaton YAML file (filename.yaml). If the Relaton XML file is a collection, and OUTPUT-DIRECTORY is nominated, also convert the file into a list of Relaton YAML files for each entry, stored in that directory. The document identifier is used as the name of each Relaton XML file; the Relaton XML filename is suffixed with RELATON_EXTENSION (default .yaml) and prefixed with PREFIX (default empty). Any libraries that need to be required for the conversion are specified in LIBRARY as a space-delimited list.
relaton yaml2html
$ relaton yaml2html YAML [<stylesheet>] [<liquid-template-dir>]
Render a Relaton YAML file (filename.yaml) as an HTML file. The stylesheet and liquid-template-dir directories are as for relaton xml2html.
relaton convert
$ relaton convert XML -f FORMAT -o OUTPUT-FILE
Convert a Relaton XML document into YAML, AsciiBib, or BibTex format. Allowed -f or --format options are yaml, asciibib, bibtex. If the option -o or --output is omitted then a new file will be created in the folder where the original file is, with the same name but another appropriated extension.
relaton version
$ relaton version CLI => 1.17.2 relaton => 1.17.2 relaton-bib => 1.17.2 relaton-iso-bib => 1.17.0 relaton-gb => 1.17.0 relaton-iec => 1.17.0 relaton-ietf => 1.17.0 relaton-iso => 1.17.0 relaton-itu => 1.17.0 relaton-nist => 1.17.0 relaton-ogc => 1.17.1 relaton-calconnect => 1.17.0 relaton-omg => 1.17.0 relaton-un => 1.17.0 relaton-w3c => 1.17.2 relaton-ieee => 1.17.0 relaton-iho => 1.17.0 relaton-bipm => 1.17.0 relaton-ecma => 1.17.0 relaton-cie => 1.17.0 relaton-bsi => 1.17.0 relaton-cen => 1.17.0 relaton-iana => 1.17.0 relaton-3gpp => 1.17.0 relaton-oasis => 1.17.0 relaton-doi => 1.17.0 relaton-jis => 1.17.0 relaton-xsf => 1.17.0 relaton-ccsds => 1.17.0 relaton-etsi => 1.17.0 relaton-isbn => 1.17.0
relaton collection
The relaton collection is a set of subcommands for collection manipulations.
relaton collection create
$ relaton collection create COLLECTION -d DIRECTORY --author AUTHOR --title TITLE --doctype DOCTYPE
Create a new empty collection with the name COLLECTION.
* DIRECTORY - optional, and specifies a path to a directory with collections. The default value is $HOME/.relaton/collections.
* AUTHOR, TITLE, and DOCTYPE are optional.
relaton collection info
$ relaton collection info COLLECTION -d DIRECTORY
Show information about COLLECTION (number of items, file size of collection, last updated, name, metadata).
* DIRECTORY is optional, and specifies the path to a directory with collections. The default value is $HOME/.relaton/collections.
relaton collection list
$ relaton collection list -d DIRECTORY -e
List all collections.
* DIRECTORY - optional, and specifies the path to a directory with collections. The default value is $HOME/.relaton/collections.
* When parameter -e is defined the id of each entry id will be listed.
relaton collection get
$ relaton collection get CODE -c COLLECTION -d DIRECTORY -f FORMAT -o FILE
Get a document matched to CODE from COLLECTION.
-
COLLECTION- optional name of a collection. If undefined then fetch the first match across all collections inDIRECTORY. -
DIRECTORY- optional, and specifies a path to a directory with collections. The default value is$HOME/.relaton/collections. -
FORMAT- optional. If undefined then print a document in a human-readable form. Allowed values areabb(AsciiBib) orxml(XML). -
FILEis optional. When it’s defined then save a document with the given file name. The file’s extension defines the format of the file. Possible extensions areabb(AsciiBib) orxml(XML).
relaton collection find
$ relaton collection find TEXT -c COLLECTION -d DIRECTORY
Full-text search through a collection or all collections.
-
COLLECTION- optional name of a collection. If undefined then search across all collections. -
DIRECTORY- optional, and specifies a path to a directory with collections. The default value is$HOME/.relaton/collections.
relaton collection fetch
$ relaton collection fetch CODE -t TYPE -y YEAR -c COLLECTION -d DIRECTORY
Fetch the Relaton XML entry corresponding to the document identifier CODE and save it into COLLECTION.
-
TYPEspecifies the standards class library to be used, that the identifier is part of. The recognized values forTYPEare:3GPP,BIPM,CCTF,CCDS,CGPM,CIPM,JCRB,JCGM,BSI,BS,PD,CC,CCSDS,CEN,EN,ENV,CWA,HD,CR,CIE,DOI,ECMA,ETSI,CN,GB,GB/T,GB/Z,IANA,IEC,CISPR,IEV,IEEE,ANSI,NACE,AIEE,ASA,IRE,IETF,RFC,BCP,FYI,STD,I-D,IHO,ISBN,ISO,ISO/IEC,ITU,JIS,TR,NIST,NBS,NISTGCR,ITL Bulletin,JPCRD,NISTIR,CSRC,FIPS,OASIS,OGC,OMG,UN,W3C,XEP. -
YEARis optional, and specifies the year of publication of the standard. -
COLLECTION- a name of a collection. -
DIRECTORY- optional, and specifies a path to a directory with collections. The default value is$HOME/.relaton/collections.
relaton collection export
$ relaton collection export COLLECTION -d DIRECTORY
Export COLLECTION into an XML file.
-
DIRECTORY- optional, and specifies a path to a directory with collections. The default value is$HOME/.relaton/collections.
relaton collection import
$ relaton collection import FILE -c COLLECTION -d DIRECTORY
Import document or collection from XML FILE into COLLECTION.
-
COLLECTION- optional. If a collection doesn’t exist then it will be created. -
DIRECTORY- optional, and specifies a path to a directory with collections. The default value is$HOME/.relaton/collections.
Dadabase manipulation
Create database
$ relaton db create DIR
Creates a new database in a directory DIR (optional, the default value is /home/USER/.relaton/dbpath). In case the target directory exists it will be used as a database.
$ relaton db create [relaton-cli] Database is in `/Users/user/.relaton/cache` $ relaton db create cachedb [relaton-cli] Database is in `/Users/user/RubyProjects/relaton-cli/cachedb`
Move database
$ relaton db mv DIR
Move a database to another place DIR.
$ relaton db mv cache_dir [relaton-cli] Database is moved to `/Users/user/RubyProjects/relaton-cli/cache_dir`
Clear database
Delete all entries from a cache DB.
$ relaton db clear
Fetch from database
$ relaton db fetch -t TYPE -f FORMAT -y YEAR
Fetch an entry from a database. See [relaton fetch](#relaton-fetch) for the explanation of the arguments.
Fetch all
Fetch all entries from a cache DB.
$ relaton db fetch_all TEXT -e EDITION -y YEAR -f FORMAT
-
TEXT(optional) search for a certain string -
EDITION(optional) filter documents with a certain edition -
YEAR(optional) filter documents by a year -
FORMAT(optional) specifies the output format. Recognized values arexml(default), yaml,bibtex.
$ relaton db fetch_all
<bibitem id="ISO/IECDIR1" type="international-standard">
...
$ relaton db fetch_all 'Procedures for the technical work'
<bibitem id="ISO/IECDIR1" type="international-standard">
<fetched>2021-04-01</fetched>
<title type="title-main" format="text/plain" language="en" script="Latn">Procedures for the technical work</title>
...
$ relaton db fetch_all -e 3
<bibitem id="ISO2146-2010" type="standard">
...
<edition>3</edition>
...
$ relaton db fetch_all -e 8 -y 2018
<bibitem id="ISO/IECDIR2IEC" type="international-standard">
<fetched>2021-04-01</fetched>
<title type="title-main" format="text/plain" language="en" script="Latn">Principles and rules for the structure and drafting of ISO and IEC documents</title>
<uri type="obp">https://www.iec.ch/members_experts/refdocs/iec/isoiecdir2%7Bed8.0.RLV%7Den.pdf</uri>
<docidentifier type="ISO" primary="true">ISO/IEC DIR 2 IEC</docidentifier>
<date type="published">
<on>2018-05-01</on>
</date>
<edition>8</edition>
...
Get document type
$ relaton db doctype REF
Takes a reference REF and returns a document type.
$ relaton db doctype 'CN(GB/T 1.1)' Chinese Standard GB/T 1.1