Dataset Card for DSK - Alexandra Institutet¶

A collection of crawled webpages that is managed by Alexandra Institutet.

This data has been contributed by Alexandra Institutet through the Dansk Sprogmodel Konsortium.

Dataset Description¶

Number of samples: 386
Number of tokens (Llama 3): 584.35K
Average document length in tokens (min, max): 1.51K (10, 56.50K)

Dataset Structure¶

An entry in the dataset consists of the following fields:

id (str): An unique identifier for each document.
text(str): The content of the document.
source (str): The source of the document.
added (str): An date for when the document was added to this collection.
created (str): An date range for when the document was originally created.
token_count (int): The number of tokens in the sample computed using the Llama 8B tokenizer

Additional Processing¶

Dataset Statistics¶

Additional Information¶

License Information¶

This data is licensed under the data sharing agreement made between the contributor and the Dansk Sprogmodel Konsortium (DSK). It allows DFM to use the data for training and releasing models, but prohibits DFM from releasing any of the data, except metadata describing the data.

Citation Information¶

There is currently no citation for this dataset.