Update spaCy pipeline

.gitattributes

@@ -19,3 +19,4 @@
 *strings.json filter=lfs diff=lfs merge=lfs -text
 vectors filter=lfs diff=lfs merge=lfs -text
 model filter=lfs diff=lfs merge=lfs -text
+*key2row filter=lfs diff=lfs merge=lfs -text

LICENSES_SOURCES

@@ -878,557 +878,6 @@ Creative Commons may be contacted at creativecommons.org.
 
 
 
-# Lemmatization Lists
-
-* Author: Michal Měchura
-* URL: https://github.com/michmech/lemmatization-lists/
-* License: ODbL
-
-```
-## ODC Open Database License (ODbL)
-
-### Preamble
-
-The Open Database License (ODbL) is a license agreement intended to
-allow users to freely share, modify, and use this Database while
-maintaining this same freedom for others. Many databases are covered by
-copyright, and therefore this document licenses these rights. Some
-jurisdictions, mainly in the European Union, have specific rights that
-cover databases, and so the ODbL addresses these rights, too. Finally,
-the ODbL is also an agreement in contract for users of this Database to
-act in certain ways in return for accessing this Database.
-
-Databases can contain a wide variety of types of content (images,
-audiovisual material, and sounds all in the same database, for example),
-and so the ODbL only governs the rights over the Database, and not the
-contents of the Database individually. Licensors should use the ODbL
-together with another license for the contents, if the contents have a
-single set of rights that uniformly covers all of the contents. If the
-contents have multiple sets of different rights, Licensors should
-describe what rights govern what contents together in the individual
-record or in some other way that clarifies what rights apply. 
-
-Sometimes the contents of a database, or the database itself, can be
-covered by other rights not addressed here (such as private contracts,
-trade mark over the name, or privacy rights / data protection rights
-over information in the contents), and so you are advised that you may
-have to consult other documents or clear other rights before doing
-activities not covered by this License.
-
-------
-
-The Licensor (as defined below) 
-
-and 
-
-You (as defined below) 
-
-agree as follows: 
-
-### 1.0 Definitions of Capitalised Words
-
-"Collective Database" – Means this Database in unmodified form as part
-of a collection of independent databases in themselves that together are
-assembled into a collective whole. A work that constitutes a Collective
-Database will not be considered a Derivative Database.
-
-"Convey" – As a verb, means Using the Database, a Derivative Database,
-or the Database as part of a Collective Database in any way that enables
-a Person to make or receive copies of the Database or a Derivative
-Database.  Conveying does not include interaction with a user through a
-computer network, or creating and Using a Produced Work, where no
-transfer of a copy of the Database or a Derivative Database occurs.
-"Contents" – The contents of this Database, which includes the
-information, independent works, or other material collected into the
-Database. For example, the contents of the Database could be factual
-data or works such as images, audiovisual material, text, or sounds.
-
-"Database" – A collection of material (the Contents) arranged in a
-systematic or methodical way and individually accessible by electronic
-or other means offered under the terms of this License.
-
-"Database Directive" – Means Directive 96/9/EC of the European
-Parliament and of the Council of 11 March 1996 on the legal protection
-of databases, as amended or succeeded.
-
-"Database Right" – Means rights resulting from the Chapter III ("sui
-generis") rights in the Database Directive (as amended and as transposed
-by member states), which includes the Extraction and Re-utilisation of
-the whole or a Substantial part of the Contents, as well as any similar
-rights available in the relevant jurisdiction under Section 10.4. 
-
-"Derivative Database" – Means a database based upon the Database, and
-includes any translation, adaptation, arrangement, modification, or any
-other alteration of the Database or of a Substantial part of the
-Contents. This includes, but is not limited to, Extracting or
-Re-utilising the whole or a Substantial part of the Contents in a new
-Database.
-
-"Extraction" – Means the permanent or temporary transfer of all or a
-Substantial part of the Contents to another medium by any means or in
-any form.
-
-"License" – Means this license agreement and is both a license of rights
-such as copyright and Database Rights and an agreement in contract.
-
-"Licensor" – Means the Person that offers the Database under the terms
-of this License. 
-
-"Person" – Means a natural or legal person or a body of persons
-corporate or incorporate.
-
-"Produced Work" –  a work (such as an image, audiovisual material, text,
-or sounds) resulting from using the whole or a Substantial part of the
-Contents (via a search or other query) from this Database, a Derivative
-Database, or this Database as part of a Collective Database.  
-
-"Publicly" – means to Persons other than You or under Your control by
-either more than 50% ownership or by the power to direct their
-activities (such as contracting with an independent consultant). 
-
-"Re-utilisation" – means any form of making available to the public all
-or a Substantial part of the Contents by the distribution of copies, by
-renting, by online or other forms of transmission.
-
-"Substantial" – Means substantial in terms of quantity or quality or a
-combination of both. The repeated and systematic Extraction or
-Re-utilisation of insubstantial parts of the Contents may amount to the
-Extraction or Re-utilisation of a Substantial part of the Contents.
-
-"Use" – As a verb, means doing any act that is restricted by copyright
-or Database Rights whether in the original medium or any other; and
-includes without limitation distributing, copying, publicly performing,
-publicly displaying, and preparing derivative works of the Database, as
-well as modifying the Database as may be technically necessary to use it
-in a different mode or format. 
-
-"You" – Means a Person exercising rights under this License who has not
-previously violated the terms of this License with respect to the
-Database, or who has received express permission from the Licensor to
-exercise rights under this License despite a previous violation.
-
-Words in the singular include the plural and vice versa.
-
-### 2.0 What this License covers
-
-2.1. Legal effect of this document. This License is:
-
-  a. A license of applicable copyright and neighbouring rights;
-
-  b. A license of the Database Right; and
-
-  c. An agreement in contract between You and the Licensor.
-
-2.2 Legal rights covered. This License covers the legal rights in the
-Database, including:
-
-  a. Copyright. Any copyright or neighbouring rights in the Database.
-  The copyright licensed includes any individual elements of the
-  Database, but does not cover the copyright over the Contents
-  independent of this Database. See Section 2.4 for details. Copyright
-  law varies between jurisdictions, but is likely to cover: the Database
-  model or schema, which is the structure, arrangement, and organisation
-  of the Database, and can also include the Database tables and table
-  indexes; the data entry and output sheets; and the Field names of
-  Contents stored in the Database;
-
-  b. Database Rights. Database Rights only extend to the Extraction and
-  Re-utilisation of the whole or a Substantial part of the Contents.
-  Database Rights can apply even when there is no copyright over the
-  Database. Database Rights can also apply when the Contents are removed
-  from the Database and are selected and arranged in a way that would
-  not infringe any applicable copyright; and
-
-  c. Contract. This is an agreement between You and the Licensor for
-  access to the Database. In return you agree to certain conditions of
-  use on this access as outlined in this License. 
-
-2.3 Rights not covered. 
-
-  a. This License does not apply to computer programs used in the making
-  or operation of the Database; 
-
-  b. This License does not cover any patents over the Contents or the
-  Database; and
-
-  c. This License does not cover any trademarks associated with the
-  Database. 
-
-2.4 Relationship to Contents in the Database. The individual items of
-the Contents contained in this Database may be covered by other rights,
-including copyright, patent, data protection, privacy, or personality
-rights, and this License does not cover any rights (other than Database
-Rights or in contract) in individual Contents contained in the Database.
-For example, if used on a Database of images (the Contents), this
-License would not apply to copyright over individual images, which could
-have their own separate licenses, or one single license covering all of
-the rights over the images.  
-
-### 3.0 Rights granted
-
-3.1 Subject to the terms and conditions of this License, the Licensor
-grants to You a worldwide, royalty-free, non-exclusive, terminable (but
-only under Section 9) license to Use the Database for the duration of
-any applicable copyright and Database Rights. These rights explicitly
-include commercial use, and do not exclude any field of endeavour. To
-the extent possible in the relevant jurisdiction, these rights may be
-exercised in all media and formats whether now known or created in the
-future. 
-
-The rights granted cover, for example:
-
-  a. Extraction and Re-utilisation of the whole or a Substantial part of
-  the Contents;
-
-  b. Creation of Derivative Databases;
-
-  c. Creation of Collective Databases;
-
-  d. Creation of temporary or permanent reproductions by any means and
-  in any form, in whole or in part, including of any Derivative
-  Databases or as a part of Collective Databases; and
-
-  e. Distribution, communication, display, lending, making available, or
-  performance to the public by any means and in any form, in whole or in
-  part, including of any Derivative Database or as a part of Collective
-  Databases.
-
-3.2 Compulsory license schemes. For the avoidance of doubt:
-
-  a. Non-waivable compulsory license schemes. In those jurisdictions in
-  which the right to collect royalties through any statutory or
-  compulsory licensing scheme cannot be waived, the Licensor reserves
-  the exclusive right to collect such royalties for any exercise by You
-  of the rights granted under this License;
-
-  b. Waivable compulsory license schemes. In those jurisdictions in
-  which the right to collect royalties through any statutory or
-  compulsory licensing scheme can be waived, the Licensor waives the
-  exclusive right to collect such royalties for any exercise by You of
-  the rights granted under this License; and,
-
-  c. Voluntary license schemes. The Licensor waives the right to collect
-  royalties, whether individually or, in the event that the Licensor is
-  a member of a collecting society that administers voluntary licensing
-  schemes, via that society, from any exercise by You of the rights
-  granted under this License.
-
-3.3 The right to release the Database under different terms, or to stop
-distributing or making available the Database, is reserved. Note that
-this Database may be multiple-licensed, and so You may have the choice
-of using alternative licenses for this Database. Subject to Section
-10.4, all other rights not expressly granted by Licensor are reserved.
-
-### 4.0 Conditions of Use
-
-4.1 The rights granted in Section 3 above are expressly made subject to
-Your complying with the following conditions of use. These are important
-conditions of this License, and if You fail to follow them, You will be
-in material breach of its terms.
-
-4.2 Notices. If You Publicly Convey this Database, any Derivative
-Database, or the Database as part of a Collective Database, then You
-must: 
-
-  a. Do so only under the terms of this License or another license
-  permitted under Section 4.4;
-
-  b. Include a copy of this License (or, as applicable, a license
-  permitted under Section 4.4) or its Uniform Resource Identifier (URI)
-  with the Database or Derivative Database, including both in the
-  Database or Derivative Database and in any relevant documentation; and
-
-  c. Keep intact any copyright or Database Right notices and notices
-  that refer to this License.
-
-  d. If it is not possible to put the required notices in a particular
-  file due to its structure, then You must include the notices in a
-  location (such as a relevant directory) where users would be likely to
-  look for it.
-
-4.3 Notice for using output (Contents). Creating and Using a Produced
-Work does not require the notice in Section 4.2. However, if you
-Publicly Use a Produced Work, You must include a notice associated with
-the Produced Work reasonably calculated to make any Person that uses,
-views, accesses, interacts with, or is otherwise exposed to the Produced
-Work aware that Content was obtained from the Database, Derivative
-Database, or the Database as part of a Collective Database, and that it
-is available under this License.
-
-  a. Example notice. The following text will satisfy notice under
-  Section 4.3:
-
-        Contains information from DATABASE NAME, which is made available
-        here under the Open Database License (ODbL).
-
-DATABASE NAME should be replaced with the name of the Database and a
-hyperlink to the URI of the Database. "Open Database License" should
-contain a hyperlink to the URI of the text of this License. If
-hyperlinks are not possible, You should include the plain text of the
-required URI's with the above notice.
- 
-4.4 Share alike. 
-
-  a. Any Derivative Database that You Publicly Use must be only under
-  the terms of: 
-
-    i. This License;
-
-    ii. A later version of this License similar in spirit to this
-      License; or
-
-    iii. A compatible license. 
-
-  If You license the Derivative Database under one of the licenses
-  mentioned in (iii), You must comply with the terms of that license. 
-
-  b. For the avoidance of doubt, Extraction or Re-utilisation of the
-  whole or a Substantial part of the Contents into a new database is a
-  Derivative Database and must comply with Section 4.4. 
-
-  c. Derivative Databases and Produced Works.  A Derivative Database is
-  Publicly Used and so must comply with Section 4.4. if a Produced Work
-  created from the Derivative Database is Publicly Used.
-
-  d. Share Alike and additional Contents. For the avoidance of doubt,
-  You must not add Contents to Derivative Databases under Section 4.4 a
-  that are incompatible with the rights granted under this License. 
-
-  e. Compatible licenses. Licensors may authorise a proxy to determine
-  compatible licenses under Section 4.4 a iii. If they do so, the
-  authorised proxy's public statement of acceptance of a compatible
-  license grants You permission to use the compatible license.
-
-
-4.5 Limits of Share Alike.  The requirements of Section 4.4 do not apply
-in the following:
-
-  a. For the avoidance of doubt, You are not required to license
-  Collective Databases under this License if You incorporate this
-  Database or a Derivative Database in the collection, but this License
-  still applies to this Database or a Derivative Database as a part of
-  the Collective Database; 
-
-  b. Using this Database, a Derivative Database, or this Database as
-  part of a Collective Database to create a Produced Work does not
-  create a Derivative Database for purposes of  Section 4.4; and
-
-  c. Use of a Derivative Database internally within an organisation is
-  not to the public and therefore does not fall under the requirements
-  of Section 4.4.
-
-4.6 Access to Derivative Databases. If You Publicly Use a Derivative
-Database or a Produced Work from a Derivative Database, You must also
-offer to recipients of the Derivative Database or Produced Work a copy
-in a machine readable form of:
-
-  a. The entire Derivative Database; or
-
-  b. A file containing all of the alterations made to the Database or
-  the method of making the alterations to the Database (such as an
-  algorithm), including any additional Contents, that make up all the
-  differences between the Database and the Derivative Database.
-
-The Derivative Database (under a.) or alteration file (under b.) must be
-available at no more than a reasonable production cost for physical
-distributions and free of charge if distributed over the internet.
-
-4.7 Technological measures and additional terms
-
-  a. This License does not allow You to impose (except subject to
-  Section 4.7 b.)  any terms or any technological measures on the
-  Database, a Derivative Database, or the whole or a Substantial part of
-  the Contents that alter or restrict the terms of this License, or any
-  rights granted under it, or have the effect or intent of restricting
-  the ability of any person to exercise those rights.
-
-  b. Parallel distribution. You may impose terms or technological
-  measures on the Database, a Derivative Database, or the whole or a
-  Substantial part of the Contents (a "Restricted Database") in
-  contravention of Section 4.74 a. only if You also make a copy of the
-  Database or a Derivative Database available to the recipient of the
-  Restricted Database:
-
-    i. That is available without additional fee;
-
-    ii. That is available in a medium that does not alter or restrict
-    the terms of this License, or any rights granted under it, or have
-    the effect or intent of restricting the ability of any person to
-    exercise those rights (an "Unrestricted Database"); and
-
-    iii. The Unrestricted Database is at least as accessible to the
-    recipient as a practical matter as the Restricted Database.
-
-  c. For the avoidance of doubt, You may place this Database or a
-  Derivative Database in an authenticated environment, behind a
-  password, or within a similar access control scheme provided that You
-  do not alter or restrict the terms of this License or any rights
-  granted under it or have the effect or intent of restricting the
-  ability of any person to exercise those rights. 
-
-4.8 Licensing of others. You may not sublicense the Database. Each time
-You communicate the Database, the whole or Substantial part of the
-Contents, or any Derivative Database to anyone else in any way, the
-Licensor offers to the recipient a license to the Database on the same
-terms and conditions as this License. You are not responsible for
-enforcing compliance by third parties with this License, but You may
-enforce any rights that You have over a Derivative Database. You are
-solely responsible for any modifications of a Derivative Database made
-by You or another Person at Your direction. You may not impose any
-further restrictions on the exercise of the rights granted or affirmed
-under this License.
-
-### 5.0 Moral rights
-
-5.1 Moral rights. This section covers moral rights, including any rights
-to be identified as the author of the Database or to object to treatment
-that would otherwise prejudice the author's honour and reputation, or
-any other derogatory treatment:
-
-  a. For jurisdictions allowing waiver of moral rights, Licensor waives
-  all moral rights that Licensor may have in the Database to the fullest
-  extent possible by the law of the relevant jurisdiction under Section
-  10.4; 
-
-  b. If waiver of moral rights under Section 5.1 a in the relevant
-  jurisdiction is not possible, Licensor agrees not to assert any moral
-  rights over the Database and waives all claims in moral rights to the
-  fullest extent possible by the law of the relevant jurisdiction under
-  Section 10.4; and
-
-  c. For jurisdictions not allowing waiver or an agreement not to assert
-  moral rights under Section 5.1 a and b, the author may retain their
-  moral rights over certain aspects of the Database.
-
-Please note that some jurisdictions do not allow for the waiver of moral
-rights, and so moral rights may still subsist over the Database in some
-jurisdictions.
-
-### 6.0 Fair dealing, Database exceptions, and other rights not affected 
-
-6.1 This License does not affect any rights that You or anyone else may
-independently have under any applicable law to make any use of this
-Database, including without limitation:
-
-  a. Exceptions to the Database Right including: Extraction of Contents
-  from non-electronic Databases for private purposes, Extraction for
-  purposes of illustration for teaching or scientific research, and
-  Extraction or Re-utilisation for public security or an administrative
-  or judicial procedure. 
-
-  b. Fair dealing, fair use, or any other legally recognised limitation
-  or exception to infringement of copyright or other applicable laws. 
-
-6.2 This License does not affect any rights of lawful users to Extract
-and Re-utilise insubstantial parts of the Contents, evaluated
-quantitatively or qualitatively, for any purposes whatsoever, including
-creating a Derivative Database (subject to other rights over the
-Contents, see Section 2.4). The repeated and systematic Extraction or
-Re-utilisation of insubstantial parts of the Contents may however amount
-to the Extraction or Re-utilisation of a Substantial part of the
-Contents.
-
-### 7.0 Warranties and Disclaimer
-
-7.1 The Database is licensed by the Licensor "as is" and without any
-warranty of any kind, either express, implied, or arising by statute,
-custom, course of dealing, or trade usage. Licensor specifically
-disclaims any and all implied warranties or conditions of title,
-non-infringement, accuracy or completeness, the presence or absence of
-errors, fitness for a particular purpose, merchantability, or otherwise.
-Some jurisdictions do not allow the exclusion of implied warranties, so
-this exclusion may not apply to You.
-
-### 8.0 Limitation of liability
-
-8.1 Subject to any liability that may not be excluded or limited by law,
-the Licensor is not liable for, and expressly excludes, all liability
-for loss or damage however and whenever caused to anyone by any use
-under this License, whether by You or by anyone else, and whether caused
-by any fault on the part of the Licensor or not. This exclusion of
-liability includes, but is not limited to, any special, incidental,
-consequential, punitive, or exemplary damages such as loss of revenue,
-data, anticipated profits, and lost business. This exclusion applies
-even if the Licensor has been advised of the possibility of such
-damages.
-
-8.2 If liability may not be excluded by law, it is limited to actual and
-direct financial loss to the extent it is caused by proved negligence on
-the part of the Licensor.
-
-### 9.0 Termination of Your rights under this License
-
-9.1 Any breach by You of the terms and conditions of this License
-automatically terminates this License with immediate effect and without
-notice to You. For the avoidance of doubt, Persons who have received the
-Database, the whole or a Substantial part of the Contents, Derivative
-Databases, or the Database as part of a Collective Database from You
-under this License will not have their licenses terminated provided
-their use is in full compliance with this License or a license granted
-under Section 4.8 of this License.  Sections 1, 2, 7, 8, 9 and 10 will
-survive any termination of this License.
-
-9.2 If You are not in breach of the terms of this License, the Licensor
-will not terminate Your rights under it. 
-
-9.3 Unless terminated under Section 9.1, this License is granted to You
-for the duration of applicable rights in the Database. 
-
-9.4 Reinstatement of rights. If you cease any breach of the terms and
-conditions of this License, then your full rights under this License
-will be reinstated:
-
-  a. Provisionally and subject to permanent termination until the 60th
-  day after cessation of breach; 
-
-  b. Permanently on the 60th day after cessation of breach unless
-  otherwise reasonably notified by the Licensor; or
-
-  c.  Permanently if reasonably notified by the Licensor of the
-  violation, this is the first time You have received notice of
-  violation of this License from  the Licensor, and You cure the
-  violation prior to 30 days after your receipt of the notice.
-
-Persons subject to permanent termination of rights are not eligible to
-be a recipient and receive a license under Section 4.8.
-
-9.5 Notwithstanding the above, Licensor reserves the right to release
-the Database under different license terms or to stop distributing or
-making available the Database. Releasing the Database under different
-license terms or stopping the distribution of the Database will not
-withdraw this License (or any other license that has been, or is
-required to be, granted under the terms of this License), and this
-License will continue in full force and effect unless terminated as
-stated above.
-
-### 10.0 General
-
-10.1 If any provision of this License is held to be invalid or
-unenforceable, that must not affect the validity or enforceability of
-the remainder of the terms and conditions of this License and each
-remaining provision of this License shall be valid and enforced to the
-fullest extent permitted by law. 
-
-10.2 This License is the entire agreement between the parties with
-respect to the rights granted here over the Database. It replaces any
-earlier understandings, agreements or representations with respect to
-the Database. 
-
-10.3 If You are in breach of the terms of this License, You will not be
-entitled to rely on the terms of this License or to complain of any
-breach by the Licensor. 
-
-10.4 Choice of law. This License takes effect in and will be governed by
-the laws of the relevant jurisdiction in which the License terms are
-sought to be enforced. If the standard suite of rights granted under
-applicable copyright law and Database Rights in the relevant
-jurisdiction includes additional rights not granted under this License,
-these additional rights are granted in this License in order to meet the
-terms of this License.```
-
-
-
-
 # Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)
 
 * Author: Explosion

README.md

@@ -14,61 +14,76 @@ model-index:
     metrics:
     - name: NER Precision
       type: precision
-      value: 0.8219461698
+      value: 0.8183716075
     - name: NER Recall
       type: recall
-      value: 0.8270833333
+      value: 0.8166666667
     - name: NER F Score
       type: f_score
-      value: 0.8245067497
+      value: 0.8175182482
+  - task:
+      name: TAG
+      type: token-classification
+    metrics:
+    - name: TAG (XPOS) Accuracy
+      type: accuracy
+      value: 0.9633898305
   - task:
       name: POS
       type: token-classification
     metrics:
-    - name: POS Accuracy
+    - name: POS (UPOS) Accuracy
       type: accuracy
-      value: 0.9650363196
+      value: 0.9633898305
   - task:
-      name: SENTER
+      name: MORPH
       type: token-classification
     metrics:
-    - name: SENTER Precision
-      type: precision
-      value: 0.9142335766
-    - name: SENTER Recall
-      type: recall
-      value: 0.8882978723
-    - name: SENTER F Score
-      type: f_score
-      value: 0.9010791367
+    - name: Morph (UFeats) Accuracy
+      type: accuracy
+      value: 0.9568038741
   - task:
-      name: UNLABELED_DEPENDENCIES
+      name: LEMMA
       type: token-classification
     metrics:
-    - name: Unlabeled Dependencies Accuracy
+    - name: Lemma Accuracy
       type: accuracy
-      value: 0.8225959658
+      value: 0.9516707022
+  - task:
+      name: UNLABELED_DEPENDENCIES
+      type: token-classification
+    metrics:
+    - name: Unlabeled Attachment Score (UAS)
+      type: f_score
+      value: 0.8195787003
   - task:
       name: LABELED_DEPENDENCIES
       type: token-classification
     metrics:
-    - name: Labeled Dependencies Accuracy
-      type: accuracy
-      value: 0.8225959658
+    - name: Labeled Attachment Score (LAS)
+      type: f_score
+      value: 0.7807576266
+  - task:
+      name: SENTS
+      type: token-classification
+    metrics:
+    - name: Sentences F-Score
+      type: f_score
+      value: 0.9055258467
 ---
 ### Details: https://spacy.io/models/da#da_core_news_lg
 
-Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler, lemmatizer.
+Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, lemmatizer (trainable_lemmatizer), senter, ner, attribute_ruler.
 
 | Feature | Description |
 | --- | --- |
 | **Name** | `da_core_news_lg` |
-| **Version** | `3.2.0` |
-| **spaCy** | `>=3.2.0,<3.3.0` |
-| **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
-| **Components** | `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `lemmatizer`, `ner` |
+| **Version** | `3.3.0` |
+| **spaCy** | `>=3.3.0.dev0,<3.4.0` |
+| **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `lemmatizer`, `attribute_ruler`, `ner` |
+| **Components** | `tok2vec`, `morphologizer`, `parser`, `lemmatizer`, `senter`, `attribute_ruler`, `ner` |
 | **Vectors** | 500000 keys, 500000 unique vectors (300 dimensions) |
-| **Sources** | [UD Danish DDT v2.8](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[Lemmatization Lists](https://github.com/michmech/lemmatization-lists/) (Michal Měchura)<br />[Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)](https://spacy.io) (Explosion) |
+| **Sources** | [UD Danish DDT v2.8](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)](https://spacy.io) (Explosion) |
 | **License** | `CC BY-SA 4.0` |
 | **Author** | [Explosion](https://explosion.ai) |
 
@@ -76,13 +91,12 @@ Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, s
 
 <details>
 
-<summary>View label scheme (195 labels for 4 components)</summary>
+<summary>View label scheme (193 labels for 3 components)</summary>
 
 | Component | Labels |
 | --- | --- |
 | **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `POS=CCONJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Degree=Pos\|POS=ADV`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=PRON\|PronType=Dem`, `NumType=Card\|POS=NUM`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `NumType=Ord\|POS=ADJ`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `POS=ADP\|PartType=Inf`, `Degree=Pos\|POS=ADJ`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Number=Plur\|POS=DET\|PronType=Ind`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `POS=PART\|PartType=Inf`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Mood=Imp\|POS=VERB`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=X`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `POS=ADV\|PartType=Inf`, `Degree=Sup\|POS=ADV`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Number=Plur\|POS=PRON\|PronType=Ind`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|POS=PROPN`, `POS=ADP`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=INTJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=SYM`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Degree=Sup\|POS=ADJ`, `Number=Plur\|POS=DET\|PronType=Ind\|Style=Arch`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Foreign=Yes\|POS=X`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Definite=Ind\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Degree=Abs\|POS=ADV`, `POS=VERB\|VerbForm=Ger`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Pres`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=PRON\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=AUX\|Tense=Pres\|VerbForm=Part`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Mood=Imp\|POS=AUX`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|POS=NOUN`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=DET\|PronType=Dem`, `Definite=Def\|Number=Plur\|POS=NOUN` |
 | **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `advmod:lmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:lmod`, `obl:tmod`, `punct`, `xcomp` |
-| **`senter`** | `I`, `S` |
 | **`ner`** | `LOC`, `MISC`, `ORG`, `PER` |
 
 </details>
@@ -95,18 +109,18 @@ Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, s
 | `TOKEN_P` | 99.78 |
 | `TOKEN_R` | 99.75 |
 | `TOKEN_F` | 99.76 |
-| `POS_ACC` | 96.50 |
-| `MORPH_ACC` | 95.72 |
-| `MORPH_MICRO_P` | 97.22 |
-| `MORPH_MICRO_R` | 96.68 |
-| `MORPH_MICRO_F` | 96.95 |
-| `SENTS_P` | 91.42 |
-| `SENTS_R` | 88.83 |
-| `SENTS_F` | 90.11 |
-| `DEP_UAS` | 82.26 |
-| `DEP_LAS` | 78.33 |
-| `TAG_ACC` | 96.50 |
-| `LEMMA_ACC` | 84.91 |
-| `ENTS_P` | 82.19 |
-| `ENTS_R` | 82.71 |
-| `ENTS_F` | 82.45 |
+| `POS_ACC` | 96.34 |
+| `MORPH_ACC` | 95.68 |
+| `MORPH_MICRO_P` | 97.27 |
+| `MORPH_MICRO_R` | 96.56 |
+| `MORPH_MICRO_F` | 96.91 |
+| `SENTS_P` | 91.04 |
+| `SENTS_R` | 90.07 |
+| `SENTS_F` | 90.55 |
+| `DEP_UAS` | 81.96 |
+| `DEP_LAS` | 78.08 |
+| `LEMMA_ACC` | 95.17 |
+| `TAG_ACC` | 96.34 |
+| `ENTS_P` | 81.84 |
+| `ENTS_R` | 81.67 |
+| `ENTS_F` | 81.75 |

accuracy.json

@@ -3,81 +3,81 @@
   "token_p": 0.9977732598,
   "token_r": 0.9974835463,
   "token_f": 0.997628382,
-  "pos_acc": 0.9650363196,
-  "morph_acc": 0.9571912833,
-  "morph_micro_p": 0.9722335025,
-  "morph_micro_r": 0.9667861289,
-  "morph_micro_f": 0.969502164,
+  "pos_acc": 0.9633898305,
+  "morph_acc": 0.9568038741,
+  "morph_micro_p": 0.9727434528,
+  "morph_micro_r": 0.9655746807,
+  "morph_micro_f": 0.9691458101,
   "morph_per_feat": {
     "Mood": {
-      "p": 0.9781160799,
-      "r": 0.9799809342,
-      "f": 0.979047619
+      "p": 0.9799043062,
+      "r": 0.9761677788,
+      "f": 0.9780324737
     },
     "Tense": {
-      "p": 0.9765506808,
-      "r": 0.9721385542,
-      "f": 0.9743396226
+      "p": 0.9772727273,
+      "r": 0.9713855422,
+      "f": 0.9743202417
     },
     "VerbForm": {
-      "p": 0.9697156984,
-      "r": 0.9602203182,
-      "f": 0.9649446494
+      "p": 0.9686153846,
+      "r": 0.9632802938,
+      "f": 0.9659404725
     },
     "Voice": {
-      "p": 0.9797752809,
-      "r": 0.9775784753,
-      "f": 0.9786756453
+      "p": 0.9798206278,
+      "r": 0.9798206278,
+      "f": 0.9798206278
     },
     "Definite": {
-      "p": 0.9666401906,
-      "r": 0.9616752272,
-      "f": 0.9641513171
+      "p": 0.968812475,
+      "r": 0.9573291189,
+      "f": 0.963036566
     },
     "Gender": {
-      "p": 0.9588903743,
-      "r": 0.9534729146,
-      "f": 0.956173971
+      "p": 0.9597720416,
+      "r": 0.9514788966,
+      "f": 0.9556074766
     },
     "Number": {
-      "p": 0.9666403993,
-      "r": 0.9598330725,
-      "f": 0.9632247088
+      "p": 0.9683961022,
+      "r": 0.9590505999,
+      "f": 0.9637006945
     },
     "AdpType": {
-      "p": 0.9991071429,
-      "r": 0.9893899204,
-      "f": 0.994224789
+      "p": 0.9982206406,
+      "r": 0.9920424403,
+      "f": 0.9951219512
     },
     "PartType": {
-      "p": 1.0,
+      "p": 0.996763754,
       "r": 1.0,
-      "f": 1.0
+      "f": 0.9983792545
     },
     "Case": {
-      "p": 0.9792332268,
-      "r": 0.9684044234,
-      "f": 0.9737887212
+      "p": 0.9806451613,
+      "r": 0.9605055292,
+      "f": 0.9704708699
     },
     "Person": {
-      "p": 0.9805996473,
-      "r": 0.9875666075,
-      "f": 0.9840707965
+      "p": 0.9804270463,
+      "r": 0.9786856128,
+      "f": 0.9795555556
     },
     "PronType": {
-      "p": 0.9860082305,
-      "r": 0.9851973684,
-      "f": 0.9856026327
+      "p": 0.9835390947,
+      "r": 0.9827302632,
+      "f": 0.9831345125
     },
     "NumType": {
-      "p": 0.9731543624,
+      "p": 0.9931506849,
       "r": 0.9602649007,
-      "f": 0.9666666667
+      "f": 0.9764309764
     },
     "Degree": {
-      "p": 0.9587878788,
-      "r": 0.9530120482,
-      "f": 0.9558912387
+      "p": 0.9578313253,
+      "r": 0.9578313253,
+      "f": 0.9578313253
     },
     "Reflex": {
       "p": 1.0,
@@ -85,24 +85,24 @@
       "f": 1.0
     },
     "Number[psor]": {
-      "p": 0.9885057471,
+      "p": 0.9772727273,
       "r": 1.0,
-      "f": 0.9942196532
+      "f": 0.9885057471
     },
     "Poss": {
-      "p": 1.0,
+      "p": 0.9887640449,
       "r": 1.0,
-      "f": 1.0
+      "f": 0.9943502825
     },
     "Foreign": {
-      "p": 0.6666666667,
-      "r": 0.4,
-      "f": 0.5
+      "p": 0.6,
+      "r": 0.3,
+      "f": 0.4
     },
     "Abbr": {
-      "p": 1.0,
-      "r": 0.2,
-      "f": 0.3333333333
+      "p": 0.0,
+      "r": 0.0,
+      "f": 0.0
     },
     "Style": {
       "p": 1.0,
@@ -110,146 +110,151 @@
       "f": 1.0
     },
     "Polite": {
-      "p": 1.0,
-      "r": 0.5,
-      "f": 0.6666666667
+      "p": 0.75,
+      "r": 0.75,
+      "f": 0.75
     }
   },
-  "sents_p": 0.9142335766,
-  "sents_r": 0.8882978723,
-  "sents_f": 0.9010791367,
-  "dep_uas": 0.8225959658,
-  "dep_las": 0.7833277461,
+  "sents_p": 0.9103942652,
+  "sents_r": 0.9007092199,
+  "sents_f": 0.9055258467,
+  "dep_uas": 0.8195787003,
+  "dep_las": 0.7807576266,
   "dep_las_per_type": {
     "advmod": {
-      "p": 0.6842105263,
-      "r": 0.697740113,
-      "f": 0.6909090909
+      "p": 0.6955345061,
+      "r": 0.7259887006,
+      "f": 0.7104353836
     },
     "root": {
-      "p": 0.8513761468,
-      "r": 0.8226950355,
-      "f": 0.8367899008
+      "p": 0.824686941,
+      "r": 0.8173758865,
+      "f": 0.821015138
     },
     "nsubj": {
-      "p": 0.8508583691,
-      "r": 0.8364978903,
-      "f": 0.8436170213
+      "p": 0.8361884368,
+      "r": 0.8238396624,
+      "f": 0.829968119
     },
     "case": {
-      "p": 0.8953603159,
-      "r": 0.8944773176,
-      "f": 0.8949185989
+      "p": 0.9003984064,
+      "r": 0.8915187377,
+      "f": 0.8959365709
     },
     "obl": {
-      "p": 0.71973466,
+      "p": 0.7221297837,
       "r": 0.6739130435,
-      "f": 0.6960705694
+      "f": 0.697188755
     },
     "cc": {
-      "p": 0.7885714286,
-      "r": 0.8023255814,
-      "f": 0.795389049
+      "p": 0.7630057803,
+      "r": 0.7674418605,
+      "f": 0.7652173913
     },
     "conj": {
-      "p": 0.647696477,
-      "r": 0.6373333333,
-      "f": 0.6424731183
+      "p": 0.6106442577,
+      "r": 0.5813333333,
+      "f": 0.5956284153
     },
     "obj": {
-      "p": 0.8161764706,
-      "r": 0.8621359223,
-      "f": 0.8385269122
+      "p": 0.7893772894,
+      "r": 0.8368932039,
+      "f": 0.8124410933
     },
     "aux": {
-      "p": 0.8742690058,
-      "r": 0.8717201166,
-      "f": 0.8729927007
+      "p": 0.8764705882,
+      "r": 0.8688046647,
+      "f": 0.8726207906
     },
     "acl:relcl": {
-      "p": 0.5773195876,
-      "r": 0.6054054054,
-      "f": 0.5910290237
+      "p": 0.6300578035,
+      "r": 0.5891891892,
+      "f": 0.6089385475
     },
     "advmod:lmod": {
-      "p": 0.6714285714,
-      "r": 0.7014925373,
-      "f": 0.6861313869
+      "p": 0.7272727273,
+      "r": 0.7164179104,
+      "f": 0.7218045113
     },
     "det": {
-      "p": 0.9253731343,
-      "r": 0.9192751236,
-      "f": 0.9223140496
+      "p": 0.9140495868,
+      "r": 0.9110378913,
+      "f": 0.9125412541
     },
     "amod": {
-      "p": 0.8313458262,
-      "r": 0.8327645051,
-      "f": 0.832054561
+      "p": 0.8080645161,
+      "r": 0.8549488055,
+      "f": 0.8308457711
     },
     "nmod:poss": {
-      "p": 0.6326530612,
-      "r": 0.6138613861,
-      "f": 0.6231155779
+      "p": 0.7373737374,
+      "r": 0.7227722772,
+      "f": 0.73
     },
     "ccomp": {
-      "p": 0.676056338,
-      "r": 0.7741935484,
-      "f": 0.7218045113
+      "p": 0.7068965517,
+      "r": 0.6612903226,
+      "f": 0.6833333333
     },
     "nummod": {
-      "p": 0.8620689655,
-      "r": 0.8333333333,
-      "f": 0.8474576271
+      "p": 0.8360655738,
+      "r": 0.85,
+      "f": 0.8429752066
     },
     "flat": {
-      "p": 0.8,
-      "r": 0.8741721854,
-      "f": 0.835443038
+      "p": 0.7844311377,
+      "r": 0.8675496689,
+      "f": 0.8238993711
     },
     "compound:prt": {
-      "p": 0.4,
-      "r": 0.3414634146,
-      "f": 0.3684210526
+      "p": 0.5,
+      "r": 0.2926829268,
+      "f": 0.3692307692
     },
     "advcl": {
-      "p": 0.6181818182,
-      "r": 0.5862068966,
-      "f": 0.6017699115
+      "p": 0.6545454545,
+      "r": 0.6206896552,
+      "f": 0.6371681416
     },
     "mark": {
-      "p": 0.8782051282,
-      "r": 0.8439425051,
-      "f": 0.8607329843
+      "p": 0.8781512605,
+      "r": 0.8583162218,
+      "f": 0.8681204569
     },
     "cop": {
-      "p": 0.7842105263,
-      "r": 0.8514285714,
-      "f": 0.8164383562
+      "p": 0.8121546961,
+      "r": 0.84,
+      "f": 0.8258426966
     },
     "dep": {
-      "p": 0.1707317073,
-      "r": 0.2641509434,
-      "f": 0.2074074074
+      "p": 0.145631068,
+      "r": 0.2830188679,
+      "f": 0.1923076923
     },
     "nmod": {
-      "p": 0.6296992481,
-      "r": 0.654296875,
-      "f": 0.6417624521
+      "p": 0.6549707602,
+      "r": 0.65625,
+      "f": 0.6556097561
     },
     "iobj": {
-      "p": 0.8,
-      "r": 0.5454545455,
-      "f": 0.6486486486
+      "p": 0.8125,
+      "r": 0.5909090909,
+      "f": 0.6842105263
     },
     "xcomp": {
-      "p": 0.5333333333,
-      "r": 0.406779661,
-      "f": 0.4615384615
+      "p": 0.4772727273,
+      "r": 0.3559322034,
+      "f": 0.4077669903
+    },
+    "appos": {
+      "p": 0.5384615385,
+      "r": 0.4242424242,
+      "f": 0.4745762712
     },
     "list": {
-      "p": 0.5454545455,
+      "p": 0.5,
       "r": 0.3333333333,
-      "f": 0.4137931034
+      "f": 0.4
     },
     "vocative": {
       "p": 0.0,
@@ -257,62 +262,57 @@
       "f": 0.0
     },
     "fixed": {
-      "p": 0.8648648649,
-      "r": 0.7804878049,
-      "f": 0.8205128205
+      "p": 0.8717948718,
+      "r": 0.8292682927,
+      "f": 0.85
     },
-    "expl": {
-      "p": 0.8,
-      "r": 0.8235294118,
-      "f": 0.8115942029
+    "obl:lmod": {
+      "p": 0.0,
+      "r": 0.0,
+      "f": 0.0
     },
-    "appos": {
-      "p": 0.4054054054,
-      "r": 0.4545454545,
-      "f": 0.4285714286
+    "expl": {
+      "p": 0.8529411765,
+      "r": 0.8529411765,
+      "f": 0.8529411765
     },
     "obl:tmod": {
-      "p": 0.5555555556,
-      "r": 0.2777777778,
-      "f": 0.3703703704
+      "p": 0.6363636364,
+      "r": 0.3888888889,
+      "f": 0.4827586207
     },
     "discourse": {
       "p": 0.0,
       "r": 0.0,
       "f": 0.0
-    },
-    "obl:lmod": {
-      "p": 0.0,
-      "r": 0.0,
-      "f": 0.0
     }
   },
-  "tag_acc": 0.9650363196,
-  "lemma_acc": 0.8491041162,
-  "ents_p": 0.8219461698,
-  "ents_r": 0.8270833333,
-  "ents_f": 0.8245067497,
+  "lemma_acc": 0.9516707022,
+  "tag_acc": 0.9633898305,
+  "ents_p": 0.8183716075,
+  "ents_r": 0.8166666667,
+  "ents_f": 0.8175182482,
   "ents_per_type": {
     "PER": {
-      "p": 0.9171974522,
-      "r": 0.8674698795,
-      "f": 0.8916408669
+      "p": 0.8993710692,
+      "r": 0.8614457831,
+      "f": 0.88
     },
     "ORG": {
-      "p": 0.7840909091,
-      "r": 0.7666666667,
-      "f": 0.7752808989
+      "p": 0.7303370787,
+      "r": 0.7222222222,
+      "f": 0.7262569832
     },
     "MISC": {
-      "p": 0.6776859504,
-      "r": 0.7256637168,
-      "f": 0.7008547009
+      "p": 0.7288135593,
+      "r": 0.7610619469,
+      "f": 0.7445887446
     },
     "LOC": {
-      "p": 0.8717948718,
-      "r": 0.9189189189,
-      "f": 0.8947368421
+      "p": 0.8672566372,
+      "r": 0.8828828829,
+      "f": 0.875
     }
   },
-  "speed": 8840.2170640394
+  "speed": 10791.2692595094
 }

config.cfg

@@ -10,7 +10,7 @@ seed = 0
 
 [nlp]
 lang = "da"
-pipeline = ["tok2vec","morphologizer","parser","senter","attribute_ruler","lemmatizer","ner"]
+pipeline = ["tok2vec","morphologizer","parser","lemmatizer","senter","attribute_ruler","ner"]
 disabled = ["senter"]
 before_creation = null
 after_creation = null
@@ -26,11 +26,22 @@ scorer = {"@scorers":"spacy.attribute_ruler_scorer.v1"}
 validate = false
 
 [components.lemmatizer]
-factory = "lemmatizer"
-mode = "lookup"
-model = null
+factory = "trainable_lemmatizer"
+backoff = "orth"
+min_tree_freq = 3
 overwrite = false
 scorer = {"@scorers":"spacy.lemmatizer_scorer.v1"}
+top_k = 1
+
+[components.lemmatizer.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.lemmatizer.model.tok2vec]
+@architectures = "spacy.Tok2VecListener.v1"
+width = ${components.tok2vec.model.encode:width}
+upstream = "tok2vec"
 
 [components.morphologizer]
 factory = "morphologizer"
@@ -39,8 +50,9 @@ overwrite = true
 scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
 
 [components.morphologizer.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.morphologizer.model.tok2vec]
 @architectures = "spacy.Tok2VecListener.v1"
@@ -70,7 +82,7 @@ nO = null
 @architectures = "spacy.MultiHashEmbed.v2"
 width = 96
 attrs = ["NORM","PREFIX","SUFFIX","SHAPE","SPACY"]
-rows = [5000,2500,2500,2500,100]
+rows = [5000,1000,2500,2500,50]
 include_static_vectors = true
 
 [components.ner.model.tok2vec.encode]
@@ -108,8 +120,9 @@ overwrite = false
 scorer = {"@scorers":"spacy.senter_scorer.v1"}
 
 [components.senter.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.senter.model.tok2vec]
 @architectures = "spacy.Tok2Vec.v2"
@@ -138,7 +151,7 @@ factory = "tok2vec"
 @architectures = "spacy.MultiHashEmbed.v2"
 width = ${components.tok2vec.model.encode:width}
 attrs = ["NORM","PREFIX","SUFFIX","SHAPE","SPACY"]
-rows = [5000,2500,2500,2500,100]
+rows = [5000,1000,2500,2500,50]
 include_static_vectors = true
 
 [components.tok2vec.model.encode]
@@ -175,7 +188,7 @@ dropout = 0.1
 accumulate_gradient = 1
 patience = 5000
 max_epochs = 0
-max_steps = 0
+max_steps = 100000
 eval_frequency = 1000
 frozen_components = []
 before_to_disk = null
@@ -210,17 +223,17 @@ eps = 0.00000001
 learn_rate = 0.001
 
 [training.score_weights]
-pos_acc = 0.08
-morph_acc = 0.08
+pos_acc = 0.14
+morph_acc = 0.14
 morph_per_feat = null
 dep_uas = 0.0
-dep_las = 0.16
+dep_las = 0.29
 dep_las_per_type = null
 sents_p = null
 sents_r = null
-sents_f = 0.02
-lemma_acc = 0.5
-ents_f = 0.16
+sents_f = 0.04
+lemma_acc = 0.1
+ents_f = 0.29
 ents_p = 0.0
 ents_r = 0.0
 ents_per_type = null
@@ -237,6 +250,13 @@ after_init = null
 
 [initialize.components]
 
+[initialize.components.lemmatizer]
+
+[initialize.components.lemmatizer.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/trainable_lemmatizer.json"
+require = false
+
 [initialize.components.morphologizer]
 
 [initialize.components.morphologizer.labels]

da_core_news_lg-any-py3-none-any.whl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d6b7f22582316614bc9c5c122a532b4eff39fc3b411054ee16ad4f89e14de765
-size 573820420
+oid sha256:70b519f9d735120b8eee33370806c00bdb12214887bf6793783421fbbbff1dc3
+size 567085252

lemmatizer/cfg

@@ -0,0 +1,457 @@
+{
+  "labels":[
+    1,
+    2,
+    4,
+    6,
+    8,
+    10,
+    12,
+    14,
+    16,
+    18,
+    20,
+    24,
+    28,
+    30,
+    32,
+    34,
+    36,
+    39,
+    41,
+    42,
+    43,
+    45,
+    47,
+    49,
+    51,
+    53,
+    55,
+    57,
+    61,
+    65,
+    67,
+    71,
+    73,
+    75,
+    77,
+    79,
+    81,
+    83,
+    85,
+    87,
+    89,
+    91,
+    93,
+    95,
+    99,
+    101,
+    102,
+    104,
+    107,
+    111,
+    113,
+    116,
+    118,
+    121,
+    124,
+    127,
+    128,
+    131,
+    133,
+    134,
+    136,
+    138,
+    140,
+    142,
+    144,
+    145,
+    147,
+    148,
+    149,
+    153,
+    155,
+    158,
+    161,
+    164,
+    166,
+    168,
+    170,
+    172,
+    174,
+    175,
+    177,
+    179,
+    182,
+    184,
+    186,
+    188,
+    190,
+    192,
+    194,
+    196,
+    199,
+    201,
+    203,
+    204,
+    207,
+    208,
+    209,
+    211,
+    213,
+    214,
+    216,
+    218,
+    220,
+    222,
+    224,
+    226,
+    229,
+    231,
+    232,
+    233,
+    235,
+    236,
+    238,
+    239,
+    243,
+    249,
+    253,
+    255,
+    257,
+    259,
+    261,
+    262,
+    263,
+    264,
+    267,
+    269,
+    270,
+    272,
+    274,
+    276,
+    278,
+    280,
+    282,
+    284,
+    286,
+    290,
+    291,
+    293,
+    295,
+    297,
+    299,
+    300,
+    302,
+    303,
+    304,
+    306,
+    308,
+    311,
+    314,
+    315,
+    317,
+    320,
+    321,
+    323,
+    324,
+    326,
+    327,
+    328,
+    330,
+    331,
+    333,
+    337,
+    339,
+    340,
+    344,
+    346,
+    350,
+    353,
+    354,
+    355,
+    358,
+    360,
+    361,
+    363,
+    365,
+    366,
+    369,
+    372,
+    373,
+    376,
+    380,
+    382,
+    383,
+    384,
+    386,
+    387,
+    389,
+    391,
+    392,
+    394,
+    395,
+    398,
+    400,
+    402,
+    404,
+    406,
+    409,
+    411,
+    412,
+    413,
+    415,
+    417,
+    420,
+    421,
+    423,
+    424,
+    425,
+    427,
+    429,
+    431,
+    433,
+    434,
+    436,
+    437,
+    439,
+    440,
+    442,
+    444,
+    445,
+    449,
+    450,
+    452,
+    454,
+    457,
+    459,
+    462,
+    465,
+    466,
+    468,
+    470,
+    471,
+    474,
+    475,
+    478,
+    480,
+    483,
+    485,
+    486,
+    487,
+    489,
+    491,
+    492,
+    493,
+    495,
+    496,
+    498,
+    500,
+    501,
+    502,
+    503,
+    504,
+    505,
+    507,
+    508,
+    509,
+    510,
+    511,
+    512,
+    514,
+    515,
+    516,
+    518,
+    519,
+    520,
+    521,
+    523,
+    525,
+    526,
+    528,
+    531,
+    533,
+    535,
+    453,
+    536,
+    538,
+    539,
+    541,
+    545,
+    547,
+    548,
+    549,
+    550,
+    551,
+    553,
+    554,
+    555,
+    557,
+    559,
+    560,
+    561,
+    563,
+    565,
+    566,
+    567,
+    568,
+    570,
+    571,
+    575,
+    577,
+    578,
+    579,
+    582,
+    585,
+    587,
+    589,
+    593,
+    594,
+    596,
+    597,
+    601,
+    603,
+    605,
+    609,
+    611,
+    612,
+    613,
+    614,
+    615,
+    616,
+    617,
+    619,
+    621,
+    622,
+    624,
+    625,
+    627,
+    628,
+    629,
+    632,
+    634,
+    638,
+    639,
+    640,
+    642,
+    644,
+    647,
+    649,
+    650,
+    651,
+    653,
+    654,
+    655,
+    657,
+    658,
+    659,
+    661,
+    663,
+    665,
+    667,
+    669,
+    670,
+    672,
+    674,
+    676,
+    677,
+    678,
+    680,
+    682,
+    683,
+    685,
+    686,
+    688,
+    689,
+    690,
+    691,
+    694,
+    695,
+    696,
+    697,
+    699,
+    700,
+    701,
+    703,
+    705,
+    706,
+    707,
+    708,
+    712,
+    715,
+    716,
+    718,
+    720,
+    724,
+    726,
+    729,
+    730,
+    732,
+    733,
+    734,
+    736,
+    738,
+    739,
+    740,
+    741,
+    742,
+    743,
+    744,
+    747,
+    749,
+    753,
+    756,
+    758,
+    759,
+    761,
+    762,
+    763,
+    764,
+    766,
+    768,
+    769,
+    771,
+    773,
+    774,
+    775,
+    776,
+    777,
+    781,
+    783,
+    784,
+    785,
+    788,
+    791,
+    792,
+    794,
+    796,
+    797,
+    798,
+    799,
+    800,
+    802,
+    803,
+    804,
+    805,
+    806,
+    808,
+    809,
+    810,
+    811,
+    812,
+    814,
+    815,
+    817,
+    819,
+    820,
+    822,
+    824,
+    825,
+    827,
+    829,
+    831,
+    833,
+    835,
+    837
+  ]
+}

lemmatizer/{lookups/lookups.bin → model}

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6864ce8705293ba1b6dcf349ec133cdc33db3ba57f6e9337458cfe5073b6f103
-size 11537995
+oid sha256:fd1961075ded3bc09a5a58ead51adad20e36d70d2a099362fe21386796b1521e
+size 176206

meta.json

@@ -1,14 +1,14 @@
 {
   "lang":"da",
   "name":"core_news_lg",
-  "version":"3.2.0",
-  "description":"Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler, lemmatizer.",
+  "version":"3.3.0",
+  "description":"Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, lemmatizer (trainable_lemmatizer), senter, ner, attribute_ruler.",
   "author":"Explosion",
   "email":"[email protected]",
   "url":"https://explosion.ai",
   "license":"CC BY-SA 4.0",
-  "spacy_version":">=3.2.0,<3.3.0",
-  "spacy_git_version":"bb26550e2",
+  "spacy_version":">=3.3.0.dev0,<3.4.0",
+  "spacy_git_version":"849bef2de",
   "vectors":{
     "width":300,
     "vectors":500000,
@@ -212,15 +212,8 @@
       "punct",
       "xcomp"
     ],
-    "senter":[
-      "I",
-      "S"
-    ],
     "attribute_ruler":[
 
-    ],
-    "lemmatizer":[
-
     ],
     "ner":[
       "LOC",
@@ -233,17 +226,17 @@
     "tok2vec",
     "morphologizer",
     "parser",
-    "attribute_ruler",
     "lemmatizer",
+    "attribute_ruler",
     "ner"
   ],
   "components":[
     "tok2vec",
     "morphologizer",
     "parser",
+    "lemmatizer",
     "senter",
     "attribute_ruler",
-    "lemmatizer",
     "ner"
   ],
   "disabled":[
@@ -254,81 +247,81 @@
     "token_p":0.9977732598,
     "token_r":0.9974835463,
     "token_f":0.997628382,
-    "pos_acc":0.9650363196,
-    "morph_acc":0.9571912833,
-    "morph_micro_p":0.9722335025,
-    "morph_micro_r":0.9667861289,
-    "morph_micro_f":0.969502164,
+    "pos_acc":0.9633898305,
+    "morph_acc":0.9568038741,
+    "morph_micro_p":0.9727434528,
+    "morph_micro_r":0.9655746807,
+    "morph_micro_f":0.9691458101,
     "morph_per_feat":{
       "Mood":{
-        "p":0.9781160799,
-        "r":0.9799809342,
-        "f":0.979047619
+        "p":0.9799043062,
+        "r":0.9761677788,
+        "f":0.9780324737
       },
       "Tense":{
-        "p":0.9765506808,
-        "r":0.9721385542,
-        "f":0.9743396226
+        "p":0.9772727273,
+        "r":0.9713855422,
+        "f":0.9743202417
       },
       "VerbForm":{
-        "p":0.9697156984,
-        "r":0.9602203182,
-        "f":0.9649446494
+        "p":0.9686153846,
+        "r":0.9632802938,
+        "f":0.9659404725
       },
       "Voice":{
-        "p":0.9797752809,
-        "r":0.9775784753,
-        "f":0.9786756453
+        "p":0.9798206278,
+        "r":0.9798206278,
+        "f":0.9798206278
       },
       "Definite":{
-        "p":0.9666401906,
-        "r":0.9616752272,
-        "f":0.9641513171
+        "p":0.968812475,
+        "r":0.9573291189,
+        "f":0.963036566
       },
       "Gender":{
-        "p":0.9588903743,
-        "r":0.9534729146,
-        "f":0.956173971
+        "p":0.9597720416,
+        "r":0.9514788966,
+        "f":0.9556074766
       },
       "Number":{
-        "p":0.9666403993,
-        "r":0.9598330725,
-        "f":0.9632247088
+        "p":0.9683961022,
+        "r":0.9590505999,
+        "f":0.9637006945
       },
       "AdpType":{
-        "p":0.9991071429,
-        "r":0.9893899204,
-        "f":0.994224789
+        "p":0.9982206406,
+        "r":0.9920424403,
+        "f":0.9951219512
       },
       "PartType":{
-        "p":1.0,
+        "p":0.996763754,
         "r":1.0,
-        "f":1.0
+        "f":0.9983792545
       },
       "Case":{
-        "p":0.9792332268,
-        "r":0.9684044234,
-        "f":0.9737887212
+        "p":0.9806451613,
+        "r":0.9605055292,
+        "f":0.9704708699
       },
       "Person":{
-        "p":0.9805996473,
-        "r":0.9875666075,
-        "f":0.9840707965
+        "p":0.9804270463,
+        "r":0.9786856128,
+        "f":0.9795555556
       },
       "PronType":{
-        "p":0.9860082305,
-        "r":0.9851973684,
-        "f":0.9856026327
+        "p":0.9835390947,
+        "r":0.9827302632,
+        "f":0.9831345125
       },
       "NumType":{
-        "p":0.9731543624,
+        "p":0.9931506849,
         "r":0.9602649007,
-        "f":0.9666666667
+        "f":0.9764309764
       },
       "Degree":{
-        "p":0.9587878788,
-        "r":0.9530120482,
-        "f":0.9558912387
+        "p":0.9578313253,
+        "r":0.9578313253,
+        "f":0.9578313253
       },
       "Reflex":{
         "p":1.0,
@@ -336,24 +329,24 @@
         "f":1.0
       },
       "Number[psor]":{
-        "p":0.9885057471,
+        "p":0.9772727273,
         "r":1.0,
-        "f":0.9942196532
+        "f":0.9885057471
       },
       "Poss":{
-        "p":1.0,
+        "p":0.9887640449,
         "r":1.0,
-        "f":1.0
+        "f":0.9943502825
       },
       "Foreign":{
-        "p":0.6666666667,
-        "r":0.4,
-        "f":0.5
+        "p":0.6,
+        "r":0.3,
+        "f":0.4
       },
       "Abbr":{
-        "p":1.0,
-        "r":0.2,
-        "f":0.3333333333
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
       "Style":{
         "p":1.0,
@@ -361,146 +354,151 @@
         "f":1.0
       },
       "Polite":{
-        "p":1.0,
-        "r":0.5,
-        "f":0.6666666667
+        "p":0.75,
+        "r":0.75,
+        "f":0.75
       }
     },
-    "sents_p":0.9142335766,
-    "sents_r":0.8882978723,
-    "sents_f":0.9010791367,
-    "dep_uas":0.8225959658,
-    "dep_las":0.7833277461,
+    "sents_p":0.9103942652,
+    "sents_r":0.9007092199,
+    "sents_f":0.9055258467,
+    "dep_uas":0.8195787003,
+    "dep_las":0.7807576266,
     "dep_las_per_type":{
       "advmod":{
-        "p":0.6842105263,
-        "r":0.697740113,
-        "f":0.6909090909
+        "p":0.6955345061,
+        "r":0.7259887006,
+        "f":0.7104353836
       },
       "root":{
-        "p":0.8513761468,
-        "r":0.8226950355,
-        "f":0.8367899008
+        "p":0.824686941,
+        "r":0.8173758865,
+        "f":0.821015138
       },
       "nsubj":{
-        "p":0.8508583691,
-        "r":0.8364978903,
-        "f":0.8436170213
+        "p":0.8361884368,
+        "r":0.8238396624,
+        "f":0.829968119
       },
       "case":{
-        "p":0.8953603159,
-        "r":0.8944773176,
-        "f":0.8949185989
+        "p":0.9003984064,
+        "r":0.8915187377,
+        "f":0.8959365709
       },
       "obl":{
-        "p":0.71973466,
+        "p":0.7221297837,
         "r":0.6739130435,
-        "f":0.6960705694
+        "f":0.697188755
       },
       "cc":{
-        "p":0.7885714286,
-        "r":0.8023255814,
-        "f":0.795389049
+        "p":0.7630057803,
+        "r":0.7674418605,
+        "f":0.7652173913
       },
       "conj":{
-        "p":0.647696477,
-        "r":0.6373333333,
-        "f":0.6424731183
+        "p":0.6106442577,
+        "r":0.5813333333,
+        "f":0.5956284153
       },
       "obj":{
-        "p":0.8161764706,
-        "r":0.8621359223,
-        "f":0.8385269122
+        "p":0.7893772894,
+        "r":0.8368932039,
+        "f":0.8124410933
       },
       "aux":{
-        "p":0.8742690058,
-        "r":0.8717201166,
-        "f":0.8729927007
+        "p":0.8764705882,
+        "r":0.8688046647,
+        "f":0.8726207906
       },
       "acl:relcl":{
-        "p":0.5773195876,
-        "r":0.6054054054,
-        "f":0.5910290237
+        "p":0.6300578035,
+        "r":0.5891891892,
+        "f":0.6089385475
       },
       "advmod:lmod":{
-        "p":0.6714285714,
-        "r":0.7014925373,
-        "f":0.6861313869
+        "p":0.7272727273,
+        "r":0.7164179104,
+        "f":0.7218045113
       },
       "det":{
-        "p":0.9253731343,
-        "r":0.9192751236,
-        "f":0.9223140496
+        "p":0.9140495868,
+        "r":0.9110378913,
+        "f":0.9125412541
       },
       "amod":{
-        "p":0.8313458262,
-        "r":0.8327645051,
-        "f":0.832054561
+        "p":0.8080645161,
+        "r":0.8549488055,
+        "f":0.8308457711
       },
       "nmod:poss":{
-        "p":0.6326530612,
-        "r":0.6138613861,
-        "f":0.6231155779
+        "p":0.7373737374,
+        "r":0.7227722772,
+        "f":0.73
       },
       "ccomp":{
-        "p":0.676056338,
-        "r":0.7741935484,
-        "f":0.7218045113
+        "p":0.7068965517,
+        "r":0.6612903226,
+        "f":0.6833333333
       },
       "nummod":{
-        "p":0.8620689655,
-        "r":0.8333333333,
-        "f":0.8474576271
+        "p":0.8360655738,
+        "r":0.85,
+        "f":0.8429752066
       },
       "flat":{
-        "p":0.8,
-        "r":0.8741721854,
-        "f":0.835443038
+        "p":0.7844311377,
+        "r":0.8675496689,
+        "f":0.8238993711
       },
       "compound:prt":{
-        "p":0.4,
-        "r":0.3414634146,
-        "f":0.3684210526
+        "p":0.5,
+        "r":0.2926829268,
+        "f":0.3692307692
       },
       "advcl":{
-        "p":0.6181818182,
-        "r":0.5862068966,
-        "f":0.6017699115
+        "p":0.6545454545,
+        "r":0.6206896552,
+        "f":0.6371681416
       },
       "mark":{
-        "p":0.8782051282,
-        "r":0.8439425051,
-        "f":0.8607329843
+        "p":0.8781512605,
+        "r":0.8583162218,
+        "f":0.8681204569
       },
       "cop":{
-        "p":0.7842105263,
-        "r":0.8514285714,
-        "f":0.8164383562
+        "p":0.8121546961,
+        "r":0.84,
+        "f":0.8258426966
       },
       "dep":{
-        "p":0.1707317073,
-        "r":0.2641509434,
-        "f":0.2074074074
+        "p":0.145631068,
+        "r":0.2830188679,
+        "f":0.1923076923
       },
       "nmod":{
-        "p":0.6296992481,
-        "r":0.654296875,
-        "f":0.6417624521
+        "p":0.6549707602,
+        "r":0.65625,
+        "f":0.6556097561
       },
       "iobj":{
-        "p":0.8,
-        "r":0.5454545455,
-        "f":0.6486486486
+        "p":0.8125,
+        "r":0.5909090909,
+        "f":0.6842105263
       },
       "xcomp":{
-        "p":0.5333333333,
-        "r":0.406779661,
-        "f":0.4615384615
+        "p":0.4772727273,
+        "r":0.3559322034,
+        "f":0.4077669903
+      },
+      "appos":{
+        "p":0.5384615385,
+        "r":0.4242424242,
+        "f":0.4745762712
       },
       "list":{
-        "p":0.5454545455,
+        "p":0.5,
         "r":0.3333333333,
-        "f":0.4137931034
+        "f":0.4
       },
       "vocative":{
         "p":0.0,
@@ -508,64 +506,59 @@
         "f":0.0
       },
       "fixed":{
-        "p":0.8648648649,
-        "r":0.7804878049,
-        "f":0.8205128205
+        "p":0.8717948718,
+        "r":0.8292682927,
+        "f":0.85
       },
-      "expl":{
-        "p":0.8,
-        "r":0.8235294118,
-        "f":0.8115942029
+      "obl:lmod":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "appos":{
-        "p":0.4054054054,
-        "r":0.4545454545,
-        "f":0.4285714286
+      "expl":{
+        "p":0.8529411765,
+        "r":0.8529411765,
+        "f":0.8529411765
       },
       "obl:tmod":{
-        "p":0.5555555556,
-        "r":0.2777777778,
-        "f":0.3703703704
+        "p":0.6363636364,
+        "r":0.3888888889,
+        "f":0.4827586207
       },
       "discourse":{
         "p":0.0,
         "r":0.0,
         "f":0.0
-      },
-      "obl:lmod":{
-        "p":0.0,
-        "r":0.0,
-        "f":0.0
       }
     },
-    "tag_acc":0.9650363196,
-    "lemma_acc":0.8491041162,
-    "ents_p":0.8219461698,
-    "ents_r":0.8270833333,
-    "ents_f":0.8245067497,
+    "lemma_acc":0.9516707022,
+    "tag_acc":0.9633898305,
+    "ents_p":0.8183716075,
+    "ents_r":0.8166666667,
+    "ents_f":0.8175182482,
     "ents_per_type":{
       "PER":{
-        "p":0.9171974522,
-        "r":0.8674698795,
-        "f":0.8916408669
+        "p":0.8993710692,
+        "r":0.8614457831,
+        "f":0.88
       },
       "ORG":{
-        "p":0.7840909091,
-        "r":0.7666666667,
-        "f":0.7752808989
+        "p":0.7303370787,
+        "r":0.7222222222,
+        "f":0.7262569832
       },
       "MISC":{
-        "p":0.6776859504,
-        "r":0.7256637168,
-        "f":0.7008547009
+        "p":0.7288135593,
+        "r":0.7610619469,
+        "f":0.7445887446
       },
       "LOC":{
-        "p":0.8717948718,
-        "r":0.9189189189,
-        "f":0.8947368421
+        "p":0.8672566372,
+        "r":0.8828828829,
+        "f":0.875
       }
     },
-    "speed":8840.2170640394
+    "speed":10791.2692595094
   },
   "sources":[
     {
@@ -580,12 +573,6 @@
       "license":"CC BY-SA 4.0",
       "author":"Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders S\u00f8gaard"
     },
-    {
-      "name":"Lemmatization Lists",
-      "url":"https://github.com/michmech/lemmatization-lists/",
-      "license":"ODbL",
-      "author":"Michal M\u011bchura"
-    },
     {
       "name":"Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)",
       "url":"https://spacy.io",

morphologizer/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:545faa5af6230b1e75b0e7bec684ca7bfaeb9fc509d4af9964093cb9e716abcd
-size 61299
+oid sha256:c9a904d06964b6afa205f053f74bc3b869bab70872d9265d38fadd867450df26
+size 61351

ner/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:baa83b1fe95f92d394cdd9c7918e2e540153028d757d2c0f337e49713f54018d
-size 7091792
+oid sha256:3d60d6db1813b3f2d8de3dea75ed89b12bf168bb820f9bda6630e5a51d4d1ecb
+size 6496592

parser/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ee9712d6daa68e5099e153041488410b84642c2fdc3e09e3c53ddf1498e5015
+oid sha256:c112c2427b1cfb0608eb1ef39d0206558de657c031eca80773d43e578f7517f8
 size 308728

parser/moves

@@ -1 +1 @@
-��moves�D{"0":{"":41514},"1":{"":34295},"2":{"case":7489,"nsubj":6009,"det":4334,"amod":3968,"advmod":3657,"mark":3529,"aux":2432,"cc":2261,"punct":2182,"cop":1329,"obl":894,"nummod":799,"nmod:poss":651,"nmod":460,"expl":291,"ccomp":202,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":49,"acl:relcl":43},"3":{"punct":8601,"obl":3949,"obj":3758,"nmod":3565,"conj":2745,"advmod":2095,"flat":1295,"nsubj":1172,"acl:relcl":1131,"advcl":808,"amod":628,"advmod:lmod":423,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":167,"list":161,"nmod:poss":156,"punct||conj":151,"mark":137,"cc":135,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"obl:lmod":44,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4367}}�cfg��neg_key�
+��moves�D{"0":{"":41615},"1":{"":34382},"2":{"case":7526,"nsubj":6005,"det":4341,"amod":3967,"advmod":3662,"mark":3530,"aux":2436,"cc":2264,"punct":2187,"cop":1330,"obl":894,"nummod":834,"nmod:poss":656,"nmod":463,"expl":291,"ccomp":203,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":48,"acl:relcl":43},"3":{"punct":8693,"obl":3951,"obj":3760,"nmod":3569,"conj":2747,"advmod":2087,"flat":1302,"nsubj":1169,"acl:relcl":1132,"advcl":809,"amod":622,"advmod:lmod":423,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":168,"list":159,"nmod:poss":156,"punct||conj":151,"cc":135,"mark":133,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"obl:lmod":44,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4383}}�cfg��neg_key�

senter/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4aed53103edd9c5cb25000aa2d8b2219a6007e6bbbc2b2368a9dc316a7d24d4f
-size 219901
+oid sha256:c5afa93a8f788243e6c02d5ab57762e55511fbfa00f89ee3c21bd75cea7ae6bc
+size 219953

tok2vec/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1c071819ef9aa2286b8d502b15e8b8f86b3fdbd755e0747233869eb4641f8c16
-size 6960804
+oid sha256:afa9aae853e4d60a66837dd127015d27d43c8f772b22c8c7b172238e5dfaa846
+size 6365604

vocab/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:42fe610567bec6fa69da580a4753d083f1f4429efd32b3c1fa638b6a07a6757e
-size 10070327
+oid sha256:528d1a6bb62dc4d608b0ea1be75d557f41cdd76867460448bbbc174d34ae193a
+size 10081139