Skip to content

Releases: LexPredict/lexpredict-lexnlp

pipeline/contract-type/0.1

10 May 02:59
Compare
Choose a tag to compare
Pre-release

Scikit-Learn Pipeline


Name Class State
transformerpreprocessor TransformerPreprocessor head_character_n=0, normalizer=<lexnlp.ml.normalizers.Normalizer object>
transformervectorizer TransformerVectorizer vectorizers=(<lexnlp.ml.vectorizers.VectorizerDoc2Vec object>, <lexnlp.ml.vectorizers.VectorizerKeywordSearch object>)
minmaxscaler MinMaxScaler feature_range=(-1.0, 1.0)
logisticregressioncv LogisticRegressionCV

Training Data

Dataset Description Hyperlink
corpus/contract-types/0.1 A sample of labeled contract types obtained from SEC EDGAR https://www.sec.gov/edgar.shtml
corpus/atticus-cuad-v1-plaintext/0.1 Atticus CUAD v1 contracts https://www.atticusprojectai.org/cuad

Metrics

LOGISTICREGRESSIONCV
                               precision    recall  f1-score   support

           ADVISORY AGREEMENT       0.64      0.69      0.67        13
          AFFILIATE AGREEMENT       0.67      1.00      0.80         2
             AGENCY AGREEMENT       0.82      0.64      0.72        14
        ARBITRATION AGREEMENT       1.00      1.00      1.00         1
         ASSIGNMENT AGREEMENT       0.25      0.40      0.31         5
         ASSUMPTION AGREEMENT       0.33      0.30      0.32        10
      COLLABORATION AGREEMENT       0.53      0.59      0.56        17
    CONFIDENTIALITY AGREEMENT       0.67      0.91      0.77        11
       CONTRIBUTION AGREEMENT       0.85      0.79      0.81        14
        CO_BRANDING AGREEMENT       0.67      0.50      0.57         4
             DEALER AGREEMENT       1.00      1.00      1.00        13
            DEPOSIT AGREEMENT       0.71      1.00      0.83        10
        DEVELOPMENT AGREEMENT       0.44      0.44      0.44        18
       DISTRIBUTION AGREEMENT       0.67      0.67      0.67        18
         EMPLOYMENT AGREEMENT       0.82      0.71      0.76        65
        ENDORSEMENT AGREEMENT       0.80      0.80      0.80         5
   ENTITY STRUCTURE AGREEMENT       0.00      0.00      0.00         3
             ESCROW AGREEMENT       0.90      0.75      0.82        12
           EXCHANGE AGREEMENT       1.00      0.85      0.92        13
          FRANCHISE AGREEMENT       0.93      0.87      0.90        15
            HOSTING AGREEMENT       0.50      0.75      0.60         4
    INDEMNIFICATION AGREEMENT       0.91      0.91      0.91        11
      INTERCREDITOR AGREEMENT       0.89      0.81      0.85        21
         INVESTMENT AGREEMENT       0.50      0.50      0.50         6
                 IP AGREEMENT       1.00      0.67      0.80         3
       JOINT FILING AGREEMENT       0.50      0.67      0.57         3
      JOINT VENTURE AGREEMENT       0.00      0.00      0.00         2
              LEASE AGREEMENT       0.67      0.67      0.67         3
            LICENSE AGREEMENT       0.50      0.40      0.44        10
               LOAN AGREEMENT       0.74      0.52      0.61        27
        MAINTENANCE AGREEMENT       0.44      0.57      0.50         7
         MANAGEMENT AGREEMENT       0.50      1.00      0.67         3
      MANUFACTURING AGREEMENT       0.29      0.50      0.36         4
          MARKETING AGREEMENT       0.33      0.33      0.33         3
MERGER & ACQUISTION AGREEMENT       0.67      0.56      0.61        18
     NON-DISCLOSURE AGREEMENT       0.56      0.71      0.63         7
     NOT A CONTRACT AGREEMENT       0.63      0.83      0.72        23
     OTHER CONTRACT AGREEMENT       0.00      0.00      0.00         3
        OUTSOURCING AGREEMENT       0.00      0.00      0.00         4
          PROMOTION AGREEMENT       0.00      0.00      0.00         2
REGISTRATION RIGHTS AGREEMENT       0.40      1.00      0.57         2
           RESELLER AGREEMENT       0.00      0.00      0.00         2
     SALES CONTRACT AGREEMENT       0.56      0.50      0.53        10
   SECURITIES SALES AGREEMENT       0.00      0.00      0.00         2
           SECURITY AGREEMENT       0.50      0.40      0.44         5
           SERVICES AGREEMENT       0.50      0.46      0.48        13
          SERVICING AGREEMENT       0.67      0.67      0.67         3
         SETTLEMENT AGREEMENT       0.57      0.67      0.62        12
        SPONSORSHIP AGREEMENT       1.00      0.83      0.91         6
       STOCK OPTION AGREEMENT       0.56      0.79      0.66        24
 STRATEGIC ALLIANCE AGREEMENT       1.00      1.00      1.00         6
      SUBORDINATION AGREEMENT       0.57      0.67      0.62         6
             SUPPLY AGREEMENT       0.43      0.43      0.43         7
     TAX ALLOCATION AGREEMENT       0.88      1.00      0.93         7
     TRANSPORTATION AGREEMENT       1.00      0.67      0.80         3
              TRUST AGREEMENT       0.00      0.00      0.00         3
       UNDERWRITING AGREEMENT       1.00      0.88      0.93         8
             WAIVER AGREEMENT       0.72      0.87      0.79        15
            WARRANT AGREEMENT       0.80      0.86      0.83        14

                     accuracy                           0.68       575
                    macro avg       0.58      0.61      0.59       575
                 weighted avg       0.68      0.68      0.67       575


Usage

from lexnlp.extract.en.contracts.predictors import ProbabilityPredictorContractType

with open('pipeline_contract_type_classifier.cloudpickle', 'rb') as f:
    pipeline_contract_type_classifier: Pipeline = cloudpickle.load(f)

probability_predictor_contract_type: ProbabilityPredictorContractType = \
    ProbabilityPredictorContractType(pipeline=pipeline_contract_type_classifier)

probability_predictor_contract_type.detect_contract_type(
    text=['This is a sentence.', 'LICENSE AGREEMENT', 'The owner shall be responsible for the license of this software.'],
    min_probability=0.5,
)