Support all registered IANA mime types

build_mime_types: Add tool to create ContentType enum from all IANA mime type CSVS
pyproject.toml: Run build_mime_types.py during `poetry build`
src/tests: Add more tests around mime types and adjust to mime_types.ContentType from enumeration.ContentType

Author: dkoston

Makefile

@@ -30,7 +30,7 @@ clean: ## Remove build files
 	@echo "Temporary files were clear"
 
 test: ## Run code tests
-	@poetry run pytest
+	@poetry run pytest -vv
 
 lint: ## Run code linters
 	@echo "Run code linters..."

build_mime_types/README.md

@@ -0,0 +1,9 @@
+# build-mime-types
+
+Builds a class file for ContentType enum from the IANA mime types list.
+
+Contents:
+
+
+- *.csv - Lists of media-types [from IANA](https://www.iana.org/assignments/media-types/media-types.xhtml)
+- [build_mime_types.py](build_mime_types.py) - Script to build class file (run automatically by poetry build)

build_mime_types/application.csv

@@ -0,0 +1,160 @@
+Name,Template,Reference
+1d-interleaved-parityfec,audio/1d-interleaved-parityfec,[RFC6015]
+32kadpcm,audio/32kadpcm,[RFC3802][RFC2421]
+3gpp,audio/3gpp,[RFC3839][RFC6381]
+3gpp2,audio/3gpp2,[RFC4393][RFC6381]
+aac,audio/aac,[ISO-IEC_JTC_1][Max_Neuendorf]
+ac3,audio/ac3,[RFC4184]
+AMR,audio/AMR,[RFC4867]
+AMR-WB,audio/AMR-WB,[RFC4867]
+amr-wb+,audio/amr-wb+,[RFC4352]
+aptx,audio/aptx,[RFC7310]
+asc,audio/asc,[RFC6295]
+ATRAC-ADVANCED-LOSSLESS,audio/ATRAC-ADVANCED-LOSSLESS,[RFC5584]
+ATRAC-X,audio/ATRAC-X,[RFC5584]
+ATRAC3,audio/ATRAC3,[RFC5584]
+basic,audio/basic,[RFC2045][RFC2046]
+BV16,audio/BV16,[RFC4298]
+BV32,audio/BV32,[RFC4298]
+clearmode,audio/clearmode,[RFC4040]
+CN,audio/CN,[RFC3389]
+DAT12,audio/DAT12,[RFC3190]
+dls,audio/dls,[RFC4613]
+dsr-es201108,audio/dsr-es201108,[RFC3557]
+dsr-es202050,audio/dsr-es202050,[RFC4060]
+dsr-es202211,audio/dsr-es202211,[RFC4060]
+dsr-es202212,audio/dsr-es202212,[RFC4060]
+DV,audio/DV,[RFC6469]
+DVI4,audio/DVI4,[RFC4856]
+eac3,audio/eac3,[RFC4598]
+encaprtp,audio/encaprtp,[RFC6849]
+EVRC,audio/EVRC,[RFC4788]
+EVRC-QCP,audio/EVRC-QCP,[RFC3625]
+EVRC0,audio/EVRC0,[RFC4788]
+EVRC1,audio/EVRC1,[RFC4788]
+EVRCB,audio/EVRCB,[RFC5188]
+EVRCB0,audio/EVRCB0,[RFC5188]
+EVRCB1,audio/EVRCB1,[RFC4788]
+EVRCNW,audio/EVRCNW,[RFC6884]
+EVRCNW0,audio/EVRCNW0,[RFC6884]
+EVRCNW1,audio/EVRCNW1,[RFC6884]
+EVRCWB,audio/EVRCWB,[RFC5188]
+EVRCWB0,audio/EVRCWB0,[RFC5188]
+EVRCWB1,audio/EVRCWB1,[RFC5188]
+EVS,audio/EVS,[_3GPP][Kyunghun_Jung]
+example,audio/example,[RFC4735]
+flexfec,audio/flexfec,[RFC8627]
+fwdred,audio/fwdred,[RFC6354]
+G711-0,audio/G711-0,[RFC7655]
+G719,audio/G719,[RFC5404][RFC Errata 3245]
+G7221,audio/G7221,[RFC5577]
+G722,audio/G722,[RFC4856]
+G723,audio/G723,[RFC4856]
+G726-16,audio/G726-16,[RFC4856]
+G726-24,audio/G726-24,[RFC4856]
+G726-32,audio/G726-32,[RFC4856]
+G726-40,audio/G726-40,[RFC4856]
+G728,audio/G728,[RFC4856]
+G729,audio/G729,[RFC4856]
+G7291,audio/G7291,[RFC4749][RFC5459]
+G729D,audio/G729D,[RFC4856]
+G729E,audio/G729E,[RFC4856]
+GSM,audio/GSM,[RFC4856]
+GSM-EFR,audio/GSM-EFR,[RFC4856]
+GSM-HR-08,audio/GSM-HR-08,[RFC5993]
+iLBC,audio/iLBC,[RFC3952]
+ip-mr_v2.5,audio/ip-mr_v2.5,[RFC6262]
+L8,audio/L8,[RFC4856]
+L16,audio/L16,[RFC4856]
+L20,audio/L20,[RFC3190]
+L24,audio/L24,[RFC3190]
+LPC,audio/LPC,[RFC4856]
+matroska,audio/matroska,[RFC-ietf-cellar-matroska-21]
+MELP,audio/MELP,[RFC8130]
+MELP600,audio/MELP600,[RFC8130]
+MELP1200,audio/MELP1200,[RFC8130]
+MELP2400,audio/MELP2400,[RFC8130]
+mhas,audio/mhas,[ISO-IEC_JTC_1][Nils_Peters][Ingo_Hofmann]
+mobile-xmf,audio/mobile-xmf,[RFC4723]
+MPA,audio/MPA,[RFC3555]
+mp4,audio/mp4,[RFC4337][RFC6381]
+MP4A-LATM,audio/MP4A-LATM,[RFC6416]
+mpa-robust,audio/mpa-robust,[RFC5219]
+mpeg,audio/mpeg,[RFC3003]
+mpeg4-generic,audio/mpeg4-generic,[RFC3640][RFC5691][RFC6295]
+ogg,audio/ogg,[RFC5334][RFC7845]
+opus,audio/opus,[RFC7587]
+parityfec,audio/parityfec,[RFC3009]
+PCMA,audio/PCMA,[RFC4856]
+PCMA-WB,audio/PCMA-WB,[RFC5391]
+PCMU,audio/PCMU,[RFC4856]
+PCMU-WB,audio/PCMU-WB,[RFC5391]
+prs.sid,audio/prs.sid,[Linus_Walleij]
+QCELP,audio/QCELP,[RFC3555][RFC3625]
+raptorfec,audio/raptorfec,[RFC6682]
+RED,audio/RED,[RFC3555]
+rtp-enc-aescm128,audio/rtp-enc-aescm128,[_3GPP]
+rtploopback,audio/rtploopback,[RFC6849]
+rtp-midi,audio/rtp-midi,[RFC6295]
+rtx,audio/rtx,[RFC4588]
+scip,audio/scip,[SCIP][Michael_Faller][Daniel_Hanson]
+SMV,audio/SMV,[RFC3558]
+SMV0,audio/SMV0,[RFC3558]
+SMV-QCP,audio/SMV-QCP,[RFC3625]
+sofa,audio/sofa,[AES][Piotr_Majdak]
+sp-midi,audio/sp-midi,[Athan_Billias][MIDI_Association]
+speex,audio/speex,[RFC5574]
+t140c,audio/t140c,[RFC4351]
+t38,audio/t38,[RFC4612]
+telephone-event,audio/telephone-event,[RFC4733]
+TETRA_ACELP,audio/TETRA_ACELP,[ETSI][Miguel_Angel_Reina_Ortega]
+TETRA_ACELP_BB,audio/TETRA_ACELP_BB,[ETSI][Miguel_Angel_Reina_Ortega]
+tone,audio/tone,[RFC4733]
+TSVCIS,audio/TSVCIS,[RFC8817]
+UEMCLIP,audio/UEMCLIP,[RFC5686]
+ulpfec,audio/ulpfec,[RFC5109]
+usac,audio/usac,[ISO-IEC_JTC_1][Max_Neuendorf]
+VDVI,audio/VDVI,[RFC4856]
+VMR-WB,audio/VMR-WB,[RFC4348][RFC4424]
+vnd.3gpp.iufp,audio/vnd.3gpp.iufp,[Thomas_Belling]
+vnd.4SB,audio/vnd.4SB,[Serge_De_Jaham]
+vnd.audiokoz,audio/vnd.audiokoz,[Vicki_DeBarros]
+vnd.CELP,audio/vnd.CELP,[Serge_De_Jaham]
+vnd.cisco.nse,audio/vnd.cisco.nse,[Rajesh_Kumar]
+vnd.cmles.radio-events,audio/vnd.cmles.radio-events,[Jean-Philippe_Goulet]
+vnd.cns.anp1,audio/vnd.cns.anp1,[Ann_McLaughlin]
+vnd.cns.inf1,audio/vnd.cns.inf1,[Ann_McLaughlin]
+vnd.dece.audio,audio/vnd.dece.audio,[Michael_A_Dolan]
+vnd.digital-winds,audio/vnd.digital-winds,[Armands_Strazds]
+vnd.dlna.adts,audio/vnd.dlna.adts,[Edwin_Heredia]
+vnd.dolby.heaac.1,audio/vnd.dolby.heaac.1,[Steve_Hattersley]
+vnd.dolby.heaac.2,audio/vnd.dolby.heaac.2,[Steve_Hattersley]
+vnd.dolby.mlp,audio/vnd.dolby.mlp,[Mike_Ward]
+vnd.dolby.mps,audio/vnd.dolby.mps,[Steve_Hattersley]
+vnd.dolby.pl2,audio/vnd.dolby.pl2,[Steve_Hattersley]
+vnd.dolby.pl2x,audio/vnd.dolby.pl2x,[Steve_Hattersley]
+vnd.dolby.pl2z,audio/vnd.dolby.pl2z,[Steve_Hattersley]
+vnd.dolby.pulse.1,audio/vnd.dolby.pulse.1,[Steve_Hattersley]
+vnd.dra,audio/vnd.dra,[Jiang_Tian]
+vnd.dts,audio/vnd.dts,[William_Zou]
+vnd.dts.hd,audio/vnd.dts.hd,[William_Zou]
+vnd.dts.uhd,audio/vnd.dts.uhd,[Phillip_Maness]
+vnd.dvb.file,audio/vnd.dvb.file,[Peter_Siebert]
+vnd.everad.plj,audio/vnd.everad.plj,[Shay_Cicelsky]
+vnd.hns.audio,audio/vnd.hns.audio,[Swaminathan]
+vnd.lucent.voice,audio/vnd.lucent.voice,[Greg_Vaudreuil]
+vnd.ms-playready.media.pya,audio/vnd.ms-playready.media.pya,[Steve_DiAcetis]
+vnd.nokia.mobile-xmf,audio/vnd.nokia.mobile-xmf,[Nokia]
+vnd.nortel.vbk,audio/vnd.nortel.vbk,[Glenn_Parsons]
+vnd.nuera.ecelp4800,audio/vnd.nuera.ecelp4800,[Michael_Fox]
+vnd.nuera.ecelp7470,audio/vnd.nuera.ecelp7470,[Michael_Fox]
+vnd.nuera.ecelp9600,audio/vnd.nuera.ecelp9600,[Michael_Fox]
+vnd.octel.sbc,audio/vnd.octel.sbc,[Greg_Vaudreuil]
+vnd.presonus.multitrack,audio/vnd.presonus.multitrack,[Matthias_Juwan]
+vnd.qcelp - DEPRECATED in favor of audio/qcelp,audio/vnd.qcelp,[RFC3625]
+vnd.rhetorex.32kadpcm,audio/vnd.rhetorex.32kadpcm,[Greg_Vaudreuil]
+vnd.rip,audio/vnd.rip,[Martin_Dawe]
+vnd.sealedmedia.softseal.mpeg,audio/vnd.sealedmedia.softseal.mpeg,[David_Petersen]
+vnd.vmx.cvsd,audio/vnd.vmx.cvsd,[Greg_Vaudreuil]
+vorbis,audio/vorbis,[RFC5215]
+vorbis-config,audio/vorbis-config,[RFC5215]

build_mime_types/audio.csv

@@ -0,0 +1,123 @@
+import csv
+import os
+import re
+from inspect import getsourcefile
+from os.path import abspath
+from string import Template
+from typing import List, Dict, Final
+
+INT_MAP: Final = {
+    0: "ZERO",
+    1: "ONE",
+    2: "TWO",
+    3: "THREE",
+    4: "FOUR",
+    5: "FIVE",
+    6: "SIX",
+    7: "SEVEN",
+    8: "EIGHT",
+    9: "NINE"
+}
+
+CSV_FILES: Final = {
+    "application.csv",
+    "audio.csv",
+    "font.csv",
+    "image.csv",
+    "message.csv",
+    "model.csv",
+    "multipart.csv",
+    "text.csv",
+    "video.csv"
+}
+
+
+def _to_enum_name(template: str) -> str:
+    """
+    Converts the IANA template to an enum name
+    :param template: IANA template value
+    :return: parsed and formatted name
+    """
+    # Of course there is one outlier with a + at the end of it
+    name_suffix: str = ""
+    if template.endswith('+'):
+        name_suffix = "_PLUS"
+
+    name_parts: List[str] = [x for x in re.split(r'[+.\-/]+', template) if x]
+    enum_name: str = "_".join(name_parts)
+    enum_name += name_suffix
+
+    return enum_name.upper()
+
+
+class MimeType:
+    """
+    Holds a representation of an IANA mime type
+    """
+    def __init__(self, template: str):
+        """
+        Information about a mime type
+        :param template: Template / header value
+        """
+        self.enum_value = template
+        self.enum_name = _to_enum_name(template=template)
+
+
+def build_mime_types_file():
+    """
+    Loads application.csv and outputs a ContentType() class in
+    src/openapi_parser/mime_types.py.
+
+    Allows for easy update of ContentTypes when the IANA list changes
+
+    :return: None
+    """
+
+    template_string = '''""" AUTO_GENERATED BY build_mime_types.py - DO NOT EDIT """
+
+from enum import Enum, unique
+    
+    
+@unique
+class ContentType(Enum):\n'''
+
+    mime_types: Dict = {}
+
+    cur_file: str = abspath(getsourcefile(lambda: 0))
+    cur_dir: str = cur_file.rstrip("build_mime_types.py")
+
+    i: int = 0
+    for file in CSV_FILES:
+        with open(f"{cur_dir}{file}", mode='r', encoding='utf-8') as csvfile:
+            mime_extension: str = file.rstrip(".csv")
+            reader: csv.reader = csv.reader(csvfile, delimiter=',')
+            next(reader)
+            for row in reader:
+                if (
+                        row[0] is not None
+                        and row[0] != ''
+                        and "OBSOLETE" not in row[0]
+                        and "DEPRECATED" not in row[0]
+
+                ):
+                    if row[1] is None or row[1] == '':
+                        row[1] = f"{mime_extension}/{row[0]}"
+
+                    mime_type = MimeType(template=row[1])
+                    mime_types[f"name_{i}"] = mime_type.enum_name
+                    mime_types[f"value_{i}"] = mime_type.enum_value
+                    template_string += f"        $name_{i} = '$value_{i}'\n"
+                i += 1
+        csvfile.close()
+
+    template_string += "\n"
+    template: Template = Template(template=template_string)
+    class_file_path = os.path.join(cur_dir, "../src/openapi_parser/mime_types.py")
+
+    with open(class_file_path, mode='w', encoding='utf-8') as class_file:
+        class_file.write(template.safe_substitute(mime_types))
+    class_file.close()
+
+
+if __name__ == "__main__":
+    build_mime_types_file()

build_mime_types/build_mime_types.py

@@ -0,0 +1,7 @@
+Name,Template,Reference
+collection,font/collection,[RFC8081]
+otf,font/otf,[RFC8081]
+sfnt,font/sfnt,[RFC8081]
+ttf,font/ttf,[RFC8081]
+woff,font/woff,[RFC8081]
+woff2,font/woff2,[RFC8081]

build_mime_types/font.csv

@@ -0,0 +1,82 @@
+Name,Template,Reference
+aces,image/aces,[SMPTE][Howard_Lukk]
+apng,image/apng,[W3C][W3C_PNG_Working_Group]
+avci,image/avci,[ISO-IEC_JTC_1][David_Singer]
+avcs,image/avcs,[ISO-IEC_JTC_1][David_Singer]
+avif,image/avif,[Alliance_for_Open_Media][Cyril_Concolato]
+bmp,image/bmp,[RFC7903]
+cgm,image/cgm,[Alan_Francis]
+dicom-rle,image/dicom-rle,[DICOM_Standard_Committee][David_Clunie]
+dpx,image/dpx,[SMPTE][SMPTE_Director_of_Standards_Development]
+emf,image/emf,[RFC7903]
+example,image/example,[RFC4735]
+fits,image/fits,[RFC4047]
+g3fax,image/g3fax,[RFC1494]
+gif,,[RFC2045][RFC2046]
+heic,image/heic,[ISO-IEC_JTC_1][David_Singer]
+heic-sequence,image/heic-sequence,[ISO-IEC_JTC_1][David_Singer]
+heif,image/heif,[ISO-IEC_JTC_1][David_Singer]
+heif-sequence,image/heif-sequence,[ISO-IEC_JTC_1][David_Singer]
+hej2k,image/hej2k,[ISO-IEC_JTC_1][ITU-T]
+hsj2,image/hsj2,[ISO-IEC_JTC_1][ITU-T]
+ief,,[RFC1314]
+j2c,image/j2c,[ISO-IEC_JTC_1_SC_29_WG_1][ISO-IEC_JTC_1][ITU-T]
+jls,image/jls,[DICOM_Standard_Committee][David_Clunie]
+jp2,image/jp2,[RFC3745]
+jpeg,,[RFC2045][RFC2046]
+jph,image/jph,[ISO-IEC_JTC_1][ITU-T]
+jphc,image/jphc,[ISO-IEC_JTC_1][ITU-T]
+jpm,image/jpm,[RFC3745]
+jpx,image/jpx,[RFC3745]
+jxr,image/jxr,[ISO-IEC_JTC_1][ITU-T]
+jxrA,image/jxrA,[ISO-IEC_JTC_1][ITU-T]
+jxrS,image/jxrS,[ISO-IEC_JTC_1][ITU-T]
+jxs,image/jxs,[ISO-IEC_JTC_1]
+jxsc,image/jxsc,[ISO-IEC_JTC_1]
+jxsi,image/jxsi,[ISO-IEC_JTC_1]
+jxss,image/jxss,[ISO-IEC_JTC_1]
+ktx,image/ktx,[Khronos][Mark_Callow]
+ktx2,image/ktx2,[Khronos][Mark_Callow]
+naplps,image/naplps,[Ilya_Ferber]
+png,image/png,[W3C][PNG_Working_Group]
+prs.btif,image/prs.btif,[Ben_Simon]
+prs.pti,image/prs.pti,[Juern_Laun]
+pwg-raster,image/pwg-raster,[Michael_Sweet]
+svg+xml,image/svg+xml,[W3C][http://www.w3.org/TR/SVG/mimereg.html]
+t38,image/t38,[RFC3362]
+tiff,image/tiff,[RFC3302]
+tiff-fx,image/tiff-fx,[RFC3950]
+vnd.adobe.photoshop,image/vnd.adobe.photoshop,[Kim_Scarborough]
+vnd.airzip.accelerator.azv,image/vnd.airzip.accelerator.azv,[Gary_Clueit]
+vnd.cns.inf2,image/vnd.cns.inf2,[Ann_McLaughlin]
+vnd.dece.graphic,image/vnd.dece.graphic,[Michael_A_Dolan]
+vnd.djvu,image/vnd.djvu,[Leon_Bottou]
+vnd.dwg,image/vnd.dwg,[Jodi_Moline]
+vnd.dxf,image/vnd.dxf,[Jodi_Moline]
+vnd.dvb.subtitle,image/vnd.dvb.subtitle,[Peter_Siebert][Michael_Lagally]
+vnd.fastbidsheet,image/vnd.fastbidsheet,[Scott_Becker]
+vnd.fpx,image/vnd.fpx,[Marc_Douglas_Spencer]
+vnd.fst,image/vnd.fst,[Arild_Fuldseth]
+vnd.fujixerox.edmics-mmr,image/vnd.fujixerox.edmics-mmr,[Masanori_Onda]
+vnd.fujixerox.edmics-rlc,image/vnd.fujixerox.edmics-rlc,[Masanori_Onda]
+vnd.globalgraphics.pgb,image/vnd.globalgraphics.pgb,[Martin_Bailey]
+vnd.microsoft.icon,image/vnd.microsoft.icon,[Simon_Butcher]
+vnd.mix,image/vnd.mix,[Saveen_Reddy]
+vnd.ms-modi,image/vnd.ms-modi,[Gregory_Vaughan]
+vnd.mozilla.apng,image/vnd.mozilla.apng,[Stuart_Parmenter]
+vnd.net-fpx,image/vnd.net-fpx,[Marc_Douglas_Spencer]
+vnd.pco.b16,image/vnd.pco.b16,[PCO_AG][Jan_Zeman]
+vnd.radiance,image/vnd.radiance,[Randolph_Fritz][Greg_Ward]
+vnd.sealed.png,image/vnd.sealed.png,[David_Petersen]
+vnd.sealedmedia.softseal.gif,image/vnd.sealedmedia.softseal.gif,[David_Petersen]
+vnd.sealedmedia.softseal.jpg,image/vnd.sealedmedia.softseal.jpg,[David_Petersen]
+vnd.svf,image/vnd.svf,[Jodi_Moline]
+vnd.tencent.tap,image/vnd.tencent.tap,[Ni_Hui]
+vnd.valve.source.texture,image/vnd.valve.source.texture,[Henrik_Andersson]
+vnd.wap.wbmp,image/vnd.wap.wbmp,[Peter_Stark]
+vnd.xiff,image/vnd.xiff,[Steven_Martin]
+vnd.zbrush.pcx,image/vnd.zbrush.pcx,[Chris_Charabaruk]
+webp,image/webp,[RFC-zern-webp-12]
+wmf,image/wmf,[RFC7903]
+x-emf - DEPRECATED in favor of image/emf,image/emf,[RFC7903]
+x-wmf - DEPRECATED in favor of image/wmf,image/wmf,[RFC7903]