o iAddlZddlZddlmZddlmZmZddlmZm Z m Z ddl m Z ddl mZmZddlmZddlmZmZmZmZd d lmZmZejeZ d,d edefdZ d,ded edefdZdZ dedededZ!defdZ"defdZ# d-de eefde e$eeffdZ%e d-dede efdZ&ed dddddddddd! ded"ed#e e'd$e ede e$d%e ed&e e'd'e e e(eefd(e e e(eefd)e e e(eefd*e efd+Z)dS).N)Path)DEFAULT_PROTOCOL PicklingError)AnyOptionalUnion)version) constantssnapshot_download)HfApi)SoftTemporaryDirectoryget_fastai_versionget_fastcore_versionget_python_version)loggingvalidate_hf_hub_args2.41.3.27fastai_min_versionfastcore_min_versionc tp tdkr4td|d|dtdtd tjt}tjt}|tj|kr"td|dtd |tj|kr"td |d td d S)a- Checks that the installed fastai and fastcore versions are compatible for pickle serialization. Args: fastai_min_version (`str`, *optional*): The minimum fastai version supported. fastcore_min_version (`str`, *optional*): The minimum fastcore version supported. > [!TIP] > Raises the following error: > > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the fastai or fastcore libraries are not available or are of an invalid version. zN/Azfastai>=z and fastcore>=z' are required. Currently using fastai==z and fastcore==.zD`push_to_hub_fastai` and `from_pretrained_fastai` require a fastai>=z+ version, but you are using fastai version zA which is incompatible. Upgrade with `pip install fastai==2.5.6`.zF`push_to_hub_fastai` and `from_pretrained_fastai` require a fastcore>=- version, but you are using fastcore version zD which is incompatible. Upgrade with `pip install fastcore==1.3.27`.N)rr ImportErrorr Version)rrcurrent_fastai_versioncurrent_fastcore_versions \/var/www/html/auto_sub_bot/venv/lib/python3.11/site-packages/huggingface_hub/fastai_utils.py_check_fastai_fastcore_versionsr s\( 6"4"6"65@@ 4) 4 4:N 4 42D2F2F 4 4.00 4 4 4   %_-?-A-ABB&/C/E/EFF0B C CCC *  "$$       '/2F"G"GGG /. / /,.. / / /   HGstorage_folderc ddl}n#t$rtdwxYwtj|dst ddS||d}d| vrt ddS|d}d| vrt d dS|d}d |D}t|dkrt d ntt|d d d }|dkr@tj|tj|krtd|d|dd|D} t| dkrt ddSt| d d d } | dkr@tj| tj|krtd|d| ddSdS)a Checks that the `pyproject.toml` file in the directory `storage_folder` has fastai and fastcore versions that are compatible with `from_pretrained_fastai` and `push_to_hub_fastai`. If `pyproject.toml` does not exist or does not contain versions for fastai and fastcore, then it logs a warning. Args: storage_folder (`str`): Folder to look for the `pyproject.toml` file. fastai_min_version (`str`, *optional*): The minimum fastai version supported. fastcore_min_version (`str`, *optional*): The minimum fastcore version supported. > [!TIP] > Raises the following errors: > > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the `toml` module is not installed. > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the `pyproject.toml` indicates a lower than minimum supported version of fastai or fastcore. rNzn`push_to_hub_fastai` and `from_pretrained_fastai` require the toml module. Install it with `pip install toml`.z/pyproject.tomlzThere is no `pyproject.toml` in the repository that contains the fastai `Learner`. The `pyproject.toml` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.z build-systemzThere is no `build-system` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `build-system` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.requireszThere is no `requires` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `requires` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.c<g|]}|d|S)fastai startswith.0pcks r z=_check_fastai_fastcore_pyproject_versions..s)SSSs#..:R:RSsSSSr!zPThe repository does not have a fastai version specified in the `pyproject.toml`.=z*`from_pretrained_fastai` requires fastai>=z$ version but the model to load uses z which is incompatible.c<g|]}|d|S)fastcorer'r)s rr,z=_check_fastai_fastcore_pyproject_versions..s)WWWCNN:=r)tomlModuleNotFoundErrorrospathisfileloggerwarningloadkeyslenstr partitionr r) r"rrr2pyproject_tomlbuild_system_tomlpackage_versionsfastai_packagesfastai_versionfastcore_packagesfastcore_versions r)_check_fastai_fastcore_pyproject_versionsrEGs6      3     7>>^<<< = =    YY.AAABBN^002222 .   &~6*//1111 .   (4TS&6SSSO ?q  ijjjj_Q/00::3??B R  GON$C$CgoVhFiFi$i$i<.<<"<<<  XW(8WWW ""klllll0344>>sCCAF r ! !go6F&G&G'/ZnJoJo&o&oF2FF,FFF  " !&o&os!u--- tags: - fastai --- # Amazing! 🥳 Congratulations on hosting your fastai model on the Hugging Face Hub! # Some next steps 1. Fill out this model card with more information (see the template below and the [documentation here](https://huggingface.co/docs/hub/model-repos))! 2. Create a demo in Gradio or Streamlit using 🤗 Spaces ([documentation here](https://huggingface.co/docs/hub/spaces)). 3. Join the fastai community on the [Fastai Discord](https://discord.com/invite/YKrxeNn)! Greetings fellow fastlearner 🤝! Don't forget to delete this content from your model card. --- # Model card ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed zB[build-system] requires = ["setuptools>=40.8.0", "wheel", "python=z ", "fastai=z ", "fastcore=z6"] build-backend = "setuptools.build_meta:__legacy__" repo_dirc|dz }|sL|dd5}|tddddS#1swxYwYdSdS)z Creates a model card for the repository. Args: repo_dir (`Path`): Directory where model card is created. z README.mdwutf-8encodingN)existsopenwriteREADME_TEMPLATE)rF readme_pathfs r_create_model_cardrRs[(K     %   cG  4 4 % GGO $ $ $ % % % % % % % % % % % % % % % % % %%%AA Ac|dz }|sL|dd5}|tddddS#1swxYwYdSdS)z Creates a `pyproject.toml` for the repository. Args: repo_dir (`Path`): Directory where `pyproject.toml` is created. zpyproject.tomlrHrIrJN)rLrMrNPYPROJECT_TEMPLATE)rFpyproject_pathrQs r_create_model_pyprojectrWs 00N  " "(  w 7 7 (1 GG& ' ' ' ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( (((rSsave_directoryconfigcttj|d|t|ts t dt |dtj|tj }t|d5}tj ||dddn #1swxYwYtt|t!t|t||_tj|d |dt$dS#t&$rt'd wxYw) a Saves a fastai learner to `save_directory` in pickle format using the default pickle protocol for the version of python used. Args: learner (`Learner`): The `fastai.Learner` you'd like to save. save_directory (`str` or `Path`): Specific directory in which you want to save the fastai learner. config (`dict`, *optional*): Configuration object. Will be uploaded as a .json file. Example: 'https://huggingface.co/espejelomar/fastai-pet-breeds-classification/blob/main/config.json'. > [!TIP] > Raises the following error: > > - [`RuntimeError`](https://docs.python.org/3/library/exceptions.html#RuntimeError) > if the config file provided is not a dictionary. T)exist_okNz(Provided config should be a dict. Got: ''rH model.pkl)fnamepickle_protocolzYou are using a lambda function, i.e., an anonymous function. `pickle` cannot pickle function objects and requires that all functions have names. One possible solution is to name the function.)r r4makedirs isinstancedict RuntimeErrortyper5joinr CONFIG_NAMErMjsondumprRrrWexportrr)learnerrXrYr5rQs r_save_pretrained_fastairks,$%%%K....&$'' [Y$v,,YYYZZ Zw||NI,ABB $__ ! Ifa  ! ! ! ! ! ! ! ! ! ! ! ! ! ! !tN++,,,D00111''GLK....  ,           E    sB88B<?B<&EErepo_idrevisioncttj|s t ||dt }n|}t |ddlm}|tj |dS)ap Load pretrained fastai model from the Hub or from a local directory. Args: repo_id (`str`): The location where the pickled fastai.Learner is. It can be either of the two: - Hosted on the Hugging Face Hub. E.g.: 'espejelomar/fatai-pet-breeds-classification' or 'distilgpt2'. You can add a `revision` by appending `@` at the end of `repo_id`. E.g.: `dbmdz/bert-base-german-cased@main`. Revision is the specific model version to use. Since we use a git-based system for storing models and other artifacts on the Hugging Face Hub, it can be a branch name, a tag name, or a commit id. - Hosted locally. `repo_id` would be a directory containing the pickle and a pyproject.toml indicating the fastai and fastcore versions used to build the `fastai.Learner`. E.g.: `./my_model_directory/`. revision (`str`, *optional*): Revision at which the repo's files are downloaded. See documentation of `snapshot_download`. Returns: The `fastai.Learner` model in the `repo_id` repo. r&)rlrm library_namelibrary_versionr) load_learnerr]) r r4r5isdirr rrEfastai.learnerrqre)rlrmr"rqs rfrom_pretrained_fastairt!s.$%%% 7== ! !!*!.00    !-n===++++++ < ^[AA B BBr!z(Push FastAI model using huggingface_hub.) commit_messageprivatetokenrYbranch create_prallow_patternsignore_patternsdelete_patterns api_endpointrurvrwrxryrzr{r|r}c Ntt| } | |||dj}t 5} t | |z }t |||| |||||||| |  cdddS#1swxYwYdS)a Upload learner checkpoint files to the Hub. Use `allow_patterns` and `ignore_patterns` to precisely filter which files should be pushed to the hub. Use `delete_patterns` to delete existing remote files in the same commit. See [`upload_folder`] reference for more details. Args: learner (`Learner`): The `fastai.Learner' you'd like to push to the Hub. repo_id (`str`): The repository id for your model in Hub in the format of "namespace/repo_name". The namespace can be your individual account or an organization to which you have write access (for example, 'stanfordnlp/stanza-de'). commit_message (`str`, *optional*): Message to commit while pushing. Will default to :obj:`"add model"`. private (`bool`, *optional*): Whether or not the repository created should be private. If `None` (default), will default to been public except if the organization's default is private. token (`str`, *optional*): The Hugging Face account token to use as HTTP bearer authorization for remote files. If :obj:`None`, the token will be asked by a prompt. config (`dict`, *optional*): Configuration object to be saved alongside the model weights. branch (`str`, *optional*): The git branch on which to push the model. This defaults to the default branch as specified in your repository, which defaults to `"main"`. create_pr (`boolean`, *optional*): Whether or not to create a Pull Request from `branch` with that commit. Defaults to `False`. api_endpoint (`str`, *optional*): The API endpoint to use when pushing the model to the hub. allow_patterns (`list[str]` or `str`, *optional*): If provided, only files matching at least one pattern are pushed. ignore_patterns (`list[str]` or `str`, *optional*): If provided, files matching any of the patterns are not pushed. delete_patterns (`list[str]` or `str`, *optional*): If provided, remote files matching any of the patterns will be deleted from the repo. Returns: The url of the commit of your model in the given repository. > [!TIP] > Raises the following error: > > - [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) > if the user is not log on to the Hugging Face Hub. )endpointT)rlrwrvr[)rY) rlrw folder_pathrurmryrzr{r|N)r r create_reporlr rrk upload_folder)rjrlrurvrwrYrxryrzr{r|r}apitmp saved_paths rpush_to_hub_fastairNs|$%%%  & & &CoogUGVZo[[cG ! !  S#YY( FCCCC  "))++!                      s ABB!B)rr)N)*rgr4pathlibrpicklerrtypingrrr packagingr huggingface_hubr r huggingface_hub.hf_apir huggingface_hub.utilsr rrrutilsrr get_logger__name__r7r<r rErOrUrRrWrbrkrtboollistrr!rrs 22222222''''''''''88888888((((((10000000  H % %$ (, , , , , , , b$ (\\\\\\\\~ D4F4F4H4HUgUgUiUiyMyMyOyO % % % % % (d ( ( ( ($(,2 2 #t)$2  T#s(^ $2 2 2 2 j#)C)C )Csm)C)C)C)CX E"! $6:7;7;"&O O O O  O d^ O C= O  TNO  SMO ~O U49c>23O eDIsN34O eDIsN34O 3-O O O O O O r!