/jUdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z ejeZdZiZeedfed <ej*Zed Gd d ZdeeefdefdZdededefdZdedefdZdededeeefdzfdZdedeeefdzfdZdededeeefddfdZy)a5On-disk cache for repository tree listings. A tree listing is the set of files (with their download metadata) contained in a repo at a given commit. Because a commit hash is immutable, its tree listing never changes and can be cached forever without any invalidation logic. The listing is stored as a human-readable JSON file under `/trees/.json`. The folder depends on the download target: the per-repo `storage_folder` for `cache_dir` downloads, or `local_dir/.cache/huggingface/` for `local_dir` downloads (see `tree_cache_folder_for_local_dir`). ```json { "format_version": 1, "files": { "config.json": {"size": 519, "blob_id": ""}, "model.safetensors": {"size": 1234, "blob_id": "...", "lfs_sha256": "", "lfs_size": 1234, "xet_hash": "..."} } } ``` N) dataclass)logging)as_extended_path)is_valid_xet_hashzdict[str, TreeCacheEntry]_IN_MEMORY_TREE_CACHET)frozenceZdZUdZeed<eed<dZedzed<dZedzed<dZ edzed<de fd Z e d e ddfd Z y) TreeCacheEntryz^Raw metadata of a single file in a cached tree listing, mirroring the `/tree` endpoint fields.sizeblob_idN lfs_sha256lfs_sizexet_hashreturnc|j|jd}|j|j|d<|j|d<|j|j|d<|S)N)r r rrrr r rrr)selfinfos ^/root/repos/pocs/video-evals/.venv/lib/python3.12/site-packages/huggingface_hub/_tree_cache.pyto_jsonzTreeCacheEntry.to_json@sW"iiDLLA ?? &!%D #}}D  == $#}}D  rc ||d|d|jd|jd|jdS)Nr r rrrr)get)clsrs r from_jsonzTreeCacheEntry.from_jsonIsAfOxx -XXj)XXj)   r)__name__ __module__ __qualname____doc__int__annotations__strrrrdictr classmethodrrrr r 6shh I L!Jd !HcDjHcDj T &6  rr entriesrcBtd|jDS)zz(is_valid_tree_entries..Vs+iuu~~%J):5>>)JJis/1)allvalues)r's ris_valid_tree_entriesr/Ts iX_XfXfXhi iirtree_cache_folder commit_hashc\ttjj|d|dS)Ntreesz.json)rospathjoin)r0r1s r_tree_cache_pathr7Ys) BGGLL):G }TYEZ[ \\r local_dircDtjj|ddS)zGFolder under which the `trees/` cache lives for a `local_dir` download.z.cache huggingface)r4r5r6)r8s rtree_cache_folder_for_local_dirr;_s 77<< 8] ;;rc$t||}t5|tvr!t|}t|r|ndcdddS dddt |}| t|syt5|t|<ddd|S#1swY%J>PTUU (U).G3G< #.&-d#. NUU. Ns A9% B9BBr5c t|d5}tj|}dddjdtk7ry|dj Dcic]\}}|t j|c}}S#1swY\xYwcc}}w#t$rYyttttf$r%}tjd|d|Yd}~yd}~wwxYw)Nutf-8encodingformat_versionfilesz#Ignoring corrupted tree cache file : )openjsonloadrTREE_CACHE_FORMAT_VERSIONitemsr rFileNotFoundErrorOSError ValueErrorKeyError TypeErrorloggerwarning)r5fdata file_pathres rr>r>ss  $ ) Q99Q33D99gg   h  Z9 5rhr&rrrqsO( !*)   H %ACtC!<<=B+Y^^- $   :j4^(;#<jj ]]#]#] FYAZ]aAa  S T#~2E-F-M 44#4SR`M`Ha4fj4r