File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/pip/_internal/network/__pycache__/download.cpython-310.pyc
Back
o ;j�1 � @ s� d Z ddlmZ ddlZddlZddlZddlZddlm Z m Z ddl m Z ddl mZ ddlmZ ddlmZ dd lmZ dd lmZ dd lmZ dd lmZ dd l m Z m Z ddl m Z m!Z! ddl"m#Z# ddl$m%Z% ddl&m'Z'm(Z( ddl)m*Z*m+Z+ ddl,m-Z-m.Z.m/Z/ ddl0m1Z1m2Z2m3Z3 e�4e5�Z6d5dd�Z7d6d d �Z8 d7d8d%d&�Z9d9d)d*�Z:d:d-d.�Z;d;d/d0�Z<e G d1d2� d2��Z=G d3d4� d4�Z>dS )<z(Download files with progress indicators.� )� annotationsN)�Iterable�Mapping)� dataclass)� HTTPStatus)�BinaryIO)�PreparedRequest)�Response)� HTTPResponse)�HTTPHeaderDict)�ReadTimeoutError)�BarType� get_download_progress_renderer)�IncompleteDownloadError�NetworkConnectionError)�PyPI)�Link)� SafeFileCache� is_from_cache)�CacheControlAdapter� PipSession)�HEADERS�raise_for_status�response_chunks)� format_size�redact_auth_from_url�splitext�respr �return� int | Nonec C s, zt | jd �W S tttfy Y d S w )N�content-length)�int�headers� ValueError�KeyError� TypeError�r � r' �R/opt/saltstack/salt/lib/python3.10/site-packages/pip/_internal/network/download.py�_get_http_response_size s �r) � str | Nonec C s | j �d| j �d��S )z� Return either the ETag or Last-Modified header (or None if neither exists). The return value can be used in an If-Range header. Zetagz last-modified)r" �getr& r' r' r( �(_get_http_response_etag_or_last_modified' s r, �linkr � progress_barr � total_length� range_start�Iterable[bytes]c C s� |j tjkr |j}n|j}t|�}|r/|r%|� dt|�� dt|�� d�}n |� dt|�� d�}t| �r:t� d|� n|rCt� d|� nt� d|� t� � t j krSd}nt| �rZd}n|s_d}n |d krfd}nd}t | �}|sp|S t|||d �} | |�S ) Nz (�/�)zUsing cached %szResuming download %szDownloading %sFTi )Zbar_type�sizeZinitial_progress)�netlocr Zfile_storage_domainZshow_url�url_without_fragmentr r r �logger�info�getEffectiveLevel�logging�INFOr r ) r r- r. r/ r0 �urlZ logged_urlZ show_progress�chunksZrendererr' r' r( � _log_download/ s< � �r> �filename�strc C s t j�| �S )zJ Sanitize the "filename" value from a Content-Disposition header. )�os�path�basename)r? r' r' r( �sanitize_content_filenameb s rD �content_disposition�default_filenamec C s4 t j�� }| |d< |�d�}|rtt|��}|p|S )z� Parse the "filename" value from a Content-Disposition header, and return the default filename if the result is empty. � content-typer? )�email�message�Message� get_paramrD r@ )rE rF �mr? r' r' r( �parse_content_dispositioni s rM c C s� |j }| j�d�}|rt||�}t|�d }|s(t�| j�dd��}|r(||7 }|s?|j| jkr?tj �| j�d }|r?||7 }|S )zoGet an ideal filename from the given HTTP response, falling back to the link filename if not provided. zcontent-disposition� rG � ) r? r" r+ rM r � mimetypesZguess_extensionr< rA rB )r r- r? rE �extr' r' r( �_get_http_response_filenamex s rR c @ s` e Zd ZU dZded< ded< ded< dZd ed < dZd ed < ddd�Zddd�Zddd�Z dS )� _FileDownloadz+Stores the state of a single link download.r r- r � output_filer r4 r r! �bytes_received� reattemptsr �boolc C s t | jd uo | j| jk �S �N)rW r4 rU ��selfr' r' r( � is_incomplete� s z_FileDownload.is_incomplete�data�bytes�Nonec C s" | j t|�7 _ | j�|� d S rX )rU �lenrT �write)rZ r\ r' r' r( � write_chunk� s z_FileDownload.write_chunkc C s | j �d� | j �� d| _dS )z1Delete any saved data and reset progress to zero.r N)rT �seek�truncaterU rY r' r' r( � reset_file� s z_FileDownload.reset_fileN)r rW )r\ r] r r^ )r r^ ) �__name__� __module__� __qualname__�__doc__�__annotations__rU rV r[ ra rd r' r' r' r( rS � s rS c @ s` e Zd Zd+d d �Zd,dd�Zd-dd�Zd.dd �Zd/d d �Zd0d!d"�Zd1d$d%�Z e fd2d(d)�Z d*S )3� Downloader�sessionr r. r �resume_retriesr! r r^ c C s& |dksJ d��|| _ || _|| _d S )Nr z<Number of max resume retries must be bigger or equal to zero)�_session� _progress_bar�_resume_retries)rZ rk r. rl r' r' r( �__init__� s � zDownloader.__init__�links�Iterable[Link]�locationr@ �&Iterable[tuple[Link, tuple[str, str]]]c c s, � |D ]}| ||�\}}|||ffV qdS )z.Convenience method to download multiple links.Nr' )rZ rq rs r- �filepath� content_typer' r' r( �batch� s ��zDownloader.batchr- r �tuple[str, str]c C s� | � |�}t|�}tj�|t||��}t|d�� }t|||�}| �||� |� � r/| � ||� W d � n1 s9w Y |j � dd�}||fS )z+Download a link and save it under location.�wbNz Content-TyperO ) � _http_getr) rA rB �joinrR �openrS �_process_responser[ � _attempt_resumes_or_redownloadsr" r+ ) rZ r- rs r Z download_sizeru Z content_file�downloadrv r' r' r( �__call__� s � �zDownloader.__call__r rS r r c C st t ||j| j|j|jd�}z |D ]}|�|� qW dS ty9 } z|jdu r)|�t�d� W Y d}~dS d}~ww )z)Download and save chunks from a response.)r0 Nz'Connection timed out while downloading.) r> r- rn r4 rU ra r r7 �warning)rZ r r r= �chunk�er' r' r( r} � s" � � ��z Downloader._process_response� first_respc C s� |j | jk r`|�� r`|jdusJ �| j d7 _ t�dt|j�t|j�|j � z"| j||d�}|j t j k}|rB|� � t |�|_|}| �||� W n tttfyU Y q w |j | jk r`|�� s |�� rot�|jj� t|��|j dkr|| �||� dS dS )zAAttempt to resume/restart the download if connection was dropped.NrN z<Attempting to resume incomplete download (%s/%s, attempt %d))� should_matchr )rV ro r[ r4 r7 r� r rU �_http_get_resume� status_coder �PARTIAL_CONTENTrd r) r} �ConnectionErrorr �OSErrorrA �removerT �namer �_cache_resumed_download)rZ r r� Z resume_respZ must_restartr' r' r( r~ � s6 � �� �z*Downloader._attempt_resumes_or_redownloads�original_responsec C s& |j j}| j�|�}t|t�st�d|� dS t|jt �s!J d��t � }|j d|i d� t � }|j �� D ]\}}|�� dvrB|||< q4t|j�|d< td|d d d �} |j�|�} |jj�|| d �} |j�| | � |j�� t|jjd ��} |j� | | � W d � n1 s�w Y t�d|� dS )an Manually cache a file that was successfully downloaded via resume retries. cachecontrol doesn't cache 206 (Partial Content) responses, since they are not complete files. This method manually adds the final file to the cache as though it was downloaded in a single request, so that future requests can use the cache. z<Skipping resume download caching: no cache controller for %sNz separate body cache not in use!ZGET)�methodr< r" )z content-ranger r rO �� F)�bodyr" �statusZpreload_content� �rbz?Cached resumed download as complete response for future use: %s) r- r6 rm Z get_adapter� isinstancer r7 �debug�cacher r Zpreparer r" �items�lowerr@ r4 �URLlib3ResponseZ controller� cache_urlZ serializer�dumps�setrT �flushr| r� Zset_body_from_io) rZ r r� r< ZadapterZsynthetic_requestZsynthetic_response_headers�key�valueZsynthetic_responser� Z metadata_blob�fr' r' r( r� sL ��� �� � ��z"Downloader._cache_resumed_downloadr� c C s< t �� }d|j� d�|d< t|� }r||d< | �|j|�S )z2Issue a HTTP range request to resume the download.zbytes=�-ZRangezIf-Range)r �copyrU r, rz r- )rZ r r� r" Z identifierr' r' r( r� = s zDownloader._http_get_resumer" �Mapping[str, str]c C sb |j }z| jj||dd�}t|� W |S ty0 } z|jd us"J �t�d|jj|� � d }~ww )NT)r" �streamz HTTP error %s while getting %s) r6 rm r+ r r �responser7 �criticalr� )rZ r- r" Z target_urlr r� r' r' r( rz K s � ���zDownloader._http_getN)rk r r. r rl r! r r^ )rq rr rs r@ r rt )r- r rs r@ r rx )r rS r r r r^ )r rS r� r r r^ )r rS r� r r r^ )r rS r� r r r )r- r r" r� r r ) re rf rg rp rw r� r} r~ r� r� r rz r' r' r' r( rj � s ( 8rj )r r r r )r r r r* )r ) r r r- r r. r r/ r r0 r r r1 )r? r@ r r@ )rE r@ rF r@ r r@ )r r r- r r r@ )?rh � __future__r � email.messagerH r: rP rA �collections.abcr r Z dataclassesr �httpr �typingr Zpip._vendor.requestsr Zpip._vendor.requests.modelsr Zpip._vendor.urllib3r r� Z pip._vendor.urllib3._collectionsr Z pip._vendor.urllib3.exceptionsr Z pip._internal.cli.progress_barsr r Zpip._internal.exceptionsr r Zpip._internal.models.indexr Zpip._internal.models.linkr Zpip._internal.network.cacher r Z pip._internal.network.sessionr r Zpip._internal.network.utilsr r r Zpip._internal.utils.miscr r r � getLoggerre r7 r) r, r> rD rM rR rS rj r' r' r' r( �<module> sD � 3
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings