File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/libcloud/storage/drivers/__pycache__/backblaze_b2.cpython-310.pyc
Back
o ;jL � @ s d Z ddlZddlZddlmZmZmZmZ ddlm Z m Z ddl m Z m Z ddlmZmZ ddlmZmZmZ ddlmZ dd lmZmZ dd lmZ zddl Z W n e y_ ddl Z Y nw g d �Z d Z d Z!G dd� de �Z"G dd� de �Z#G dd� de �Z$G dd� de�Z%dS )z" Driver for Backblaze B2 service. � N)�b�next�httplib�urlparse)� JsonResponse�ConnectionUserAndKey)�read_in_chunks�exhaust_iterator)� LibcloudError�InvalidCredsError)�Object� Container� StorageDriver)�sanitize_object_name)�ObjectDoesNotExistError�ContainerDoesNotExistError)�Provider)�BackblazeB2StorageDriver�BackblazeB2Connection�BackblazeB2AuthConnectionzapi.backblaze.comz /b2api/v1/c @ s e Zd Zdd� Zdd� ZdS )�BackblazeB2Responsec C s | j tjtjtjfv S �N)�statusr �OK�CREATED�ACCEPTED)�self� r �Y/opt/saltstack/salt/lib/python3.10/site-packages/libcloud/storage/drivers/backblaze_b2.py�success1 s zBackblazeB2Response.successc C s. t | j�}| �� }|tjkrt|d ��| jS )N�message)�intr Z parse_bodyr � UNAUTHORIZEDr �body)r r r# r r r � parse_error4 s z BackblazeB2Response.parse_errorN)�__name__� __module__� __qualname__r r$ r r r r r 0 s r c sD e Zd ZeZdZeZ� fdd�Zd dd�Z dd� Z d d d �Z � Z S ) r Tc s: t � j|i |�� d | _d | _d | _d | _d | _d | _d S r )�super�__init__� account_id�api_url�api_host� download_url� download_host� auth_token�r �args�kwargs�� __class__r r r) C s z"BackblazeB2AuthConnection.__init__Fc C s� | j |d�s| S i }d}t�td�| j| j���}d|�d� |d< td }| j ||dd�}|j t j kr=| j |jd � | S td t|j� ��) z� :param force: Force authentication if if we have already obtained the token. :type force: ``bool`` )�forceZb2_authorize_accountz{}:{}zBasic %szutf-8� Authorization�GET)�action�headers�method��datazFailed to authenticate: %s)�_is_authentication_needed�base64� b64encoder �formatZuser_id�key�decode�API_PATH�requestr r r �_parse_and_set_auth_info�object� Exception�str)r r5 r9 r8 Zauth_b64�respr r r � authenticateN s �z&BackblazeB2AuthConnection.authenticatec C sX i }|d | _ |d | _|d | _|d | _t�| j�}|j| _t�| j�}|j| _|S )N� accountIdZapiUrlZ downloadUrl�authorizationToken)r* r+ r- r/ r �netlocr, r. )r r< �resultZparsed_api_urlZparsed_download_urlr r r rE g s z2BackblazeB2AuthConnection._parse_and_set_auth_infoc C s | j r|rdS dS )NTF)r/ )r r5 r r r r= v s z3BackblazeB2AuthConnection._is_authentication_needed)F) r% r& r' � AUTH_API_HOST�host�securer � responseClsr) rJ rE r= � __classcell__r r r3 r r > s r c sv e Zd ZdZdZeZeZ� fdd�Z ddd�Z dd� Z dd d �Z d� fd d� Z dd� Z� ZS )r NTc s( t � j|i |�� | j|i |��| _d S r )r( r) �authCls� _auth_connr0 r3 r r r) � s z BackblazeB2Connection.__init__c C s> | j �� }| �|j� d| }d}d}| j|||||d�}|S )Nz/file/r7 T)� auth_connr8 �paramsr: �raw)rU rJ � _set_hostr. �_request)r r8 rW rV r: rX �responser r r �download_request� s �z&BackblazeB2Connection.download_requestc C s< | j �� }| j|d� d}d}| j||d |||||d�} | S )N�rP �POSTF)rV r8 rW r< r9 r: rX r/ )rU rJ rY rZ ) r r8 r9 � upload_hostr/ r< rV r: rX r[ r r r �upload_request� s � z$BackblazeB2Connection.upload_requestr7 Fc C s� |pi }|pi }| j �� }| j|jd� |s |r d|d< |r5|dkr(|j|d< n |dkr5|p/i }|j|d< t| }|r@t�|�}| j| j ||||||d�} | S )Nr] zapplication/json� Content-Typer7 rK r^ )rV r8 rW r< r: r9 rX ) rU rJ rY r, r* rC �json�dumpsrZ ) r r8 rW r< r9 r: rX �include_account_idrV r[ r r r rD � s2 � z BackblazeB2Connection.requestc sD |pi }|pi }|s| j j}d| |d< t� j||||||d�} | S )Nz%sr6 )r8 rW r< r: r9 rX )rU r/ r( rD ) r rV r8 rW r< r9 r: rX r/ r[ r3 r r rZ � s � z BackblazeB2Connection._requestc C s || _ d| | j_ dS )z� Dynamically set host which will be used for the following HTTP requests. NOTE: This is needed because Backblaze uses different hosts for API, download and upload requests. z https://%sN)rP � connection)r rP r r r rY s z BackblazeB2Connection._set_hostr )NNNr7 FF)NNNr7 FN)r% r& r' rP rQ r rR r rT r) r\ r` rD rZ rY rS r r r3 r r } s. �6� r c @ s� e Zd ZeZdZdZejZ dZ dZ dd� Z d4dd �Z d d � Zd d � Zd5dd�Zdd� Z d6dd�Zd7dd�Z d8dd�Zd4dd�Zd d � Zd d � Zd d!� Z d9d"d#�Zd$d%� Zd&d'� Zd(d)� Z d*d+� Z d,d-� Z d7d.d/�Z d0d1� Z d8d2d3�Z!dS ):r z Backblaze B2z https://www.backblaze.com/b2/�sha1Fc C s$ | j jdddd�}| j|jd�}|S )NZb2_list_bucketsr7 T)r8 r: rd r; )re rD �_to_containersrF )r rI � containersr r r �iterate_containers s �z+BackblazeB2StorageDriver.iterate_containersNc C sH | � ||�}d|jd i}| jjdd|d�}| j|j|d�}| �||�S )aO Return a generator of objects for the given container. :param container: Container instance :type container: :class:`Container` :param prefix: Filter objects starting with a prefix. Filtering is performed client-side. :type prefix: ``str`` :param ex_prefix: (Deprecated.) Filter objects starting with a prefix. Filtering is performed client-side. :type ex_prefix: ``str`` :return: A generator of Object instances. :rtype: ``generator`` of :class:`Object` �bucketId�idZb2_list_file_namesr7 �r8 r: rW �r< � container)Z_normalize_prefix_argument�extrare rD � _to_objectsrF Z _filter_listed_container_objects)r rn �prefixZ ex_prefixrW rI �objectsr r r �iterate_container_objects s z2BackblazeB2StorageDriver.iterate_container_objectsc s6 | � � }t� fdd�|D �d �}|r|S td | � d��)Nc 3 � � | ] }|j � kr|V qd S r ��name)�.0�c��container_namer r � <genexpr>; � � z9BackblazeB2StorageDriver.get_container.<locals>.<genexpr>)�value�driverrz )ri r r )r rz rh rn r ry r � get_container9 s z&BackblazeB2StorageDriver.get_containerc sJ | j |d�}| j|d�}t� fdd�|D �d �}|d ur |S td | � d��)Nry )rn c 3 rt r ru )rw �obj�� object_namer r r{ F r| z6BackblazeB2StorageDriver.get_object.<locals>.<genexpr>)r} r~ r� )r rs r r )r rz r� rn rr r� r r� r � get_objectB s z#BackblazeB2StorageDriver.get_object� allPrivatec C s: i }||d< ||d< | j jd|ddd�}| j|jd�}|S )N� bucketName� bucketTypeZb2_create_bucketr^ T�r8 r< r: rd ��item)re rD � _to_containerrF )r rz Zex_typer< rI rn r r r �create_containerM s �z)BackblazeB2StorageDriver.create_containerc C s2 i }|j d |d< | jjd|ddd�}|jtjkS )Nrk rj Zb2_delete_bucketr^ Tr� )ro re rD r r r )r rn r< rI r r r �delete_containerY s � z)BackblazeB2StorageDriver.delete_containerTc C sD | j |j|d�}| jj|d�}| j|| j|||j|||d�tjd�S )N�rn r� �r8 )r� r[ �destination_path�overwrite_existing�delete_on_failure�r� �callbackr[ Zcallback_kwargsZsuccess_status_code) �_get_object_download_pathrn re r\ � _get_objectZ _save_objectr[ r r )r r� r� r� r� r8 r[ r r r �download_objectc s ��z(BackblazeB2StorageDriver.download_objectc C s@ | j |j|d�}| jj|d�}| j|t||�|�|d�tjd�S )Nr� r� )�iterator� chunk_sizer� ) r� rn re r\ r� r Z iter_contentr r )r r� r� r8 r[ r r r �download_object_as_streamz s ��z2BackblazeB2StorageDriver.download_object_as_streamc C s` t |d��}t|�}t|d�}t|d�} W d � n1 s w Y | j| |||||d�} | S )zq Upload an object. Note: This will override file with a same name if it already exists. �rb�r� N)r< rn r� ro � verify_hashr9 )�open�iterr r �_perform_upload) r Z file_pathrn r� ro r� r9 �fpr� r< r� r r r � upload_object� s �� z&BackblazeB2StorageDriver.upload_objectc C s, t |d�}t|d�}| j|||||d�}|S )z� Upload an object. Note: Backblaze does not yet support uploading via stream, so this calls upload_object internally requiring the object data to be loaded into memory at once r� )r< rn r� ro r9 )r r r� )r r� rn r� ro r9 r< r� r r r �upload_object_via_stream� s �z1BackblazeB2StorageDriver.upload_object_via_streamc C s: i }|j |d< |jd |d< | jjd|dd�}|jtjkS )N�fileName�fileIdZb2_delete_file_versionr^ �r8 r< r: )rv ro re rD r r r )r r� r< rI r r r � delete_object� s z&BackblazeB2StorageDriver.delete_objectc C s2 i }||d< | j jdd|d�}| j|jd d�}|S )Nr� Zb2_get_file_infor7 rl �r� rn �re rD � _to_objectrF )r Z object_idrW rI r� r r r � ex_get_object� s z&BackblazeB2StorageDriver.ex_get_objectc C s: i }||d< ||d< | j jd|dd�}| j|jd d�}|S )Nrj r� Z b2_hide_filer^ r� r� r� )r � container_idr� r< rI r� r r r �ex_hide_object� s z'BackblazeB2StorageDriver.ex_hide_objectc C sV i }||d< |r ||d< |r||d< |r||d< | j jd|dd�}| j|jd d�}|S ) Nrj Z startFileNameZ startFileIdZ maxFileCountZb2_list_file_versionsr7 )r8 rW r: rm )re rD rp rF )r r� Zex_start_file_nameZex_start_file_idZex_max_file_countrW rI rr r r r �ex_list_object_versions� s z0BackblazeB2StorageDriver.ex_list_object_versionsc C s$ i }||d< | j jdd|d�}|jS )z Retrieve information used for uploading files (upload url, auth token, etc). :rype: ``dict`` rj Zb2_get_upload_urlr7 rl )re rD rF )r r� rW r[ r r r �ex_get_upload_data� s z+BackblazeB2StorageDriver.ex_get_upload_datac C s | j |d�}|d }|S )zN Retrieve URL used for file uploads. :rtype: ``str`` �r� � uploadUrl)r� )r r� rN Z upload_urlr r r �ex_get_upload_url s z*BackblazeB2StorageDriver.ex_get_upload_urlc C s, g }|d D ] }| j |d�}|�|� q|S )NZbucketsr� )r� �append)r r< rN r� rn r r r rg s z'BackblazeB2StorageDriver._to_containersc C s2 i }|d |d< |d |d< t |d || d�}|S )Nrj rk r� r� )rv ro r~ )r )r r� ro rn r r r r� s z&BackblazeB2StorageDriver._to_containerc C s. g }|d D ]}| j ||d�}|�|� q|S )N�filesr� )r� r� )r r< rn rN r� r� r r r rp s z$BackblazeB2StorageDriver._to_objectsc C sj i }|d |d< |� dd �|d< |� d|� dd ��}|� dd �}|� di �}t|d |||||| d�}|S ) Nr� ZuploadTimestamp�sizeZ contentLengthZ contentSha1ZfileInfor� )rv r� �hashro � meta_datarn r~ )�getr )r r� rn ro r� r� r� r� r r r r� & s � z#BackblazeB2StorageDriver._to_objectc C s |j d |j }|S )zW Return a path used in the download requests. :rtype: ``str`` �/ru )r rn r� �pathr r r r� 9 s z2BackblazeB2StorageDriver._get_object_download_pathc C s t |t�r t|�}t|�}|pi }|�dd�}|�di �}|p i }||d< ||d< t�� } | �t|�� | � � |d< |� � D ] \} } | |d| < q>| j |j d d �} | d } t � | d �}|j}|j}| jj|||| |d �}|jtjkr~| j|j|d �}|S |j�� }td�|j|�| d��)N� content_typez b2/x-autor� zX-Bz-File-Namera zX-Bz-Content-Sha1z X-Bz-Info-%srk r� rL r� )r8 r9 r_ r/ r< r� z&Upload failed. status_code={}, body={})r~ )� isinstancerH � bytearrayr r� �hashlibrf �updater � hexdigest�itemsr� ro r rM r� re r` r r r r� rF r[ �readr r@ )r r< rn r� ro r� r9 r� r� rf rA r} Z upload_dataZ upload_tokenZ parsed_urlr_ Z request_pathr[ r� r# r r r r� C sD � �z(BackblazeB2StorageDriver._perform_upload)NN)r� )FTr )NTN)NNN)"r% r& r' r Z connectionClsrv Zwebsiter Z BACKBLAZE_B2�typeZ hash_typeZsupports_chunked_encodingri rs r r� r� r� r� r� r� r� r� r� r� r� r� r� rg r� rp r� r� r� r r r r r sJ � � " � �r )&�__doc__r> r� Zlibcloud.utils.py3r r r r Zlibcloud.common.baser r Zlibcloud.utils.filesr r Zlibcloud.common.typesr r Zlibcloud.storage.baser r r Zlibcloud.utils.escaper Zlibcloud.storage.typesr r Zlibcloud.storage.providersr Z simplejsonrb � ImportError�__all__rO rC r r r r r r r r �<module> s0 �?
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings