File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/http.cpython-310.pyc
Back
o ;j� � 1 @ s d Z ddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlm mZ ddlZddlZddlZddlZddlZddl Zddl Zddl Zddl Zddl Zddl!Zddl"Zddl#Zddl$Zddl%Zddl&m' m(Z) ddl*Zddl+Zddl,m-Z- ddl.m/Z/ ddl0m1Z1 z ddl m2Z2m3Z3 dZ4W n7 e5y� z ddl6m2Z2m3Z3 dZ4W n! e5y� z ddl7m2Z2m3Z3 dZ4W n e5y� dZ4Y nw Y nw Y nw zddl8Z8dZ9W n e5y� dZ9Y nw zddl:Z:dZ;W n e5�y dZ;Y nw e�<e=�Z>d ej?j@� �ZAd d � ZBd&d d �ZCd&dd�ZDe1d�dddddddddddddddddddddddddddddddddddddddddeAddddddf0dd��ZEd'dd�ZF d(dd�ZGd d � ZHd d � ZId d!� ZJd"d#� ZKd)d$d%�ZLdS )*z� Utils for making various web calls. Primarily designed for REST, SOAP, webhooks and the like, but also useful for basic HTTP testing. .. versionadded:: 2015.5.0 � N)� HTTPClient)�compile_template)� jinja_filter)�CertificateError�match_hostnameTFzSalt/c C s� |s|S t �dt|�| � | dkrt�|tj �}n,| dkr.t�|�}tj |d�}|� � }n| dkr6t d��| dkr>t d��| d krFt d ��t �d t|�� |S ) z� Decompress returned HTTP content depending on the specified encoding. Currently supports identity/none, deflate, and gzip, which should cover 99%+ of the content on the internet. z7Decompressing %s byte content with compression type: %sZdeflate�gzip)�fileobjZsdchz+SDCH compression is not currently supported�brz-Brotli compression is not currently supported�compressz*LZW compression is not currently supportedz$Content size after decompression: %s) �log�trace�len�zlib� decompress� MAX_WBITS�io�BytesIOr �GzipFile�read� ValueError)�codingZpgctnt�buf�f� r �C/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/http.py�__decompressContentS s& � r c C sF |dkrt | t�s|r| �|jpd�} | S t | t�r!|r!| �d�} | S )z% Decode only the result_text �requestszutf-8)� isinstance�str�decode�encoding�bytes)� result_text�backend� decode_body�resultr r r �_decode_result_texts s � r& c C sh d|v r(t j�� }|�d|d � |�� �d�r(|�� }|r(t| t�s(| � |�} t | |||d�} | |fS )z- Decode the result_text and headers. � Content-Typeztext/�r$ r% ) �email�message� EmailMessage� add_header�get_content_type� startswith�get_content_charsetr r r r& )r" �result_headersr# r$ r% �msgZcontent_charsetr r r �_decode_result� s �r2 Z http_queryZGET�autoZlwp�minion�P c1 f s� i }2| du r,| dkrt j�tj�t jjd��} n| dkr*t j�tj�t jjd��} ni } | s4| � dd�} | � dd�}3|3rCt j j � |3�}3| � dd�}4| � dd�}5|5rXt j j � |5�}5| � d d�}6|6rgt j j � |6�}6| � d g �}7t j�| �j|7v r~d}3d}4d}5d}6d}8|3r�|4r�| d kr�t�d � d } |5r�|6r�d |5� d|6� d|3� d|4� �}8nd |3� d|4� �}8t�d| �}9|9s�t j j�� | d kr�tdu r�d|2d< t�|2d � |2S t�d �}:|:�tj � |r�t j j j � | |�n| };| du r�t!| �} |!du r�| � dd�}!|"du �r| � dd�}"|du�rt"||||| �}t#|;|+�}<t�d|<� � t�d| � � dk�ret�$tj%��ret&|t'��r\|�(� }=t&|+t)��rR|D ]}>|+D ] }?|>|?k�rNd|=|>< �qC�q?t�*dt+�,|=�� n t�*dt+�,|�� |du�rt"||||| �}@t&|@t'��r{|@}n|@�-� }|du �r�i }|du �r�g }|du �r�tj�| � d t jj.�d �}|du �r�tj�| � d t jj.�d �}|du �rt j j/j0�rtj�1|��r�t j j2�3|d ��}At j j/�4|A�}BW d � n 1 �s�w Y t&|Bt'��r�|�5|B� n!t j j2�3|d ��}At j j/�6d!|A� W d � n 1 �s w Y |D ] }C|C�7d�}Dt8|D�d"k �r"�q|Dd# �9� ||Dd$ �9� < �q| �s=|�r=| �r=|| f} |*t:k�rG|*� d%�}*|*|d&< |3�rp|4�rp� dk�rpd'|v�rpt�d(� d)|d'< d*|v�rpt8|�� |d*< | d k�r�t;�<� }E| |E_=|Ej>�5|� t�*d+|Ej>� |Ej?}F|!|E_@|8du�r�|8|8d,�|E_An | d-k�r�d}Fnd}F|du�r�|d.k�r�tBjC�D|�}FntBjC�E|�}Ftj�1|��s�|F�F� |F�4� |du �r�|du �r�i S |} d|2d/< | d k�r�i }G|&du �r�t;jGd$ d0k�r�d|Gd1< nd|Gd2< |"du�r4t&|"tH��rtj�I|"��r|"|Gd< n#t&|"t)��r.tj�I|"d$ ��r-tj�I|"d# ��r-|"|Gd< nt�d3|"� |-�r\|.�sGd4|2d< t�|2d � |2S |EjJ� | f||.|/tK�L|�fid5�|G��}Hn |EjJ� | f||d6�|G��}H|H�M� |&du �r�|(d7|HjN� d8�� |'|HjO� d9|HiS |)du �r�|H|HjOd:�S t�d;t#|HjP|+�� |HjN}I|Hj>}J|HjO}K|Hj?}LtQ|K| |0|Hd<�}K|K|2d=< �n�| d-k�r t jJ�R|;|�}Mt jJjSt jJ�T|F�g}N| �Ud>��r�|M�V� }Ot jJ�Wd#�|Nd$< tX�s�t�Yd?� n�|!du �r�t�Yd@� n�d|Ov �r�|O�7d�\}O} ndA} tZ�ZtZj[tZj\�}P|P�]|Ot^| �f� t_j`|P| t_jadB�}Qz tb|Q�c� |O� W n td�y@ }R zdC�et+�,|R��|2d< |2W Y d}R~RS d}R~Rww |"du�r�d}St&|"tH��rXtj�I|"��rW|"}Sn#t&|"t)��rstj�I|"d$ ��rrtj�I|"d# ��rr|"}Snt�d3|"� dS tft_dD��r�t_jgjh|S� }T|N�it jJjW|TdE�� n"|M�V� | |Sd$ dF�}Ut8|S�d#k�r�|Sd# |UdG< tBjjjkdoi |U��|Nd$< t jJjl|N� }V|D ] }C|M�m|C||C � �q�� fdHdI�|M_nz|V�o|M�}HW n t jjp�y� }R z dJtH|R�iW Y d}R~RS d}R~Rww |&du �s�|)du �r|H|HjOd:�S |Hjq}It'|H�r� �}J|H�s� }Ktt|K|J| |0|Hd<�\}K}J|K|2d=< �nti }G|"du�rdt&|"tH��r9tj�I|"��r8|"|GdK< n+t&|"t)��r^tj�I|"d$ ��r]tj�I|"d# ��r]|"d$ |GdK< |"d# |GdL< nt�d3|"� t&|t'��rpt j�u|�}|!�rw| |GdM< | � dNt jjvdN �}W| � dOt jjvdO �}X| � dPt jjvdP �}Yt j j jwjx�yd� t j jz�{t j j j|j}j~�}ZdQ|Zjzv }[|G�5� ||| ||!d|'|(|X|Y|,ddR� � t j jj�|GddS�}Gz|[�r�t�|WdT�nt�� }\|\j�|;fi |G��}HW nl t j j jwj��y }R z)|Rjq|2dU< tH|R�|2d< |Rj�du�rtt|Rj�j�|Rj�j>| |0dV�\|2d=< }]|2W Y d}R~RS d}R~Rw tZj�t�t�tZj�f�yM }R z | du �r2d$|2dU< tH|R�|2d< t�dW|;|2d � |2W Y d}R~RS d}R~Rww |&du �sX|)du �r^|H|Hj�d:�S |Hjq}I|Hj>}J|Hj�}Ktt|K|J| |0|Hd<�\}K}J|K|2d=< dX|Jv �r�|du�r�t�|JdX �}L|LD ]}>|F��|>� �q�nd}Lt&|Jt)��r�i }^|JD ]}C|C�7d�}Dd�|Dd#d� ��9� |^|Dd$ �9� < �q�|^}Jt�dY|I� t�*dZ|J� t�*d[|F� |J� d\d]�}_| d k�r�t�|_|K�}Kzt�*d^|K� W n t��y� }R z t�*d_|R� W Y d}R~Rnd}R~Rww |#du�r!t j j2�3|#d`�� }`|`��|K� W d � n 1 �s w Y |$du�rKtj�I|$��rKt j j2�3|$d`�� }a|a��|J� W d � n 1 �sFw Y |du�rT|F�F� |du �r�t j j/j0�r�da|Jv �r�t j j2�3|d ��&}A|J� dad�}B|Bdu�r�t j j/�6db|Bi|A� nt j j/�6d!|A� W d � n 1 �s�w Y | du �r�|I|2dU< |du �r�|J|2dc< | du �rV| ddk�r�|J� dedf�}bdg|bv �r�dg} ndh|bv �r�dh} n di|bv �r�di} ndj} dk}c| |cv�r�dl�et+�,|c��|2d< t�|2d � |2S | dhk�r t j j���|K�|2dm< n5| dgk�r g |2dm< t���|K�}d|dD ] }>|2dm �it���|>�� �qn| dik�r3t j j��t j j���|K��|2dm< nd}|%�rVt j j2�3|%d`�� }e|e��|K� W d � n 1 �sQw Y |du �r_|K|2dn< |2S )pz6 Query a resource, and decode the return data NZmasterr4 r# �tornado� proxy_host� proxy_port�proxy_username�proxy_password�no_proxyr z7Switching to request backend due to the use of proxies.zhttp://�:�@zOhttps?://((25[0-5]|2[0-4]\d|[01]?\d\d?)\.){3}(25[0-5]|2[0-4]\d|[01]?\d\d?)($|/)Fz_http.query has been set to use requests, but the requests library does not seem to be installed�error� verify_sslT�certz!Requesting URL %s using %s methodzUsing backend: %s�POSTZ XXXXXXXXXXzRequest POST Data: %sZcachedirz cookies.txtzcookies.session.p�rb�wb� � � r z http.query()z User-agentr' zVContent-Type not provided for POST request, assuming application/x-www-form-urlencodedz!application/x-www-form-urlencodedzContent-LengthzRequest Headers: %s)�http�httpsZurllib2Zmozilla�test�0Zprefetch�streamzAThe client-side certificate path that was passed is not valid: %sz1formdata_fieldname is required when formdata=True)�params�files)rL �dataz HTTP/1.0 z MESSAGE�handle)rO �bodyz"Final URL location of Response: %sr( rP rH zgmatch_hostname() not available, SSL hostname checking not available. THIS CONNECTION MAY NOT BE SECURE!z]SSL certificate verification has been explicitly disabled. THIS CONNECTION MAY NOT BE SECURE!i� )�ca_certs� cert_reqsz3The certificate was invalid. Error returned was: {}� SSLContext)�context)�host�port� cert_file�key_filec s � S �Nr r ��methodr r �<lambda> s zquery.<locals>.<lambda>�ErrorZ client_certZ client_keyrQ Z http_max_bodyZhttp_connect_timeoutZhttp_request_timeout� max_body_size) r[ �headersZ auth_usernameZ auth_passwordrP Z validate_certZallow_nonstandard_methods�streaming_callback�header_callback�connect_timeoutZrequest_timeout� raise_errorZdecompress_response)�to_str)r^ �status)r$ z$Cannot perform 'http.query': %s - %sz Set-CookiezResponse Status Code: %szResponse Headers: %szResponse Cookies: %szContent-Encoding�identityzResponse Text: %szfCannot Trace Log Response Text: %s. This may be due to incompatibilities between requests and logging.�wz set-cookie�Cookier_ r3 z content-typezapplication/json�xml�json�yaml�plain)rj ri rk rl z9Invalid decode_type specified. Valid decode types are: {}�dict�textr )��saltZconfigZ master_config�os�path�join�syspathsZ CONFIG_DIRZ minion_config�get�utilsZ stringutilsrd �urllib�parse�urlparse�hostnamer �debug�re�match�networkZ refresh_dns� HAS_REQUESTSr> �logging� getLogger�setLevel�WARNING�extr6 ZhttputilZ url_concat� get_ca_bundle�_render� sanitize_url� isEnabledForZTRACEr rm �copy�listr �pprintZpformat� splitlinesZ CACHE_DIRZmsgpackZ HAS_MSGPACK�isfilerM �fopen�load�update�dump�splitr �strip� USERAGENTr ZSession�authr_ �cookies�verifyZproxiesrG � cookiejarZMozillaCookieJarZ LWPCookieJarZsave� __version__r �exists�requestr �StringIOZraise_for_statusZ status_code�content�urlr& �RequestZ HTTPHandlerZHTTPCookieProcessorr. Zget_hostZ HTTPSHandler�HAS_MATCHHOSTNAME�warning�socket�AF_INET� SOCK_STREAM�connect�int�ssl� wrap_socket� CERT_REQUIREDr � getpeercertr �format�hasattrrS �load_cert_chain�append�client�HTTPSConnectionZ build_openerr, Z get_method�open�URLError�code�infor r2 � urlencodeZDEFAULT_MINION_OPTSZ httpclientZAsyncHTTPClientZ configure�argsZget_function_argspecZsimple_httpclientZSimpleAsyncHTTPClientZ initializerN r r Zfetch� HTTPError�responserP �herror�OSError� TimeoutError�gaierror�parse_cookie_headerZ set_cookier �UnicodeEncodeError�writerj �loads�ETZ fromstringri Zto_dictrk Z safe_load)fr� r[ rL rN Z data_fileZ header_dictZ header_listZ header_file�username�passwordr� r Z decode_typere r_ rn r� Z cookie_jarZ cookie_formatZpersist_sessionZsession_cookie_jarZ data_renderZ data_rendererZ header_renderZheader_renderer� template_dictrI Ztest_url�noderV �optsr# � ca_bundler? r@ �text_outZ headers_outZ decode_outrK r` ra rO Zagent� hide_fieldsrc ZformdataZformdata_fieldnameZformdata_filenamer$ �kwargs�retr7 r8 r9 r: r; Zhttp_proxy_urlr| Z requests_logZurl_full�log_urlZlog_data�item�fieldZ header_tpl�fh_Zsession_cookies�header�compsZsessZ sess_cookiesZ req_kwargsr% Zresult_status_coder0 r" Zresult_cookiesr� �handlersry �sockZsockwrap�excZ cert_chainrT Z cert_kwargsZopenerZmax_bodyrb �timeoutZclient_argspecZsupports_max_body_sizeZdownload_client�_Zresult_headers_dictr ZtofZhof� content_typeZ valid_decodes�itemsZdofr rZ r �query� s� 8�� �� � �� � � � � � � �� � �� � $����� � � �� � � � ����� � $�� �� ��� � � $ �� � � � � ���� �� ��� � � & ��� � � � � �� � � r� c C s� t td�rtjS | du ri } | �dd�}|dur tj�|�r |S | �ddtjj gi�}|�dg �D ]}dD ]}tj� ||�}tj�|�rJ| S q5q1d}|D ] }tj�|�r\| S qPtj j � � ritrit�� S dS )zs Return the location of the ca bundle file. See the following article: http://tinyurl.com/k7rx42a �__return_value__Nr� � file_roots�base)z cacert.pemz ca-bundle.crt)z"/etc/ssl/certs/ca-certificates.crtz /etc/pki/tls/certs/ca-bundle.crtz&/etc/pki/tls/certs/ca-bundle.trust.crtz /etc/ssl/certs/ca-bundle.crtz&/var/lib/ca-certificates/ca-bundle.pemz/etc/ssl/cert.pem)r� r� r� rt rp rq r� ro rs Z SRV_ROOT_DIRrr ru �platformZ is_windows� HAS_CERTIFI�certifi�where)r� Z opts_bundler� Z salt_rootrq Z cert_pathZ locationsr r r r� s. �� �r� c C s� |du ri }| du rt |�} | du rt�d� dS |du r#|�dd�}t�d|| � t|dddd| d� |dur�t|t�r@|g}t|t�sLt�d � dS d }|D ]L}t j � |�r�t�d || � z#t j j�|d ��}d �||�� f�}W d � n1 s|w Y W qP ty� } z t�d||� W Y d}~qPd}~ww qP|r�t�d| � z't j j�| d��}|�d � |�|� W d � W dS 1 s�w Y W dS ty� } zt�d| |� W Y d}~dS d}~ww dS dS )a. Attempt to update the CA bundle file from a URL If not specified, the local location on disk (``target``) will be auto-detected, if possible. If it is not found, then a new location on disk will be created and updated. The default ``source`` is: http://curl.haxx.se/ca/cacert.pem This is based on the information at: http://curl.haxx.se/docs/caextract.html A string or list of strings representing files to be appended to the end of the CA bundle file may also be passed through as ``merge_files``. Nz/Unable to detect location to write CA bundle toZ ca_bundle_urlz!http://curl.haxx.se/ca/cacert.pemz Attempting to download %s to %sTF)rn r r_ re r� zIA value was passed as merge_files which was not either a string or a listrD z#Queueing up %s to be appended to %s�r� z.Reading from %s caused the following error: %szAppending merge_files to %s�az,Writing to %s caused the following error: %s)r� r r> rt rz r� r r r� rp rq r� ro ru rM r� rr r r� r� ) �target�sourcer� Z merge_filesZ merge_contentrW Zfcfr� Ztfpr r r �update_ca_bundle6 s` � ������ &� ���r� c C s� |rR|du ri }|s|� dd�}tj�|i �}|� d�}|� d�}t| ||||fi |��}tjj�|�r8|�� }t |�� d�rPt |�� d�sPt |�� dd �d }|S tjj � | d �� } | �� W d � S 1 siw Y dS ) z Render a template N�rendererz jinja|yamlZrenderer_blacklistZrenderer_whitelistz#!z#!/r� rF r� )rt ro �loader�renderr ru ZstringioZ is_readabler r r. r� rM r� ) �templater� r� r� r� ZrendZ blacklistZ whitelistr� r� r r r r� � s* �� $�r� c C s d}g }| � d�D ]!}|�� }d|v r%d|vr%|� d�D ]}|�|� q q |�|� q g }i }d}|D ]Y}|� d�} | d �� | d< | d |v rp| d |v rU|�|� i }t| �dkrid�| dd � �|| d < q3d || d < q3|d u r}|�|� i }d}d�| dd � �|| d < d }q3|r�|�|� d } g } |D ]m}d } d } t|�D ]}||v r�q�|} |�|�} q�d|v r�tj � |d �|d< | D ] }||vr�d ||< q�|d d kr�d|d < |d d kr�i |d< |d d kr�d|d< |�dd � |�dd � | �tj j d| | d�|��� q�| S )z� Parse the "Set-cookie" header, and return a list of cookies. This function is here because Tornado's HTTPClient doesn't handle cookies. ) �expiresrq �domain�version�httponly�secure�commentzmax-age�samesite�;�,r� F�=r rF NT)r� rV Zport_specifiedr� Zdomain_specifiedZdomain_initial_dotrq Zpath_specifiedr� r� �discardr� Z comment_url�restrD r� r� r� r� )�name�valuer ) r� r� r� �lowerr rr r� �poprG r� Z http2timerh )r� ZattribsZmorselsr� �partr� ZcookieZ value_setZmorsel�partsZreqdr� r� r� �reqr r r r� � sp � � r� c C s� t |t�rItj�| �}|d }t|�dkr|d7 }|dd� D ]$}d}|D ]}|�d�}|r9|�d�}t||�}q%t||�}q%||7 }q |�d�S t | �S )z4 Make sure no secret fields show up in logs r rF �?N�&) r r� rv rw � splitqueryr r� �_sanitize_url_components�rstripr )r� r� Z url_compsr� �pairZurl_tmpr� Z comps_listr r r r� s r� c C sl | sdS | d � |� d��r!|� d�}| �| d � |t| |� S | d � d�}| �| d � |t| |� S )zC Recursive function to sanitize each component of the url. rD r r� z =XXXXXXXXXX&r� )r. �remover )Z comp_listr� r� r r r r s r c C sd t �� }| r |r | |f|_|r|st�d� dS |r#d|i}t|�|_|s(d|_|r0|j�|� |S )z# create a requests session z;You cannot use both ca_bundle and verify_ssl False togetherFr� ) r �sessionr� r r> r� r� r_ r� )�userr� r? r� r_ r r� r r r r + s r )NNrY )NNNN)NNTNN)M�__doc__� email.messager) r � http.clientrG Zhttp.cookiejarr r rp r� r{ r� r� � urllib.errorrv � urllib.parse�urllib.requestZxml.etree.ElementTreeZetreeZ ElementTreer� r Z salt.configro Zsalt.ext.tornado.httputilZ"salt.ext.tornado.simple_httpclientZ salt.loaderZ salt.syspathsZsalt.utils.argsZsalt.utils.dataZsalt.utils.filesZsalt.utils.jsonZsalt.utils.msgpackZsalt.utils.networkZsalt.utils.platformZsalt.utils.stringutilsZsalt.utils.urlZsalt.utils.xmlutilru Zxmlutilri Zsalt.utils.yamlZ salt.versionZsalt.ext.tornado.httpclientr Z salt.templater Zsalt.utils.decorators.jinjar r r r� � ImportErrorZ backports.ssl_match_hostnameZsalt.ext.ssl_match_hostnamer r~ r� r� r� �__name__r r� r� r� r r& r2 r� r� r� r� r� r� r r r r r r �<module> s ����� �� � u3 �Jk
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings