File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/urllib3/contrib/emscripten/__pycache__/fetch.cpython-310.pyc
Back
o ;j�[ � @ s� U d Z ddlmZ ddlZddlZddlmZ ddlmZ ddl m Z m Z ddl Z ddl mZmZmZmZ e r=ddlmZ d d lmZ d d lmZ d Zd ZdZdZdZ G dd� de �Z G dd� de �Z G dd� de �Z dRdd �Z!G d d � d ej"�Z#G d d � d �Z$G d!d"� d"ej"�Z%dSd$d%�Z&dSd&d'�Z'dSd(d)�Z(dSd*d+�Z)dZ*d,e+d-< e)� r�e'� r�e&� s�e(� s�e$� Z*ndZ*d.Z,dTd2d3�Z-d4a.dUd6d7�Z/d4a0dUd8d9�Z1dVd;d<�Z2dWd>d?�Z3dXdGdH�Z4dSdIdJ�Z5dSdKdL�Z6dYdNdO�Z7dSdPdQ�Z8dS )Za� Support for streaming http requests in emscripten. A few caveats - If your browser (or Node.js) has WebAssembly JavaScript Promise Integration enabled https://github.com/WebAssembly/js-promise-integration/blob/main/proposals/js-promise-integration/Overview.md *and* you launch pyodide using `pyodide.runPythonAsync`, this will fetch data using the JavaScript asynchronous fetch api (wrapped via `pyodide.ffi.call_sync`). In this case timeouts and streaming should just work. Otherwise, it uses a combination of XMLHttpRequest and a web-worker for streaming. This approach has several caveats: Firstly, you can't do streaming http in the main UI thread, because atomics.wait isn't allowed. Streaming only works if you're running pyodide in a web worker. Secondly, this uses an extra web worker and SharedArrayBuffer to do the asynchronous fetch operation, so it requires that you have crossOriginIsolation enabled, by serving over https (or from localhost) with the two headers below set: Cross-Origin-Opener-Policy: same-origin Cross-Origin-Embedder-Policy: require-corp You can tell if cross origin isolation is successfully enabled by looking at the global crossOriginIsolated variable in JavaScript console. If it isn't, streaming requests will fallback to XMLHttpRequest, i.e. getting the whole request into a buffer and then returning it. it shows a warning in the JavaScript console in this case. Finally, the webworker which does the streaming fetch is created on initial import, but will only be started once control is returned to javascript. Call `await wait_for_streaming_ready()` to wait for streaming fetch. NB: in this code, there are a lot of JavaScript objects. They are named js_* to make it clear what type of object they are. � )� annotationsN)�Parser)�files)� TYPE_CHECKING�Any)�JsArray� JsException�JsProxy�to_js)�Buffer� )�EmscriptenRequest)�EmscriptenResponse)z user-agent������������c s* e Zd Z d ddd�d � fd d �Z� ZS ) � _RequestErrorN��request�response�message� str | Noner �EmscriptenRequest | Noner �EmscriptenResponse | Nonec s$ || _ || _|| _t� �| j� d S �N)r r r �super�__init__)�selfr r r �� __class__� �T/opt/saltstack/salt/lib/python3.10/site-packages/urllib3/contrib/emscripten/fetch.pyr H s z_RequestError.__init__r )r r r r r r )�__name__� __module__� __qualname__r � __classcell__r! r! r r" r G s ��r c @ � e Zd ZdS )�_StreamingErrorN�r# r$ r% r! r! r! r" r( U � r( c @ r' )� _TimeoutErrorNr) r! r! r! r" r+ Y r* r+ �dict_val�dict[str, Any]�returnr c C s t | tjjd�S )N)Zdict_converter)r �jsZObjectZ fromEntries)r, r! r! r" �_obj_from_dict] � r0 c sr e Zd Zd#d d �Zd$dd�Zd%dd�Zed%dd��Zd$� fdd� Zd%dd�Z d%dd �Z d%d d �Z d&d!d"�Z � Z S )'� _ReadStream� int_bufferr � byte_buffer�timeout�float�workerr � connection_id�intr r c C sT || _ || _d| _d| _|| _|| _|dkr td| �nd | _d| _d| _ || _ d S )Nr �� TF) r3 r4 �read_pos�read_lenr8 r7 r9 r5 �is_live� _is_closedr )r r3 r4 r5 r7 r8 r r! r! r" r b s z_ReadStream.__init__r. �Nonec C � | � � d S r ��close�r r! r! r" �__del__v � z_ReadStream.__del__�boolc C � | j S r �r> rC r! r! r" � is_closedz � z_ReadStream.is_closedc C � | � � S r �rI rC r! r! r" �closed~ � z_ReadStream.closedc s` | � � rd S d| _d| _d | _d | _d| _d | _| jr)| j� t d| j i�� d| _t � � � d S )Nr TrB F)rI r< r; r3 r4 r> r r= r7 � postMessager0 r8 r rB rC r r! r" rB � s z_ReadStream.closec C � dS �NTr! rC r! r! r" �readable� � z_ReadStream.readablec C rP �NFr! rC r! r! r" �writable� rS z_ReadStream.writablec C rP rT r! rC r! r! r" �seekable� rS z_ReadStream.seekable�byte_objr c C s< | j s td| jd d��| jdkrotj�| j dt� | j� t d| j i�� tj� | j dt| j �dkr3t�| j d }|dkrC|| _d| _n,|tkrf| j d }tj�� }|�| j�d|��}td|� �| jd d��d| _| �� dS t| jtt|���}| j�| j| j| �� � }|t|�d|�< | j|8 _| j|7 _|S ) Nz,No buffer for stream in _ReadStream.readintor r ZgetMorez timed-outr �Exception thrown in fetch: F) r3 r( r r< r/ �Atomics�store� ERROR_TIMEOUTr7 rO r0 r8 �waitr5 r+ r; �ERROR_EXCEPTION� TextDecoder�new�decoder4 �slicer= rB �min�len� memoryview�subarray�to_py)r rW Zdata_len� string_len� js_decoder�json_str� ret_lengthre r! r! r" �readinto� sN � � � ��z_ReadStream.readinto) r3 r r4 r r5 r6 r7 r r8 r9 r r �r. r? �r. rF �rW r r. r9 )r# r$ r% r rD rI �propertyrM rB rR rU rV rk r& r! r! r r" r2 a s r2 c @ s e Zd Zd dd�Zd dd �Zd S ) �_StreamingFetcherr. r? c sz d� _ tt��d�jdd�}tj�t|gdd�t ddi��}d� fd d� }tj � |�}tj j �|�� _tj j�|�� _d S )NFzemscripten_fetch_worker.jszutf-8)�encoding)Zcreate_pyproxies�typezapplication/javascript� js_resolve_fnr � js_reject_fnr. r? c s2 d ��fdd� }d � fdd� }|�j _|�j _d S ) N�er r. r? c s d�_ � | � d S rQ )�streaming_ready�ru )rs r r! r" �onMsg� s zC_StreamingFetcher.__init__.<locals>.promise_resolver.<locals>.onMsgc s � | � d S r r! rw )rt r! r" �onErr� rE zC_StreamingFetcher.__init__.<locals>.promise_resolver.<locals>.onErr)ru r r. r? )� js_workerZ onmessage�onerror)rs rt rx ry rC )rt rs r" �promise_resolver� s z4_StreamingFetcher.__init__.<locals>.promise_resolver)rs r rt r r. r? )rv r � __package__�joinpath� read_textr/ �Blobr_ r r0 �URLZcreateObjectURLZ globalThis�Workerrz ZPromise�js_worker_ready_promise)r Zstreaming_worker_codeZ js_data_blobr| Z js_data_urlr! rC r" r � s �� � z_StreamingFetcher.__init__r r r c C s� dd� |j �� D �}|j}|t|�|jd�}|jdkr"td|j �nd }tj� d�}tj � |�}tj � |d�}tj � |dt� tj �|d� tj� |jtj�j} | j�t|| |d��� tj �|dt|� |d tkrrtd |d d ��|d tkr�|d } tj� � } | �|� d| ��} t � | �} t || d | d t |||j| j| d |�d�S |d t!kr�|d } tj� � } | �|� d| ��} t"d| � �|d d ��t"d|d � �|d d ��)Nc S � i | ] \}}|t vr||�qS r! ��HEADERS_TO_IGNORE��.0�k�vr! r! r" � <dictcomp>� s z*_StreamingFetcher.send.<locals>.<dictcomp>)�headers�body�methodr r: i � )�buffer�urlZ fetchParamsz'Timeout connecting to streaming requestr r �statusr� Z connectionID)r � status_coder� r� rX z%Unknown status from worker in fetch: )#r� �itemsr� r r� r5 r9 r/ ZSharedArrayBufferr_ Z Int32ArrayZ Uint8ArrayrY rZ r[ �notifyr� r� �locationZhrefrz rO r0 r\ r+ �SUCCESS_HEADERr^ r` ra �json�loadsr r2 r] r( )r r r� r� � fetch_datar5 Zjs_shared_bufferZ js_int_bufferZjs_byte_bufferZjs_absolute_urlrg rh ri Z response_objr! r! r" �send� sr � ��� � �� � �z_StreamingFetcher.sendNrl �r r r. r )r# r$ r% r r� r! r! r! r" rp � s rp c s� e Zd ZdZd%d d �Zd&dd�Zd'dd�Zed'dd��Zd&� fdd� Z d'dd�Z d'dd�Z d'd d �Z d'd d �Z d(d#d$�Z� ZS ))�_JSPIReadStreamaF A read stream that uses pyodide.ffi.run_sync to read from a JavaScript fetch response. This requires support for WebAssembly JavaScript Promise Integration in the containing browser, and for pyodide to be launched via runPythonAsync. :param js_read_stream: The JavaScript stream reader :param timeout: Timeout in seconds :param request: The request we're handling :param response: The response this stream relates to :param js_abort_controller: A JavaScript AbortController object, used for timeouts �js_read_streamr r5 r6 r r r r �js_abort_controllerc C s: || _ || _d| _d| _|| _|| _d | _d| _|| _d S )NFr ) r� r5 r> �_is_doner r �current_buffer�current_buffer_posr� )r r� r5 r r r� r! r! r" r D s z_JSPIReadStream.__init__r. r? c C r@ r rA rC r! r! r" rD V rE z_JSPIReadStream.__del__rF c C rG r rH rC r! r! r" rI Z rJ z_JSPIReadStream.is_closedc C rK r rL rC r! r! r" rM ^ rN z_JSPIReadStream.closedc sN | � � rd S d| _d| _| j�� d | _d| _d| _d | _d | _t � � � d S )Nr T) rI r< r; r� �cancelr> r� r r r rB rC r r! r" rB b s z_JSPIReadStream.closec C rP rQ r! rC r! r! r" rR o rS z_JSPIReadStream.readablec C rP rT r! rC r! r! r" rU r rS z_JSPIReadStream.writablec C rP rT r! rC r! r! r" rV u rS z_JSPIReadStream.seekablec C sF t | j�� | j| j| j| jd�}|jrd| _dS |j � � | _ d| _ dS )Nr TFr ) �_run_sync_with_timeoutr� �readr5 r� r r �doner� �valuerf r� r� )r Z result_jsr! r! r" �_get_next_bufferx s � z _JSPIReadStream._get_next_bufferrW r r9 c C s� | j d u r| �� r| j d u r| �� dS tt|�t| j �| j �}| j | j| j| � |d|�< | j|7 _| jt| j �krBd | _ |S )Nr )r� r� rB rb rc r� )r rW rj r! r! r" rk � s � �z_JSPIReadStream.readinto) r� r r5 r6 r r r r r� r rl rm rn )r# r$ r% �__doc__r rD rI ro rM rB rR rU rV r� rk r& r! r! r r" r� . s r� rF c C s t td�ot td�otjtjkS )N�windowr )�hasattrr/ r r� r! r! r! r" �is_in_browser_main_thread� s r� c C s t td�otjS )N�crossOriginIsolated)r� r/ r� r! r! r! r" �is_cross_origin_isolated� r1 r� c C s2 t td�ot tjd�ot tjjd�otjjjdkS )N�process�release�name�node�r� r/ r� r� r� r! r! r! r" � is_in_node� s � � �r� c C s t td�o t td�S )Nr� r� )r� r/ r! r! r! r" �is_worker_available� s r� z_StreamingFetcher | None�_fetcherz�urllib3 only works in Node.js with pyodide.runPythonAsync and requires the flag --experimental-wasm-stack-switching in versions of node <24.r r r c C sB t � rt| d�S t� rtt| d d��tr t� r t�| �S t� d S )NT�r r r ) �has_jspi�send_jspi_requestr� r �NODE_JSPI_ERRORr� rv r� �_show_streaming_warning�r r! r! r" �send_streaming_request� s � r� Fr? c C s t sda d} tj�| � d S d S )NTz8Warning: Timeout is not available on main browser thread)�_SHOWN_TIMEOUT_WARNINGr/ �console�warn)r r! r! r" �_show_timeout_warning� s �r� c C sf t s1da d} t� s | d7 } t� r| d7 } t� s| d7 } t� du r$| d7 } dd lm} |�| � d S d S ) NTz%Can't stream HTTP requests because: z$ Page is not cross-origin isolated z+ Python is running in main browser thread z> Worker or Blob classes are not available in this environment.Fz� Streaming fetch worker isn't ready. If you want to be sure that streaming fetch is working, you need to call: 'await urllib3.contrib.emscripten.fetch.wait_for_streaming_ready()`r )r� )�_SHOWN_STREAMING_WARNINGr� r� r� rv r/ r� r� )r r� r! r! r" r� � s �r� r c C sX t � rt| d�S t� rtt| d d��zntj�� }t� s*d|_ | j r)t | j d �|_ n |� d� | j r5t � |�| j| jd� | j�� D ]\}}|�� tvrS|�||� qC|�t| j�� tt� �|� � ��}t� sq|j � � � � }n|j � d�}t!|j"||| d�W S t#y� } z |j$dkr�t%|j&| d ��|j$d kr�t|j&| d ��t|j&| d ��d }~ww ) NFr� Z arraybufferr: z text/plain; charset=ISO-8859-15z ISO-8859-15�r� r� r� r � TimeoutErrorr� Z NetworkError)'r� r� r� r r� r/ ZXMLHttpRequestr_ r� Z responseTyper5 r9 ZoverrideMimeTyper� �openr� r� r� r� �lowerr� ZsetRequestHeaderr� r r� �dictr �parsestrZgetAllResponseHeadersr rf �tobytes�encoder r� r r� r+ r )r Zjs_xhrr� r� r� r� �errr! r! r" � send_request� sN � � � � ��r� � streamingc C s | j }tj�� }dd� | j�� D �}| j}|t|�| j|j d�}t � r'd|d< t� | j t |��}t|||| dd�}i }|j�� } | �� } t| d d �rLnt| jd �|t| jd �< qA|j} d } t| |d | d�} |r}|jdur||j�� }t||| | |�} n t|�� ||| | d��� } | | _| S )a7 Send a request using WebAssembly JavaScript Promise Integration to wrap the asynchronous JavaScript fetch api (experimental). :param request: Request to send :param streaming: Whether to stream the response :return: The response object :rtype: EmscriptenResponse c S r� r! r� r� r! r! r" r� 6 s z%send_jspi_request.<locals>.<dictcomp>)r� r� r� �signalZmanualZredirectNr Tr� Fr r � r� )r5 r/ ZAbortControllerr_ r� r� r� r r� r� � _is_node_jsZfetchr� r0 r� �entries�next�getattr�strr� r� r Z getReaderr� Z arrayBufferrf )r r� r5 r� r� Zreq_bodyr� Zfetcher_promise_jsZ response_jsZ header_iterZ iter_value_jsr� r� r Zbody_stream_jsr! r! r" r� $ sd � � �� ����r� �promiser r5 r6 r� r r c C s� d}|dkrt �|j�|�t|d ��}z7zddlm} || �W W |dur+t �|� S S tyK } z|j dkr?t d||d��t |j ||d��d}~ww |durVt �|� w w )ak Await a JavaScript promise synchronously with a timeout which is implemented via the AbortController :param promise: Javascript promise to await :param timeout: Timeout in seconds :param js_abort_controller: A JavaScript AbortController object, used on timeout :param request: The request being handled :param response: The response being handled (if it exists yet) :raises _TimeoutError: If the request times out :raises _RequestError: If the request raises a JavaScript exception :return: The result of awaiting the promise. Nr r: )�run_syncZ AbortErrorzRequest timed outr� ) r/ Z setTimeout�abort�bindr9 � pyodide.ffir� Z clearTimeoutr r� r+ r r )r� r5 r� r r Ztimer_idr� r� r! r! r" r� r s, � �� ��� �r� c C s2 zddl m} m} t| � �W S ty Y dS w )a Return true if jspi can be used. This requires both browser support and also WebAssembly to be in the correct state - i.e. that the javascript call into python was async not sync. :return: True if jspi can be used. :rtype: bool r �� can_run_syncr� F)r� r� r� rF � ImportErrorr� r! r! r" r� � s �r� c C s$ t td�ot tjd�otjjjdkS )z_ Check if we are in Node.js. :return: True if we are in Node.js. :rtype: bool r� r� r� r� r! r! r! r" r� � s � �r� � bool | Nonec C s t rt jS d S r )r� rv r! r! r! r" rv � s rv c � s �t r t jI d H dS dS )NTF)r� r� r! r! r! r" �wait_for_streaming_ready� s � r� )r, r- r. r rm )r r r. r rl r� )r r r� rF r. r ) r� r r5 r6 r� r r r r r r. r )r. r� )9r� � __future__r �ior� � email.parserr Zimportlib.resourcesr �typingr r r/ r� r r r r Ztyping_extensionsr r r r r r� r� Z SUCCESS_EOFr[ r] � Exceptionr r( r+ r0 � RawIOBaser2 rp r� r� r� r� r� r� �__annotations__r� r� r� r� r� r� r� r� r� r� r� rv r� r! r! r! r" �<module> sl $ gf l ���� 1 N 6
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings