File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/files.cpython-310.pyc
Back
o ;jZ� � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl ZddlZddlZddlZddlZddlmZmZmZ ddlmZ zddlZdZW n e yi dZY nw e ed�rsej Z nddl Z G dd � d �Z d d� Z e�!e"�Z#d Z$d Z%d e% Z&dZ'ddddddd�Z(dd� e(�)� D �Z*dd� Z+dd� Z,d d � Z-d d � Z.d\d!d"�Z/d#d$� Z0d]d%d&�Z1ej2d^d)d*��Z3e d^d+d,��Z4d-d.� Z5ej2d/d0� �Z6d1d2� Z7ej2d3d4� �Z8ej2d5d6� �Z9d_d7d8�Z:d9d:� Z;d;d<� Z<ed=�d>d=� �Z=d`d?d@�Z>dAdB� Z?d]dCdD�Z@edE�dadGdH��ZAedI�dJdK� �ZBdLdM� ZCedN�dOdN� �ZDdPdQ� ZEdRdS� ZFdTdU� ZGdVdW� ZHd]dXdY�ZIdZd[� ZJdS )bz" Functions for working with files � N)�CommandExecutionError� FileLockError� MinionError)� jinja_filterTF�asynccontextmanagerc @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) � _AsyncGeneratorContextManagerzA Async context manager backport for Python < 3.7 c C s ||i |��| _ d S �N)�_gen)�self�func�args�kwargs� r �D/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/files.py�__init__. s z&_AsyncGeneratorContextManager.__init__c � s. �z | j �� I d H W S ty td�d �w )Nzgenerator didn't yield)r � __anext__�StopAsyncIteration� RuntimeError)r r r r � __aenter__1 s � �z(_AsyncGeneratorContextManager.__aenter__c � s� �|d u r z | j �� I d H W td�� ty Y d S w |d u r$|� }z| j �|||�I d H W d S ty< Y dS tyd } z ||u rNW Y d }~dS t|t�r_|j|u r_W Y d }~dS � d }~w ty{ } z ||u rvW Y d }~dS � d }~ww )Nzgenerator didn't stopTF)r r r r �athrow� isinstance� __cause__� Exception)r �exc_type� exc_value� traceback�excr r r � __aexit__7 s: � �� � ���z'_AsyncGeneratorContextManager.__aexit__N)�__name__� __module__� __qualname__�__doc__r r r r r r r r ) s r c s t �� �� fdd��}|S )z8 asynccontextmanager decorator backport c s t � | |�S r )r )r r �r r r �helperY s z#asynccontextmanager.<locals>.helper)� functools�wraps)r r# r r" r r T s )� �file)�http�https�ftpZswiftZs3)�saltr' � __salt.tmp.� �` �@ �8 �( � )�sha512�sha384�sha256�sha224�sha1�md5c C s i | ]\}}||�qS r r )�.0�x�yr r r � <dictcomp>o s r< c C sH zt | � W dS ty# } ztjd|tjd� W Y d}~dS d}~ww )z Remove temporary files z+Exception while removing temp directory: %s)Zexc_info_on_loglevelN)�rm_rfr �log�error�logging�DEBUG)�tmpr r r r � __clean_tmpr s ���rC c C sJ | � � } dD ] }| �d| �r dS qdD ] }| �d| �r"| S qdS )zH Guess an archive type (tar, zip, or rar) by its file extension ) �tarztar.gzZtgzztar.bz2Ztbz2Ztbzztar.xzZtxzztar.lzmaZtlz�.rD )�zipZrarN)�lower�endswith)�nameZendingr r r �guess_archive_type� s ��rJ c O sP d|vrd|d< |� dd�}tj| i |��\}}|du r ||fS t�|� ~|S )a Helper function which does exactly what ``tempfile.mkstemp()`` does but accepts another argument, ``close_fd``, which, by default, is true and closes the fd before returning the file path. Something commonly done throughout Salt's code. �prefixr, �close_fdTF)�pop�tempfile�mkstemp�os�close)r r rL Zfd_Zf_pathr r r rO � s rO c C s� t jj�| �D ];\}}}|�| d��tj�}tj�||�}tj� |�s(t� |� |D ]}tj�| ||�}tj�||�} t � || � q*qdS )z� Recursively copy the source directory to the destination, leaving files with the source does not explicitly overwrite. (identical to cp -r on a unix machine) r& N) r+ �utils�pathZos_walk�replace�lstriprP �sep�join�exists�makedirs�shutil�copyfile) �source�dest�root�_�filesZpath_from_sourceZtarget_directoryrI Zfile_path_from_source� target_pathr r r �recursive_copy� s ��rb r& c C s� t j�| �s td| � ���t j�t j�|��s td|� ���t j�|�}t j�t j�|��}t||d�}t � | |� d}|rEt j� |d�}|dksO|dkrZ|rZt j� |�rZt ||� |dksd|dkre|re d}tjj�� s~zt �|�}W n ty} Y nw zt �||� W n ty� t|� � w |dur�t �||j|j� t �||j� tjj�d �} | r�d } z d d l m } | � � } W n t t fy� Y nw | d kr�t!t j"d��} | |g} t#j$| | | d� W d � n1 s�w Y t j�|�r�t|� dS dS )zj Copy files from a source to a destination in an atomic way, and if specified cache the file. z%[Errno 2] No such file or directory: )rK �dirr& Z file_backupZminionZbothZmasterNZ restoreconFr )�selinuxZ Enforcing�w)�stdout�stderr)%rP rS �isfile�OSError�isdir�dirname�basename�abspathrO rZ r[ rW rX � backup_minionr+ rR �platform� is_windows�stat�mover rC �chown�st_uid�st_gid�chmod�st_mode�whichZ salt.modulesrd Z getenforce� ImportErrorr �fopen�devnull� subprocess�call)r\ r] Z backup_modeZcachedir�bname�dname�tgt�bkroot�fstatZrcon�policyrd Zdev_null�cmdr r r r[ � sb � � � � �r[ c C s� z t �| |� W dS tyT } z?|jtjkr� zt �|� W n# tyB } z|jtjkr8td|� d|j� ���W Y d}~nd}~ww t �| |� W Y d}~dS d}~ww )z� On Windows, os.rename() will fail with a WindowsError exception if a file exists at the destination path. This function checks for this error and if found, it deletes the destination path first. zError: Unable to remove �: N) rP �renameri �errno�EEXIST�remove�ENOENTr �strerror)�src�dstr r r r r� s �����r� c C sv |dur t |t�r |f}nd}| j|v rdS | jtjkr#t|� d���| jtjkr0td|� ���td�| j|| j���)z� Common code for raising exceptions when reading a file fails The ignore argument can be an iterable of integer error codes (or a single integer error code) that should be ignored. Nr z does not existz Permission denied reading from z(Error {} encountered reading from {}: {})r �intr� r� r ZEACCES�formatr� )r rS �ignorer r r �process_read_exception s � ��r� � 皙�����?c # sF � t | t�s td��|du r| d }� du rt�� � d}d� fdd� }z�z�zt�|�}W n# tyO } z|jtjkrE|d� |j||j �� W Y d}~nd}~ww t� |j �s^|d|� d �� tj tjB tjB } t�� � |k r�zt�|| �} W n/ ty� } z#|jtjkr�|d � |j||j �� t�d ||� t�|� W Y d}~n'd}~ww t�| d �� W d � n1 s�w Y t�d |� d}dV nt�� � |k so|d� ||�� W n# ty� � ty� } z|d|� d|� �� W Y d}~nd}~ww W |�rt�|� t�d| |� dS dS |�r"t�|� t�d| |� w w )�J Obtain a write lock. If one exists, wait for it to release first �path must be a stringN�.wFc � t | � d���z' Raise a FileLockError �� time_start�r ��msgZracer� r r � _raise_error= � z wait_lock.<locals>._raise_error�.Error {} encountered checking file lock {}: {}�lock_fn � exists and is not a file�/Error {} encountered obtaining file lock {}: {}�(Lock file %s exists, sleeping %f secondsre �Write lock %s obtainedT�DTimeout of {} seconds exceeded waiting for lock_fn {} to be released�&Error encountered obtaining file lock r� � Write lock for %s (%s) released�F)r �strr �timerP rq ri r� r� r� r� �S_ISREGrw �O_CREAT�O_EXCL�O_WRONLY�openr� r> �trace�sleep�fdopenr r� � rS Zlock_fn�timeoutr� r� Z obtained_lockr� Z lock_statr Z open_flagsZfh_r r� r � wait_lock0 s� � ���� ���� � � �� ��� � �r� c sT �t | t�s td��|du r| d }� du rt�� � d}d� fdd� }z�z�zt�|�}W n# tyO } z|jtjkrE|d� |j||j �� W Y d}~nd}~ww t� |j �s^|d|� d �� tj tjB tjB } t�� � |k r�zt�|| �} W n5 ty� } z)|jtjkr�|d � |j||j �� t�d ||� tjjj�|�I dH W Y d}~n'd}~ww t�| d �� W d � n1 s�w Y t�d |� d}dV nt�� � |k so|d� ||�� W n$ ty� � t�y } z|d|� d|� �� W Y d}~nd}~ww W |�rt�|� t�d| |� dS dS |�r)t�|� t�d| |� w w )r� r� Nr� Fc r� r� r� r� r� r r r� � r� z await_lock.<locals>._raise_errorr� r� r� r� r� re r� Tr� r� r� r� r� ) r r� r r� rP rq ri r� r� r� r� r� rw r� r� r� r� r� r> r� r+ �extZtornado�genr� r� r r� r� r r� r � await_lock� s� � ���� ��"�� � � �� ��� � �r� c C s t �d�} t �| � | S )z# Returns the current umask r )rP �umask)�retr r r � get_umask� s r� c c sN � | du s t jj�� rdV dS t�| �}z dV W t�|� dS t�|� w )zM Temporarily set the umask and restore once the contextmanager exits N)r+ rR ro rp rP r� )�maskZ orig_maskr r r � set_umask� s � r� c O s� z| d dv rt | d � d���W n ty Y nw d}|�dd�rtt| �dkrLt| �} d| d vrK| d �dd�| d< d| d vrK| d d7 < n(|�d �rpd|d vro|d �dd�|d < d|d vro|d d7 < nd |d < d |vr�d }t| �dkr�t| �} d| d v r�d }|�d d�r�d|d v r�d }|s�t|d < |s�|�dd�s�d|d< |�d�dkr�d|�d d�v r�t� d� t j |d< t | i |��}t � r�ztj}W n ty� d}Y nw t�|�� tj�}t�|�� tj||B � |S )a� Wrapper around open() built-in to set CLOEXEC on the fd. This flag specifies that the file descriptor should be closed when an exec function is invoked; When a file descriptor is allocated (as with open or dup), this bit is initially cleared on the new file descriptor, meaning that descriptor will survive into the new program after exec. NB! We still have small race condition between open and fcntl. r )r � � z# is not a permitted file descriptorN�binaryr� �b�t�mode�rb�encodingFT�newliner& � bufferingzaLine buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used)� TypeError� IndexErrorrM �len�listrT �get�__salt_system_encoding__r> �debug�io�DEFAULT_BUFFER_SIZEr� �is_fcntl_available�fcntl� FD_CLOEXEC�AttributeError�fileno�F_GETFD�F_SETFD)r r r� �f_handler� Z old_flagsr r r rz � sn � � � � � �� �rz c / s� � � d � dd� }� d}t |g� �R i |���M}z3tdd�r;tj}� r3t� fdd�|D ��r3tj}t�|�� |� |V W tdd�rMt�|�� tj� ntdd�r]t�|�� tj� w w W d � dS 1 siw Y dS ) z; Shortcut for fopen with lock and context manager. r r� N�waT�Z check_sunosc s g | ]}|� d v �qS )r r )r9 �write�r r r � <listcomp>N s zflopen.<locals>.<listcomp>) rz r� r� �LOCK_SH�any�LOCK_EX�flockr� �LOCK_UN)r r �filename�writingr� Z lock_typer r� r �flopenC s& � � ���"�r� c o s� � |� dd�}|� dd�}|� dd�}t| i |���M}| d }t�|�}ttd�rC|j|ks3|j|krCdd � ||fD �rCt�|||� |dur\t�|j �}||kr\t� ||j |A |B � |V W d � dS 1 sjw Y dS ) a� Shortcut for fopen with extra uid, gid, and mode options. Supported optional Keyword Arguments: mode Explicit mode to set. Mode is anything os.chmod would accept as input for mode. Works only on unix/unix-like systems. uid The uid to set, if not set, or it is None or -1 no changes are made. Same applies if the path is already owned by this uid. Must be int. Works only on unix/unix-like systems. gid The gid to set, if not set, or it is None or -1 no changes are made. Same applies if the path is already owned by this gid. Must be int. Works only on unix/unix-like systems. �uid����gidr� Nr rs c S s g | ]}|d kr|�qS )r� r �r9 �ir r r r� x s zfpopen.<locals>.<listcomp>) rM rz rP rq �hasattrrt ru rs �S_IMODErw rv ) r r r� r� r� r� rS Zd_statZ mode_partr r r �fpopenW s$ � � "�r� c c s: � |du rt � }zt�| �}W n ty* } z|dur ||� W Y d}~dS d}~ww |rHt�| �}|jdkrH|j|jf}||v rCdS |�|� g g } } |D ]} tj� | | �} tj� | �rd| � | � qO| � | � qO|rr| | | fV | D ] } tj� | | �} |s�tj� | �s�t | ||||�E dH qt|s�| | | fV dS dS )z� A clone of the python os.walk function with some checks for recursive symlinks. Unlike os.walk this follows symlinks by default. Nr )�setrP �listdirri rq �st_ino�st_dev�addrS rW rj �append�islink� safe_walk)�top�topdown�onerror� followlinks�_seen�names�err�status�node�dirs�nondirsrI � full_path�new_pathr r r r� � sD ��� ��r� c C s& zt �| � W dS ty Y dS w )z Safely remove a file N)rP r� ri )r� r r r �safe_rm� s �r c C sr dd� }t j�| �st j�| �st �| � dS tjj�� r0z tjj � | �} W n t y/ Y nw t j | |d� dS )zj Platform-independent recursive delete. Includes code from http://stackoverflow.com/a/2656405 c S s6 t jj�� rt�|tj�st�|tj � | |� dS � )a/ Error handler for `shutil.rmtree`. If the error is due to an access error (read only file) it attempts to add write permission and then retries. If the error is for another reason it re-raises the error. Usage : `shutil.rmtree(path, onerror=onerror)` N) r+ rR ro rp rP �access�W_OKrv rq �S_IWUSR)r rS �exc_infor r r �_onerror� s zrm_rf.<locals>._onerror)r� N)rP rS r� rj r� r+ rR ro rp � stringutilsZ to_unicoder� rZ �rmtree)rS r r r r r= � s �r= �is_emptyc C s( z t �| �jdkW S ty Y dS w )z Is a file empty? r F)rP rq �st_sizeri )r� r r r r � s �c C s | r t jj�� r dS tS )z� Simple function to check if the ``fcntl`` module is available or not. If ``check_sunos`` is passed as ``True`` an additional check to see if host is SunOS is also made. For additional information see: http://goo.gl/159FF8 F)r+ rR ro Zis_sunos� HAS_FCNTLr� r r r r� � s r� c C sB dd� }t | t�st�d|t| d��dd��S tjd|| tjd�S )a� Input the basename of a file, without the directory tree, and returns a safe name to use i.e. only the required characters are converted by urllib.parse.quote If the input is a PY2 String, output a PY2 String. If input is Unicode output Unicode. For consistency all platforms are treated the same. Hard coded to utf8 as its ascii compatible windows is \ / : * ? " < > | posix is / .. versionadded:: 2017.7.2 :codeauthor: Damon Atkins <https://github.com/damon-atkins> c S s t jj| �d�dd�S )Nr r& )�safe)�urllib�parse�quote�group)Zre_objr r r �_replace s z$safe_filename_leaf.<locals>._replacez [\\:/*?"<>|]�utf8�ascii�backslashreplace)�flags)r r� �re�sub�encode�UNICODE)Z file_basenamer r r r �safe_filename_leaf� s �r c C sh |st j}t| t�st|t�r|�d�}t j�| �\}}|�dd� |�|�D ��}|r2|�||g�}|S )a3 Input the full path and filename, splits on directory separator and calls safe_filename_leaf for each part of the path. dir_sep allows coder to force a directory separate to a particular character .. versionadded:: 2017.7.2 :codeauthor: Damon Atkins <https://github.com/damon-atkins> r c S s g | ]}t |��qS r )r )r9 Z file_sectionr r r r� ) s z!safe_filepath.<locals>.<listcomp>) rP rV r r� r rS � splitdriverW �rsplit)Zfile_path_nameZdir_sep�driverS r r r � safe_filepath s �r! Z is_text_file� c s� dd� � d� � fdd�tdd�D ��d }z| �|�}W n1 tyM z t| d �� }|�|�}W d � n1 s9w Y W n tyJ Y Y d S w Y nw d |v rTd S |sXd S z|�d� W d S tyi Y nw |�d |�}t t |��t |� dkS )a Uses heuristics to guess whether the given file is text or binary, by reading a single block of bytes from the file. If more than 30% of the chars in the block are non-text, or there are NUL (' ') bytes in the block, assume this is a binary file. c S s t | f�S r )�bytes)r: r r r �int2byte9 s zis_text.<locals>.int2byte� c 3 s � | ]}� |�V qd S r r r� �r$ r r � <genexpr>< s � zis_text.<locals>.<genexpr>r2 � s r� NF� Tzutf-8g333333�?) rW �range�readr� rz ri �decode�UnicodeDecodeError� translate�floatr� )�fp_� blocksizeZtext_characters�blockZfp2_Znontextr r& r �is_text0 s6 " �� ��� � r3 Z is_bin_filec C s� t j�| �sdS z=t| d��-}z|�d�}|�t�}tjj � |�W W d � W S t y: Y W d � W dS w 1 s>w Y W dS t yO Y dS w )z� Detects if the file is a binary, returns bool. Returns True if the file is a bin, False if the file is not and None if the file is not available. Fr� � NT) rP rS rh rz r+ r, r� r+ rR r � is_binaryr- ri )rS r0 �datar r r r5 X s" � �� �r5 c C sF zt �| � W dS ty" } z|jtjkr� W Y d}~dS d}~ww )zS Runs os.remove(path) and suppresses the OSError if the file doesn't exist N)rP r� ri r� r� )rS r r r r r� l s ���r� � list_filesc C sh t � }|�| � t| �D ]#\}}}|D ] }|�tj�||�� q|D ] }|�tj�||�� q"q t|�S )zS Return a list of all files found under directory (and its subdirectories) )r� r� r� rP rS rW r� )� directoryr� r^ r r` rI r r r r7 w s �c C s, z t | �dd� W S ttfy Y dS w )zj Convert the st_mode value from a stat(2) call (as returned from os.stat()) to an octal mode. ���Nr& )�octr� r� �r� r r r �st_mode_to_octal� s �r< c C sF | du rdS t | t�st| �} | �dd�} | �d��d��d��d�S )z� Return a mode value, normalized to a string and containing a leading zero if it does not have one. Allow "keep" as a valid mode (used by file state/module to preserve mode from the Salt fileserver in file states). NZ0o�0�"�'� )r r� rT �striprU �zfillr; r r r �normalize_mode� s rC c C s\ dddddd�}t | �}t�d|�}|std��t|�d��}d |�|�d�d � }|| S ) z/ Convert human-readable units to bytes r� r� � r@ r� )�K�M�G�T�Pz^(\d+)([KMGTP])?$zFSize must be all digits, with an optional unit type (K, M, G, T, or P)i r )r� r �match� ValueErrorr� r r� )Z human_sizeZ size_exp_mapZhuman_size_strrJ Zsize_numZunit_multiplierr r r �human_size_to_bytes� s �rL c C s, t j�| �\}}tjj�� r|�dd�}n|dd� }tjj�� s&t �| �}t t t � � d ��dd� }tjj�� r@t � d�}nt � d�}|dd � � |� d|d d� � �}t j� |||� d|� ��}t j�t j�|��svt �t j�|�� t�| |� tjj�� s�t �||j|j� t �||j� dS dS ) z% Backup a file on the minion �:r_ r� Ni@B i����z%a_%b_%d_%H-%M-%S_%Yz%a_%b_%d_%H:%M:%S_%Yr9 )rP rS �splitr+ rR ro rp rT rq r� r� r� �strftimerW rj rk rY rZ r[ rs rt ru rv rw ) rS r� r r~ Zsrc_dirr� �msecsZstampZbkpathr r r rn � s& " �rn c C sF t jd| dd��}tj�|j�� �W d � S 1 s w Y dS )z� Detect case insensitivity on a system. Returns: bool: Flag to indicate case insensitivity .. versionadded:: 3004 ZTmPT)rK rc �deleteN)rN ZNamedTemporaryFilerP rS rX rI rG )rS Ztmp_filer r r �case_insensitive_filesystem� s $�rR c C s� dd� }dd� }dd� }dd� }t j�| �std ��z t| d �� }|�d �}W d � n1 s0w Y W n tyA td ��w ||�}|rJ|S ||�rPdS ||�rVtS ||�r\dS td��)ao Detect a file's encoding using the following: - Check for Byte Order Marks (BOM) - Check for UTF-8 Markers - Check System Encoding - Check for ascii Args: path (str): The path to the file to check Returns: str: The encoding of the file Raises: CommandExecutionError: If the encoding cannot be detected c S s0 z | � d� t�d� W dS ty Y dS w )N�ASCIIz Found ASCIIFT)r, r> r� r- ��_datar r r � check_ascii� s ��z!get_encoding.<locals>.check_asciic S s� dt jj�tj�fdt jj�tj�fdt jj�tj�fdt jj�tj�fdt jj�tj �fdt jj�d�fdt jj�d�fdt jj�d �fdt jj�d �fdt jj�d �fg }|D ]\}}| � |�rlt � d |� | S qYd S )Nz UTF-32-BEz UTF-32-LEz UTF-16-BEz UTF-16-LE�UTF-8zUTF-7z+/v8-z+/v8z+/v9z+/v+z+/v/zFound BOM for %sF) r+ rR r �to_bytes�codecs� BOM_UTF32_BE� BOM_UTF32_LE� BOM_UTF16_BE� BOM_UTF16_LE�BOM_UTF8� startswithr> r� )rU Zboms� _encodingZbomr r r � check_bom� s" � �z get_encoding.<locals>.check_bomc S s& z| � d�}W dS ty Y dS w )NrW FT)r, r- )rU �decodedr r r �check_utf8_markers � ��z(get_encoding.<locals>.check_utf8_markersc S s& z| � t� W dS ty Y dS w )NFT)r, r� r- rT r r r �check_system_encoding rd z+get_encoding.<locals>.check_system_encodingz Not a filer� r4 NzFailed to open filerW rS z Could not detect file encoding)rP rS rh r rz r+ ri r� )rS rV ra rc re r0 r6 r� r r r � get_encoding� s0 �� �rf )r& r& r )Nr� r� N)TNTNr� )r" )Kr! rY � contextlibr� r� r@ rP r rZ rq r| rN r� � urllib.parser Zsalt.ext.tornado.genr+ Zsalt.utils.pathZsalt.utils.platformZsalt.utils.stringutilsZsalt.exceptionsr r r Zsalt.utils.decorators.jinjar r� r ry r� r r$ r � getLoggerr r> Z LOCAL_PROTOSZ REMOTE_PROTOSZ VALID_PROTOSZTEMPFILE_PREFIXZHASHES�itemsZ HASHES_REVMAPrC rJ rO rb r[ r� r� �contextmanagerr� r� r� r� rz r� r� r� r r= r r� r r! r3 r5 r� r7 r< rC rL rn rR rf r r r r �<module> s� � + � D X Q O -1 $ '
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings