File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/relenv/build/common/__pycache__/builder.cpython-310.pyc
Back
o ;jls � @ sd d Z ddlmZ ddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z mZmZmZ ddlmZmZmZmZmZmZmZmZmZ ddlm Z ddl m Z dd l m!Z!m"Z"m#Z#m$Z$m%Z%m&Z& e rxddl'Z'dd l(m)Z)m*Z*m+Z+ e,ej-e, B Z-e�.e/�Z0d dd�Z1d!dd�Z2e1Z3G dd� d�Z4G dd� de�Z5G d d � d �Z6G d d � d �Z7e7� Z8dS )"z< Builder and Builds classes for managing the build process. � )� annotationsN)�IO� TYPE_CHECKING�Any� TypedDict�cast) �DATA_DIR� MODULE_DIR�ConfigurationError�WorkDirs� build_arch�extract_archive� get_toolchain� get_triplet� work_dirs� )� build_default)�Download)� BuildStats�LineCountHandler�load_build_stats�print_ui�print_ui_expanded�update_build_stats)�Callable�MutableMapping�Sequence�env�MutableMapping[str, str]�dirs�Dirs�return�Nonec C s | }|}dS )z�Default populate_env implementation (does nothing). This default implementation intentionally does nothing; specific steps may provide their own implementation via the ``populate_env`` hook. N� )r r �_r# r# �O/opt/saltstack/salt/lib/python3.10/site-packages/relenv/build/common/builder.py�_default_populate_env: s r& �name�str�platform�dict[str, str] | Nonec C s� t d }|�� s dS t�|�� �}|�di �}| |vr dS || }t|�� dd� dd�D ]-\}}||�dg �v rY||d |�d d �d �}|�� D ] \} } | d vrT| || < qH| S q,dS )a� Get dependency version and metadata from python-versions.json. Returns dict with keys: version, url, sha256, and any extra fields (e.g., sqliteversion) Returns None if dependency not found. :param name: Dependency name (openssl, sqlite, xz) :param platform: Platform name (linux, darwin, win32) :return: Dict with version, url, sha256, and extra fields, or None zpython-versions.jsonN� dependenciesc S s dd� | d � d�D �S )Nc S s g | ]}t |��qS r# )�int)�.0�nr# r# r% � <listcomp>] s z<get_dependency_version.<locals>.<lambda>.<locals>.<listcomp>r �.)�split)�xr# r# r% �<lambda>] s z(get_dependency_version.<locals>.<lambda>T)�key�reverse� platforms�url�sha256� )�versionr7 r8 )r7 r8 r6 )r �exists�json�loads� read_text�get�sorted�items) r' r) Z versions_file�datar+ Z dep_versionsr: �info�resultr4 �valuer# r# r% �get_dependency_versionD s2 � ��� rF c @ sb e Zd ZdZd d d �Zed d d��Zed dd��Zed dd��Zd!dd�Z d"dd�Z d!dd�Z d S )#r a" A container for directories during build time. :param dirs: A collection of working directories :type dirs: ``relenv.common.WorkDirs`` :param name: The name of this collection :type name: str :param arch: The architecture being worked with :type arch: str r r r' r( �archr: r! r" c C sX || _ || _|| _|j| _|j| _|j| _|j| _|j| _ t j |� d�d�| _ d | _ d S )NZ_build)�prefix)r' r: rG �root�build�download� downloads�logs�src�sources�tempfileZmkdtemp�tmpbuild�source)�selfr r' rG r: r# r# r% �__init__� s z Dirs.__init__�pathlib.Path | Nonec C s: t jdkr t| jd�S t jdkrt| jd�S t| j| j�S )z:Get the toolchain directory path for the current platform.�darwin)rI �win32)�sysr) r rI rG �rS r# r# r% � toolchain� s zDirs.toolchainc C �8 t jdkr | j� d�S t jdkr| j� d�S | j� d�S �NrV z-macosrW z-winz -linux-gnu�rX r) rG rY r# r# r% �_triplet� � z Dirs._triplet� pathlib.Pathc C s | j | j� d| j� � S �z$Get the build prefix directory path.�-)rJ r: r^ rY r# r# r% rH � s z Dirs.prefix�dict[str, Any]c C s& | j | j| j| j| j| j| j| jd�S )z[ Return an object used for pickling. :return: The picklable state �r' rG rI rJ rL rM rO rQ rd rY r# r# r% � __getstate__� s �zDirs.__getstate__�statec C sT |d | _ |d | _|d | _|d | _|d | _|d | _|d | _|d | _d S ) z� Unwrap the object returned from unpickling. :param state: The state to unpickle :type state: dict r' rG rI rL rM rO rJ rQ N)r' rG rI rL rM rO rJ rQ )rS rf r# r# r% � __setstate__� s zDirs.__setstate__c s � fdd�dD �S )z� Get a dictionary representation of the directories in this collection. :return: A dictionary of all the directories :rtype: dict c s i | ]}|t � |��qS r# )�getattr)r- r2 rY r# r% � <dictcomp>� s ��z Dirs.to_dict.<locals>.<dictcomp>)rI rH rL rM rO rJ rZ r# rY r# rY r% �to_dict� s �z Dirs.to_dictN) r r r' r( rG r( r: r( r! r" �r! rU �r! r( �r! r` )r! rc )rf rc r! r" ) �__name__� __module__� __qualname__�__doc__rT �propertyrZ r^ rH re rg rj r# r# r# r% r t s c @ s* e Zd ZU dZded< ded< ded< dS ) �Recipez*Typed description of a build recipe entry.z9Callable[[MutableMapping[str, str], Dirs, IO[str]], None]� build_func� list[str]�wait_on�Download | NonerK N)rn ro rp rq �__annotations__r# r# r# r% rs � s rs c @ s� e Zd ZdZ dLdMdd�ZdNdd�ZedOdd��ZedPdd��ZedQd d ��Z edPd d ��Z dRdSd'd(�Z ) * dTdUd5d6�Z dVd7d8�Z dVd9d:�Z ) ) )dWdXd>d?�Z @ ) * )dYdZdBdC�Zd[dEdF�Z @ @ ) ) ) * )d\d]dJdK�ZdS )^�Buildera� Utility that handles the build process. :param root: The root of the working directories for this build :type root: str :param recipies: The instructions for the build steps :type recipes: list :param build_default: The default build function, defaults to ``build_default`` :type build_default: types.FunctionType :param populate_env: The default function to populate the build environment, defaults to ``populate_env`` :type populate_env: types.FunctionType :param force_download: If True, forces downloading the archives even if they exist, defaults to False :type force_download: bool :param arch: The architecture being built :type arch: str N�x86_64r9 rI �PathLike | None�recipies�dict[str, Recipe] | Noner �@Callable[[MutableMapping[str, str], Dirs, IO[str]], None] | None� populate_env�7Callable[[MutableMapping[str, str], Dirs], None] | NonerG r( r: r! r" c C s� || _ t|�| _t� | _t| j�| _|| _| jj| _| jj | _ |d u r'i | _ n|| _ |d ur0|nt | _ |d ur9|nt| _|| _| �| j� d S )N)rI r r r r � build_tripletrG rN rO rK rL r| �_default_build_funcr r& r r: �set_arch)rS rI r| r r rG r: r# r# r% rT � s ��zBuilder.__init__c C s || _ d| _dS )zu Set the architecture for the build. :param arch: The arch to build :type arch: str N)rG � _toolchain)rS rG r# r# r% r� s zBuilder.set_archrU c C s8 | j du rtjdkrddlm} || j| jj�| _ | j S )z(Lazily fetch toolchain only when needed.N�linuxr )r )r� rX r) � relenv.commonr rG r rI )rS r r# r# r% rZ # s zBuilder.toolchainc C s t | j�S )z4Get the target triplet for the current architecture.)r rG rY r# r# r% �triplet, s zBuilder.tripletr` c C s | j j| j� d| j� � S ra )r rJ r: r� rY r# r# r% rH 1 s zBuilder.prefixc C r[ r\ r] rY r# r# r% r^ 6 r_ zBuilder._tripletr' rt �Callable[..., Any] | Nonerv �Sequence[str] | NonerK �dict[str, Any] | Nonec C s\ |du rg }nt |�}|du r| j}d}|dur#t|fd| ji|��}|||d�| j|< dS )a� Add a step to the build process. :param name: The name of the step :type name: str :param build_func: The function that builds this step, defaults to None :type build_func: types.FunctionType, optional :param wait_on: Processes to wait on before running this step, defaults to None :type wait_on: list, optional :param download: A dictionary of download information, defaults to None :type download: dict, optional NZ destination)rt rv rK )�listr r rL r| )rS r' rt rv rK � wait_on_listZ download_objr# r# r% �add? s �z Builder.addF�WARNING�event�!multiprocessing.synchronize.Event�Callable[..., Any]rw �show_ui�bool� log_level� line_counts� MutableMapping[str, int] | Noner c C s� t �d�}tjdkr |s t �� } | �t �|�� |�| � |jD ]} t | t j�r4| � t � d|� d��� q | j j �� sDtj| j j dd� t| j || j| j�} tj| jdd� tj| jdd� tj| jdd� |�� du rwt�d� |�� du slttj� | j|� d ��d �} t � | j|� d � �} |�| � |�t j � d}|dur�t ||�}|�|� t� � }|r�t!| jt"|j#�� | j|j#j$�%d �d | _&t�'| j&� nt�'| j� tjdkr�tj(�)� }nd tj(d i}d|d< d|d< | j*|d< | j|d< | j+|d< | j,|d< | j-d �.d�}|du �rt/d��|j|d< |d �0dd�d |d< d tj(v �r1tj(d |d < | j,| jk�rFt1d }t"|d d �|d < | �2|| � | �3� }|D ] }t4�5d!||| � �qR|D ] }t4�5d"||| � �qazjz:||| | �}|du�r�|du�r�||v �r�|| }t6||� |W W t�'|� |du�r�|�7|� |�7| � | �8� S t9�y� t4�:d#� t�;d� Y nw W t�'|� |du�r�|�7|� |�7| � | �8� dS t�'|� |du�r�|�7|� |�7| � | �8� w )$a� Run a build step. :param name: The name of the step to run :type name: str :param event: An event to track this process' status and alert waiting steps :type event: ``multiprocessing.Event`` :param build_func: The function to use to build this step :type build_func: types.FunctionType :param download: The ``Download`` instance for this step :type download: ``Download`` :param line_counts: Optional shared dict for tracking log line counts :type line_counts: Optional[MutableMapping[str, int]] :return: The output of the build function NrW z %(asctime)s z %(message)sT��exist_okF�333333�?�.log�wz.tarr �PATH�1� RELENV_DEBUG�RELENV_BUILDENVZ RELENV_HOSTZRELENV_HOST_ARCHZ RELENV_BUILDZRELENV_BUILD_ARCH�pythonrK z/Python recipe is missing download configurationZRELENV_PY_VERSIONr0 r ZRELENV_PY_MAJOR_VERSION� RELENV_DATA�native�binZpython3ZRELENV_NATIVE_PYzDirectory %s %szEnvironment %s %sz Build failure)<�logging� getLoggerrX r) � StreamHandler�setLevel� getLevelName� addHandler�handlers� isinstance� setFormatter� Formatterr rJ r; �os�makedirsr rG r: rO rM rH �is_set�time�sleep�open�path�join� FileHandler�NOTSETr �getcwdr r( �filepathr' r1 rR �chdir�environ�copyr� r� r r| r? r �rsplitr r rj �logrC r � removeHandler�close� Exception� exception�exit)rS r' r� rt rK r� r� r� Zroot_log�stream_handler�hr Zlogfp� file_handlerZline_count_handler�cwdr Zpython_download� native_rootr$ �krD Z final_countr# r# r% �runa s� � � � � � � z Builder.runc C s t �| j� dS )z1 Clean up the build directories. N)�shutil�rmtreerH rY r# r# r% �cleanup� s zBuilder.cleanupc C s� | j | jfD ]#}zt�|� W q ty! tj�d|� �� Y q ty) Y qw | j � d�}|fD ]}zt � |� W q3 tyE Y q3w dS )zE Completely clean up the remnants of a relenv build. z Unable to remove directory: z.tar.xzN) rH rO r� r� �PermissionErrorrX �stderr�write�FileNotFoundErrorr� �remove)rS r$ �archiver# r# r% �clean� s � ��z Builder.clean�steps�force_download� expanded_uic C s� |durt |�nt | j�}g }i }i }t�� } | �� } i } |r'|s'tj�d� t� d� |r6|s6t |||� |D ]>} | j| d } | du rFq8t� � }|� � ||| < dd d �}||d d�}|rf|| | �|d< tj | | |d�}|�� ||| < q8|r�t |�� �D ]2}|�d� |r�|r�t|||| | d� nt |||� |jdu r�q|�|j� |jdkr�|�|j� q|sy|r�|r�t|||| | d� nt |||� tj�d� |r�|r�t |||� tj�d� |D ] }tj�|d � q�tj�� t�d� dS dS )a Download all of the needed archives. :param steps: The steps to download archives for, defaults to None :type steps: list, optional :param expanded_ui: Whether to use expanded UI with progress bars :type expanded_ui: bool, optional NzStarting downloads zStarting downloadsrK � step_namer( � shared_dict�MutableMapping[str, int]r! �Callable[[int, int], None]c s d� �fdd� }|S ) N� downloadedr, �totalr! r" c s | � �< |� �� d�< d S )NZ_totalr# )r� r� �r� r� r# r% �progress_callback s zQBuilder.download_files.<locals>.make_progress_callback.<locals>.progress_callback)r� r, r� r, r! r" r# )r� r� r� r# r� r% �make_progress_callback s z6Builder.download_files.<locals>.make_progress_callbackT)r� r� Zexit_on_failurer� )r' �target�kwargsr� r � �%The following failures were reported r )r� r( r� r� r! r� )r� r| �multiprocessing�Manager�dictrX �stdoutr� r� rC r �Event�set�Process�start�valuesr� r �exitcode�popr' �appendr� �flushr� )rS r� r� r� r� � step_names�fails� processes�events�managerr� � build_statsr' rK r� r� Zdownload_kwargs�proc�failr# r# r% �download_files� s� �� � �� �zBuilder.download_filesTr� c C s� g }i }i }i } t �� } | �� } i } |rt� } |r(|r n tj�d� t|| |� t� d� |dur5t |�nt | j �} | D ]^}t � � }|||< | j | }t|�}||d< ||d< | |d< t d|�dg ��}t |�}|dd� D ] }|| vry|�|� qn|||< || s�|�� t j|| j||f|d �}|�� || |< q<| �rt | �� �D ]n}|�d � |r�|r�t|| || | d � nt|| |� |jdu r�q�| �|j� |jd kr�|�|j� d }nd}|D ]4}|j|| v r�|r�|| v r�| | �� t� d� || �|j� || �s|| � � �s|| �� q�q�| s�|�r�tj �d� i }|D ]}| j j |� d� }zVt!|��G}|�"d d� |�#� }|d } | d k�rL|�"| � n|�"d � |�$� } |�rrtj �dd|� d� d d � tj �|�$� d � W d � n 1 �s}w Y W n t%�y� d|� �||< Y nw t�&d|� t�&| � �q"|�r�tj �'� |�r�t�(d� | �)� t�*d� |�r�t� d � |�r�t|| || | d � nt|| |� tj�d� tj�'� |�r�t�(d� | �)� dS dS ) aU Build! :param steps: The steps to run, defaults to None :type steps: list, optional :param cleanup: Whether to clean up or not, defaults to True :type cleanup: bool, optional :param expanded_ui: Whether to use expanded UI with progress bars :type expanded_ui: bool, optional zStarting builds zStarting buildsNr� r� r� ru rv )r' r� �argsr� r� rJ r TFg�������?r� r� � i z====================� r� z zLog file not found: zBuild step %s has failedzPerforming cleanup.r )+r� r� r� r rX r� r� r r� rC r� r| r� r r� r� r� r� r� r� r� r� r r� r' r� � terminater� r� r� r� r rM r� �seek�tell�readr� �errorr� �debugr� r� ) rS r� r� r� r� r� r� r� Zwaitsr� r� r� r� r� r' r� Zreciper� Z wait_on_seqr� Z dependencyr� Z is_failureZ last_outsr� Zlog_file�fp�end�indZlast_outr# r# r% rJ W s� � ��� � �� � �z Builder.buildru c C s6 g }t jdkr| jr| j�� s|�d| j� d�� |S )z� Check pre-requsists for build. This method verifies all requrements for a successful build are satisfied. :return: Returns a list of string describing failed checks :rtype: list r� zToolchain for z) does not exist. Please pip install ppbt.)rX r) rZ r; r� rG )rS r� r# r# r% � check_prereqs� s zBuilder.check_prereqs� str | Noner� � download_onlyc C s� t �d�} | �t j� d} |s t �� } | �t �|�� | �| � tj| j j dd� t � | j j d �} | �t j � | �| � |rD| � |� |durLt|�nt| j�} | �� }|sq|rq|D ] }tj�|� d�� q[tj�� t�d� |rw| �� | j| jkr�td }|�� s�dtjv r�tjd }n| j }d d l m } |dt|d � z;| j | ||| d � |r�W | � | � | dur�| � | � dS dS | j!| |||| d � W | � | � | dur�| � | � dS dS | � | � | dur�| � | � w w )a Set the architecture, define the steps, clean if needed, download what is needed, and build. :param steps: The steps to run, defaults to None :type steps: list, optional :param arch: The architecture to build, defaults to None :type arch: str, optional :param clean: If true, cleans the directories first, defaults to True :type clean: bool, optional :param cleanup: Cleans up after build if true, defaults to True :type cleanup: bool, optional :param force_download: Whether or not to download the content if it already exists, defaults to True :type force_download: bool, optional :param expanded_ui: Whether to use expanded UI with progress bars :type expanded_ui: bool, optional NTr� z build.logr� r r� ZRELENV_NATIVE_PY_VERSIONr )�create)r: )r� r� r� )r� r� r� )"r� r� r� r� r� r� r� r� r� r rM r� �INFOr� r� r| r rX r� r� r� r� r� r rG r r; r� r: Z relenv.creater r� r� rJ )rS r� rG r� r� r� r r� r� r� r� r� r� r� Zfailuresr$ r� r: r r# r# r% �__call__� st � ��� � � �zBuilder.__call__)NNNNrz r9 )rI r{ r| r} r r~ r r� rG r( r: r( r! r" )rG r( r! r" rk rl rm )NNN) r' r( rt r� rv r� rK r� r! r" )Fr� N)r' r( r� r� rt r� rK rw r� r� r� r( r� r� r! r �r! r" )NFFF) r� r� r� r� r� r� r� r� r! r" )NTFr� F) r� r� r� r� r� r� r� r( r� r� r! r" )r! ru ) NNTTFFFr� F)r� r� rG r r� r� r� r� r� r� r r� r� r� r� r( r� r� r! r" )rn ro rp rq rT r� rr rZ r� rH r^ r� r� r� r� r� rJ r r r# r# r# r% ry � sf � # �( � v �h � �ry c @ s$ e Zd ZdZddd�Zdd d �ZdS )�Buildsz)Collection of platform-specific builders.r! r" c C s i | _ dS )z+Initialize an empty collection of builders.N)�buildsrY r# r# r% rT L s zBuilds.__init__r) r( r� r r� ry c O sJ d|v r|� d�}|s |rtd��td|�}nt|i |��}|| j|< |S )z&Add a builder for a specific platform.Zbuilderz9builder keyword can not be used with other kwargs or argsry )r� � RuntimeErrorr ry r )rS r) r� r� Zbuild_candidaterJ r# r# r% r� P s z Builds.addNr )r) r( r� r r� r r! ry )rn ro rp rq rT r� r# r# r# r% r I s r )r r r r r! r" )r' r( r) r( r! r* )9rq � __future__r r< r� r� r� r� rX rP r� �typingr r r r r r� r r r r r r r r r Zbuildersr r� rK r Zuir r r r r r �pathlib�collections.abcr r r r( �PathLiker� rn r� r& rF r r rs ry r r r# r# r# r% �<module> s@ , -h i
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings