File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/salt/cloud/__pycache__/__init__.cpython-310.pyc
Back
o ;j�_ � @ s| d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl Z ddl Z ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlZ ddlmZm Z m Z m Z ddl m Z e�!e"�Z#dd� Z$ d dd �Z%G d d � d �Z&G d d � d �Z'G dd� de'�Z(dd� Z)d dd�Z*d dd�Z+d dd�Z,dd� Z-dd� Z.d d � Z/dS ) z` The top level interface used to translate configuration data back to the correct cloud modules � N)�groupby)�SaltCloudConfigError�SaltCloudException�SaltCloudNotFound�SaltCloudSystemExit)�compile_templatec s � fdd�}|S )z(Warning, this is a picklable decorator !c s0 | |d< d}z� |i |��}| � d� W |S tyA } z t�� }| � d� | � d� | � |� d|� d�� W Y d}~|S d}~w tyl } z t�� }| � d� | � d� | � |� d|� d�� W Y d}~|S d}~w ty� } z t�� }| � d� | � d � | � |� d|� d�� W Y d}~|S d}~ww ) z7called with [queue, args, kwargs] as first optional arg�queueN�END� KEYBOARDINTzKeyboard interrupt� �ERROR� Exceptionz System exit)�put�KeyboardInterrupt� traceback� format_excr � SystemExit)r �args�kwargs�ret�ex�trace��func� �G/opt/saltstack/salt/lib/python3.10/site-packages/salt/cloud/__init__.py�_call, s8 � �� �� ��zcommunicator.<locals>._callr )r r r r r � communicator) s r c s: � si � |sd}|st �|�}�st �� }|�� �|dur0|s0d�| �} t�| � td| � ���|durF� �fdd�|D �} |j| | d�} n |� | �|� g�} �� � } | d v r��� � } �� � }d | � d �} | d |� d �7 } t�| � |� � |� � td| � ���| dv s�|r�|| �r�|� � |� � | S t�d� qP)a' Manage a multiprocessing pool - If the queue does not output anything, the pool runs indefinitely - If the queue returns KEYBOARDINT or ERROR, this will kill the pool totally calling terminate & join and ands with a SaltCloudSystemExit exception notifying callers from the abnormal termination - If the queue returns END or callback is defined and returns True, it just join the process and return the data. target the function you want to execute in multiprocessing pool pool object can be None if you want a default pool, but you ll have then to define pool_size instead pool_size pool size if you did not provide yourself a pool callback a boolean taking a string in argument which returns True to signal that 'target' is finished and we need to join the pool queue A custom multiprocessing queue in case you want to do extra stuff and need it later in your program args positional arguments to call the function with if you don't want to use pool.map mapped_args a list of one or more arguments combinations to call the function with e.g. (foo, [[1], [2]]) will call:: foo([1]) foo([2]) kwargs kwargs to give to the function in case of process Attention, the function must have the following signature: target(queue, *args, **kw) You may use the 'communicator' decorator to generate such a function (see end of this file) � NzdWe are called to asynchronously execute {} but we do no have anything to execute, weird, we bail outzException caught c s g | ]}�|g� g�qS r r )�.0�arg�r r r r � <listcomp>� s z"enter_mainloop.<locals>.<listcomp>)r �iterableT)r r zCaught z, terminating workers zTRACE: r )r g �?)�multiprocessing�Pool�Manager�Queue�format�log�errorr �mapZapply�get� terminate�join�close�time�sleep)�targetZ mapped_argsr r �pool� pool_size�callbackr �manager�msgr# r �test�type_r r r! r �enter_mainloopG sJ 9 � ��r: c @ s� e Zd ZdZd'dd�Zdd� Zdd� Zd(d d �Zd(d d �Zd(d d�Z d)dd�Z d*dd�Z d+dd�Z d,dd�Z d(dd �Zd(d d �Zd d � Zd!d"� Zd#d$� Z d-d%d&�ZdS ).� CloudClientz5 The client class to wrap cloud interactions Nc C sh |r|| _ ntj�|�| _ | j d g}tjj�|tjj�� � |r�|� di �� � D ]\}}|d }i |d< | j d � |||ii� q)|� di �� � D ]A\}} | d � d�d }t t| j d | �� ��}|� d|� �| d< || d< | j d � || i� | j d | | d � || i� qJ|� d i �� � D ]\}} d | j vr�i | j d < | | j d |< q�| j � |� d S d S ) NZcachedir� providers�driver�profiles�provider�:r �profile�maps)�opts�salt�configZ cloud_config�utilsZverifyZ verify_env�userZget_user�pop�items�update�split�next�iter�keys) �self�pathrC Z config_dirZpillarsZv_dirs�namer? r= rA Zmap_dctr r r �__init__� s2 � �zCloudClient.__init__c K s� t jj�� }|�| j�� � d|d< d|d< d|d< d|d< d|d< d|d < d |v r1|�|d � |�|� |�d d �}|rz|�d i ��� }dd� |D �D ] }||ksX|�|� qMdd� |�� D �}|rz|�di �}|�� D ] }||vry|�|� qn|S )zi Set the opts dict to defaults and allow for opts to be overridden in the kwargs F�parallelZkeep_tmpT�deployZupdate_bootstrap�show_deploy_args� Z script_argsr rA Nr> c S s g | ]}|�qS r r �r �ar r r r" � s z.CloudClient._opts_defaults.<locals>.<listcomp>c S s. g | ]}|� d d�r|� d d��d�d �qS )r? rV r@ r )r, rK rW r r r r" � s ��r< ) rD rE ZDEFAULT_CLOUD_OPTS�copyrJ rC r, rH �values) rO r rC rA Z tmp_profilesZ_profiler< Z _providersr? r r r �_opts_defaults� s8 �� �zCloudClient._opts_defaultsc C s8 t | |�}tjj�||�}||�dd�i |�di ���S )zG Pass the cloud function and low data structure to run r r r )�getattrrD rF r Z format_callr, )rO �fun�lowZl_funZf_callr r r r^ � s zCloudClient.lowc C �$ t j�| �� �}t jj�|�|��S )zF List all available sizes in configured cloud systems )rD �cloud�Mapr[ rF �data�simple_types_filter� size_list�rO r? �mapperr r r � list_sizes � zCloudClient.list_sizesc C r_ )zG List all available images in configured cloud systems )rD r` ra r[ rF rb rc � image_listre r r r � list_images rh zCloudClient.list_imagesc C r_ )zJ List all available locations in configured cloud systems )rD r` ra r[ rF rb rc � location_listre r r r �list_locations rh zCloudClient.list_locations� list_nodesc C �$ t j�| �� �}d|jd< |�|�S )z2 Query basic instance information rm �selected_query_option�rD r` ra r[ rC �map_providers_parallel�rO Z query_typerf r r r �query � zCloudClient.query�list_nodes_fullc C rn )z0 Query all instance information ru ro rp rr r r r � full_query rt zCloudClient.full_query�list_nodes_selectc C rn )�3 Query select instance information rw ro rp rr r r r � select_query% rt zCloudClient.select_query�list_nodes_minc C rn )rx rz ro rp rr r r r � min_query- rt zCloudClient.min_queryc K sV |si }||d< t j�| jdi |���}t|t�r |�d�}t jj� |j |||d��S )aY Pass in a profile to create, names is a list of vm names to allocate vm_overrides is a special dict that will be per node options overrides Example: .. code-block:: python >>> client= salt.cloud.CloudClient(path='/etc/salt/cloud') >>> client.profile('do_512_git', names=['minion01',]) {'minion01': {'backups_active': 'False', 'created_at': '2014-09-04T18:10:15Z', 'droplet': {'event_id': 31000502, 'id': 2530006, 'image_id': 5140006, 'name': 'minion01', 'size_id': 66}, 'id': '2530006', 'image_id': '5140006', 'ip_address': '107.XXX.XXX.XXX', 'locked': 'True', 'name': 'minion01', 'private_ip_address': None, 'region_id': '4', 'size_id': '66', 'status': 'new'}} rA �,)� vm_overridesNr ) rD r` ra r[ � isinstance�strrK rF rb rc � run_profile)rO rA �namesr} r rf r r r rA 5 s �zCloudClient.profilec K sN i }|r||d< |� |� tj�| jdi |���}|�� }tjj�|� |��S )z" To execute a map r+ Nr ) rJ rD r` ra r[ �map_datarF rb rc �run_map)rO rP r �kwargrf �dmapr r r �map_run_ s zCloudClient.map_runc C s< t j�| jdd��}t|t�r|�d�}t jj� |� |��S )�' Destroy the named VMs T)�destroyr| ) rD r` ra r[ r~ r rK rF rb rc r� )rO r� rf r r r r� k s zCloudClient.destroyc K s� t j�| �� �}| jd }||v r!|dtt|| �� ��� �7 }ndS t|t �r-|� d�}i }|D ]"}|� � }||d< ||d< d|d< ||d < t j j �|�|��||< q1|S ) aM Create the named VMs, without using a profile Example: .. code-block:: python client.create(provider='my-ec2-config', names=['myinstance'], image='ami-1624987f', size='t1.micro', ssh_username='ec2-user', securitygroup='default', delvol_on_destroy=True) r< r@ Fr| rQ r= NrA r? )rD r` ra r[ rC rL rM rN r~ r rK rY rF rb rc �create) rO r? r� r rf r< r rQ �vm_r r r r� t s zCloudClient.createc K s� t j�| �� �}|�� }||v r |dtt|| �� ��� �7 }ndS t|t �r,|� d�}i }|D ]"}|� � } || d< || d< d| d< || d< t j j �|�| ��||< q0|S ) a� Perform actions with block storage devices Example: .. code-block:: python client.extra_action(names=['myblock'], action='volume_create', provider='my-nova', kwargs={'voltype': 'SSD', 'size': 1000} ) client.extra_action(names=['salt-net'], action='network_create', provider='my-nova', kwargs={'cidr': '192.168.100.0/24'} ) r@ Fr| rQ r? NrA �action)rD r` ra r[ rq rL rM rN r~ r rK rY rF rb rc �extras) rO r� r? r� r rf r< r rQ �extra_r r r � extra_action� s zCloudClient.extra_actionc C s| |du ri }t j�| jd||d�|���}|r |r td��|g}|r/|s/|| jd< |�||�S |r:|s:|�|||�S td��)aD Execute a single action via the cloud plugin backend Examples: .. code-block:: python client.action(fun='show_instance', names=['myinstance']) client.action(fun='show_image', provider='my-ec2-config', kwargs={'image': 'ami-10314d79'} ) N)r� r� zMPlease specify either a list of 'names' or a single 'instance', but not both.r� zTEither an instance (or list of names) or a provider must be specified, but not both.r )rD r` ra r[ r rC � do_action� do_function)rO r] Zcloudmapr� r? �instancer rf r r r r� � s" � �zCloudClient.action)NNNN�N)rm )ru )rw )rz )NNNNNN)�__name__� __module__� __qualname__�__doc__rR r[ r^ rg rj rl rs rv ry r{ rA r� r� r� r� r� r r r r r; � s0 * * &$�r; c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd6d d �Zd6dd�Z d7dd�Z dd� Z d8dd�Z d8dd�Z d8dd�Zd8d d �Zd8d d �Zd d!� Zd9d"d#�Zd$d%� Zd:d(d)�Zed*d+� �Zd,d-� Zd;d.d/�Zd0d1� Zd2d3� Zd4d5� ZdS )<�Cloudz/ An object for the creation of new VMs c C s( || _ tj�| j �| _| �� i | _d S r� )rC rD �loader�clouds�$_Cloud__filter_non_working_providers� _Cloud__cached_provider_queries�rO rC r r r rR � s zCloud.__init__c C sX t � }| jd �� D ] \}}t|�dkr$|D ] }|�|� d|� �� qq |�|� q |S )z1 Return the configured providers r< r r@ )�setrC rI �len�add)rO r< �alias�driversr= r r r �get_configured_providers� s z Cloud.get_configured_providersc C s |du rd}|dkr-t � }| jd �� D ]\}}|D ] }|�||f� qq|s+td��|S d|v rU|�d�\}}|| jd vsH|| jd | vrUtd�|d�| �� ����t � }| jd �� D ]\}}|D ]}|||fv rt|�||f� qeq_|s�td�|d�| �� ����|S ) z@ Get a dict describing the configured providers N�allr< z(There are no cloud providers configured.r@ z.No cloud providers matched '{}'. Available: {}�, z9No cloud providers matched '{}'. Available selections: {}) r� rC rI r� r rK r( r. r� )rO �lookupr< r� r� r= r r r �lookup_providers sD ��� ����zCloud.lookup_providersc C s� |du rd}|du r d}|dkrct � }t � }| jd �� D ]7\}}|�d�}|rT|�d�d }|�d�d } ||krB|�||f� n | |krM|�|| f� |�||f� q |s[td��|dkra|S |S dS ) zH Return a dictionary describing the configured profiles Nr� r> r? r@ r r z'There are no cloud profiles configured.)r� rC rI r, rK r� r ) rO r? r� r> Zprovider_profilesr� �infor< Zgiven_prov_nameZsalt_prov_namer r r �lookup_profiles1 s0 ��zCloud.lookup_profilesrm Fc C s, |du r|| j v r| j | S i }| jd �� D ]w\}}|�� D ]n\}}|� d|� �}|| jvr6t�d|� q ||vr>i ||< z-tjjj | j| d� ||g�d�� | j| � || |< W d � n1 sew Y W q t y� } ztj d|| t jd � g || |< W Y d} ~ q d} ~ ww q|| j |< |S ) z� Return a mapping of what named VMs are running on what VM providers based on what providers are defined in the configuration and VMs Tr< �.�)Public cloud provider %s is not availabler@ �Z__active_provider_name__N�=Failed to execute '%s()' while querying for running nodes: %s�Zexc_info_on_loglevel)r� rC rI r� r) r* rD rF �context�func_globals_injectr. r �debug�logging�DEBUG) rO rs �cached�pmapr� r� r= �detailsr] �errr r r � map_providersQ s@ � ������ zCloud.map_providersc C s@ |du r|| j v r| j | S | j�� }g }| �|d �|d< |d �� D ]>\}}|}|�� D ]3\}} |�d�du rC|� d�| jv rCd}|� d|� �} | | jvrVt�d|� q.|� | ||||d �� q.q$i } |si| S t |�} t � | d k ru| pvd t �} tt|| d �}|D ]\}}} | s�q�|| vr�i | |< | | | |< q�| | j |< | S ) z� Return a mapping of what named VMs are running on what VM providers based on what providers are defined in the configuration and VMs Same as map_providers but query in parallel. Tr< ro Nz.list_nodes_minrz r� r� )r] rC rs r� r= � )r3 )r� rC rY �_optimize_providersrI r, r� r) r* �appendr� r$ r% �init_pool_workerr: �!_run_parallel_map_providers_query)rO rs r� rC Zmultiprocessing_datar� r� Z this_queryr= r� r] �outputZ data_countr3 Z parallel_pmapr r r rq v sT ����� z Cloud.map_providers_parallelNc C sD t |t�r|g}i }i }| j||d�}|�� D ]�\}} | �� D ]\} } | |vr+||| < |r>|| jd | d �d�d vr>q | �� D ][\} } | |vrKqB| dkrfd|v rfd||d v rf| ||d d v rfqB| dkr�d|v r�d||d v r�| ||d d v r�qB||vr�i ||< | || vr�i || | < | || | | < qBq q|S )N�r� r> r? r@ r Zec2Zaws)r~ r rq rI rC rK )rO r� rs r� rA �matchesZhandled_drivers�mapped_providersr� r� r= �vms�vm_namer� r r r �get_running_by_names� sH �� ��-zCloud.get_running_by_namesc C s� i }i }|� � D ]\}}|� � D ]\}}||vr i ||< ||| |< qq|� � D ]L\}}|� d�} | | jvrTt�d|� |� � D ]\}} ||vrLi ||< | || |< q@q(| j| |�} | rt| � � D ]\}} ||vrmi ||< | || |< qaq(|S )zD Return an optimized mapping of available providers z.optimize_providersz0The '%s' cloud driver is unable to be optimized.)rI r� r) r� ) rO r< Z new_providersZprovider_by_driverr� r= rQ rb Zproviders_datar] Z prov_dataZnew_datar r r r� � s2 � �zCloud._optimize_providersr� c C �� i }| � |�}|s |S |D ]g\}}|� d�}|| jvr#t�d||� q ||vr+i ||< z-tjjj| j| d�||g�d�� | j| � || |< W d � n1 sRw Y W q t yt } ztj d||t j d� W Y d}~q d}~ww |S )zO Return a mapping of all location data for available providers z.avail_locationszbThe '%s' cloud driver defined under '%s' provider alias is unable to get the locations informationr@ r� N�&Failed to get the output of '%s()': %sr� � r� r� r) r� rD rF r� r� r. r r* r� r� �rO r� rb �lookupsr� r= r] r� r r r rk s@ �� �����zCloud.location_listc C r� )�L Return a mapping of all image data for available providers z .avail_imagesz_The '%s' cloud driver defined under '%s' provider alias is unable to get the images informationr@ r� Nr� r� r� r� r r r ri : �@ �� �����zCloud.image_listc C r� )r� z .avail_sizesz^The '%s' cloud driver defined under '%s' provider alias is unable to get the sizes informationr@ r� Nr� r� r� r� r r r rd b r� zCloud.size_listc C sP i }| � |�}|s |S |D ]\}}||vri ||< ||| vr%i || |< q |S )r� )r� )rO r� rb r� r� r= r r r � provider_list� s �zCloud.provider_listc C sR i }| � ||�}|s |S |D ]\}}||vri ||< ||| vr&i || |< q|S )z= Return a mapping of all configured profiles )r� )rO r? r� rb r� r� r= r r r � profile_list� s �zCloud.profile_listc C s4 g }| j d �� D ]\}}|�|| �|�i� q |S )z6 Create/Verify the VMs in the VM data r> )rC rI r� r� )rO r r� � vm_detailsr r r � create_all� s zCloud.create_allc C s� i }t |�}| j||d�}t � }g }|�� D ].\}}|�� D ]%\} } | D ] } | |v rB|�|| | f� | jd rB|�| j| || d�� q$q q| jd r�|r�d| jv rW| jd } nt|�} t�d| � t t || d�} i }| D ]}|� |� ql|D ]5}|d }|d } |d } ||vr�i ||< | || vr�i || | < || || | | < | |v r�|� | � qvn`t�d � |D ]X\}} } | � d �}t jjj| j| d �|| g�d �� | j| | �}W d � n1 s�w Y ||vr�i ||< | || vr�i || | < ||| | | < | |v �r |� | � q�|D �]*\}} } || | | }|�s"�q| dd �|| g�| d�}t jjd|| ji d�}tj�| jd d|�d| ��}t�|� d��}tj�|��st|�stt|t��rrd|v �rrt jj � | jd |d � �qtj�|��r�|�s�t jj � | jd tj� |�� �qtj�|��s�|�r�t|�dk�r�t jj � | jd tj� |d �� �qt d� | �� t!|�D ]\}}t d|� d tj� |�� �� �q�t"d �}zt#|�}W n t$�y� t d |� d �� Y nw z tj� |�%|��}W n t&�y Y �q�w t"d |� d!��}|d"k�s |�'� �(d#��r0t jj � | jd |� t d$|� d �� n t d%|� d �� �q|�rK|�sKt)d&� d'�|����|�rW|�rW||d(< |S |�s^t)d)��|S )*r� r� rS )rC rQ r� r= r4 z0Destroying in parallel mode; Cloud pool size: %s�r4 r� r= rQ z Destroying in non-parallel mode.z.destroyr@ r� N)rQ rA r? r= �minion��default�pki_dirZminions�idz.*Znewnamer r zjThere are several minion keys who's name starts with '{}'. We need to ask you which one should be deleted:T� z: z,Which minion key should be deleted(number)? �'z' is not a valid selection.zDelete 'z '? [Y/n]? rV �yz Deleted 'zDid not delete 'z%The following VM's were not found: {}r� � Not FoundzNo machines were destroyed!)*r� r� rI r� rC r� r� r) r� r: �_destroy_multiprocessingrJ �removerD rF r� r� r� r. rE �get_cloud_config_value�osrP r, �glob�isfiler~ �dictr` Z remove_key�basename�printr( � enumerate�input�int� ValueErrorrH r �lower� startswithr )rO r� r� Z processed�matchingZvms_to_destroy� parallel_datar� r� r= r� rQ r4 � output_multipZ ret_multip�objr] r r� � minion_dict�key_fileZglobbed_key_file�idx�filenameZ selection�deleter r r r� � s ����� � �� � � � � ��� ���� ��� � �z Cloud.destroyc C s� g }| � � }i }|�� D ]\}}g ||< |D ] }||v r#|| �|� qq |�� D ]\}}|� d�} |D ]} |�| | j| | �i� q4q)|S )z& Reboot the named VMs z.reboot)rq rI r� r� ) rO r� r r� Zacts�prov�nodes�nodeZnames_r] rQ r r r �reboot` s �� �z Cloud.rebootT� c C s� i }t jjd|| ji d�}|d �d�\}}|� d�}|| jvr.t�d|d |d |� dS t j�d || j�} t j�d || j�} | ry| sPd |vrPt�d |d � d |vrxd|vrxt� d|d � t j j � t j�d|| j��\} } | |d < | |d< nd|d < d|d< |� d|d �} |� d�}|� d�r�|r�||d< d|v r�d�| |d g�} | du r�d|vr�d|vr�t� d|d � t j j � t j�d|| j��\}}||d< ||d< |du r�| du r�t j j �| jd |d | � t j�d|| j�|d < z t j�d || j�|d < W n t�y Y nw z�|d �d�\}}|� d�}t j jj| j| d�||g�d �� | j| |�}W d � n 1 �s>w Y |d u�r�d | jv �r�| jd �rf| jd d!v�rft�d"� d#| jd < t�|� t�� d$ }t�� |k �r�t�t jj�}d%�| jd& �d%�dd'� �}|�t j�tj�|d ��� t j j |d(��,}|j |d d)� | jd �| jd* d+�}|�r�t� d,|� W d � nW d � n 1 �s�w Y t�� |k �sxW n t�y� } zt�!d-|d |� W Y d}~nd}~ww z| jd. }W n t�y d }Y nw | jd/ �r[| jd0 �r[|�s[t� d1| jd0 |d � t j j | jd(��}|j |d | jd0 | jd* d$ d+�}W d � n 1 �sRw Y ||d2< |S )3z$ Create a single VM r� r� r? r@ z.create�TCreating '%s' using '%s' as the provider cannot complete since '%s' is not availablerQ NrT � make_master�masterz2There's no master defined on the '%s' VM settings.�pub_key�priv_key� Generating minion keys for '%s'�keysizer� �domainZuse_fqdnZ append_domainr� T� master_pub� master_pemz#Generating the master keys for '%s'r� Zscriptr� Z inline_scriptr� FZsync_after_install)r� Zbeaconsr� ZenginesZ executors�grainsr) Zmatchers�modulesr� ZpillarZ proxymodulesZ renderersZ returnersZsdbZ serializersZstatesZthoriumrF z6Bad option for sync_after_install. Defaulting to 'all'r� �< �/� conf_file���)Zmoptszsaltutil.sync_{}�timeout)r z.Synchronized the following dynamic modules: %sz>Failed to create VM %s. Configuration value %s needs to be setr+ rS � start_action�Running %s on %sr )"rD rE r� rC rK r� r) r* �warningr� rF r` �gen_keysr, r. Z accept_key�KeyErrorr� r� r0 r1 rY �deepcopyZDEFAULT_MASTER_OPTSrJ Z master_configr� rP �client�get_local_client�cmdr( r� � exception)rO r� � local_masterZ sync_sleepr� r� r� r= r] rT r� �priv�pubZkey_idr� Z master_privr� r Zexpiration_timeZmopts_Z conf_pathr r �excZopt_mapZ action_outr r r r� s s� � � ��� � �� � ���� ���� ������� � �z Cloud.createc C s> |� � }tjj�||�}tjj�||�}|�|� | |d< |S )a Create vm config. :param str name: The name of the vm :param dict main: The main cloud config :param dict provider: The provider config :param dict profile: The profile config :param dict overrides: The vm's config overrides rQ )rY rD rF � dictupdaterJ )rQ �mainr? rA � overridesZvmr r r � vm_config s zCloud.vm_configc C s� i }|d � d�\}}d�||d �}|| jvr&t�d|d |d |� dS z-tjjj| j| |d d�� | j| d i |��}W d � W |S 1 sLw Y W |S t yu } zt� d |d |d |d |� W Y d}~|S d}~ww ) z Extra actions r? r@ �{}.{}r� r� rQ Nr� zEFailed to perform %s.%s on %s. Configuration value %s needs to be setr ) rK r( r� r) r* rD rF r� r� r r )rO r� r� r� r= r] r r r r r� ! s> �� � � ����z Cloud.extrasc C s� || j d vrd|� d�}t�|� d|iS i }|s i }z(tjj�| j d d��}tjj�|�}W d � n1 s:w Y |sCi }W n t yO i }Y n t yY i }Y nw |du r`i }| � � }| j d | } i } |� � D ])\} } t t| ��} || | D ]}|| | | | |< | | | d< | | | d < q�qq| d �d �\}}| j d | | �� }|d= |D ]�}|| v r�| | d } | | d }|� d | � d |� �}t�|� d|i||< q�| �|||| |�}| j d �rtj| j|fd�}|�� dd�|j�i||< q�z;| �|�||< || �s#ddi||< t|�dk�r!td��W q�| j �dd�du �r=t|| t ��r=|| � dd� W q� tt f�yc } zt|�dk�rQ� dt |�i||< W Y d}~q�d}~ww |S )zl Parse over the options passed on the command line and determine how to handle them r> zProfile z is not defined�Errorr �rNr? r= r@ r< z already exists under rS )r2 r Z Provisioningz)VM being provisioned in parallel. PID: {}zFailed to deploy VMr rU F� deploy_kwargs) rC r) r* rD rF �files�fopenZyamlZ safe_loadr �OSErrorrq rI rL rM rK rY r r$ ZProcessr� �startr( �pidr� r r, r~ r� rH r r )rO rA r� r} r7 r ZmccZmain_cloud_configr� �profile_detailsr� r� �valZ prov_namer� r� r= �provider_detailsrQ Zdrivr� �processr r r r r� B s� �� � � � �� � ��zCloud.run_profilec C sj i }i }t |�}| �� �� D ]�\}}|s n�|�� D ]�\}}|s" n�d} d�|| jd �} | | jvr:t�d| � d} |�� D ]�\} } |sF n�| |vrit| t �sQi } d| v r`| d |v r`| d } n t� d| ||� q>| du r�|� | �du r{|� | g i� || � | � q>tjjj| j| d �||g�d ��M ||vr�i ||< ||| vr�i || |< tjjjdi |��}|r�| j| | |dd �|| | | < n| j| | dd �|| | | < |�| � W d � n1 s�w Y q>qqt � } |�r ||d < t � }|�� D ] \}}|�t |��}q�|�|�} | �r t| �|d < t|�|d< |�s"|S | �r'|S t|�|d< t|�|d < |S )zX Perform an action on a VM which may be specific to this cloud provider Tr r� z)'%s()' is not available. Not actioning...Fr� z-vm:%s in provider:%s is not in name list:'%s'Nr@ r� ��callzInvalid Actionsr� zNot Actioned/Not Runningr )r� rq rI r( rC r� r) r� r~ r� r� r, rJ r� rD rF r� r� r. r Z clean_kwargsr� �union� difference�list)rO r� r r Zinvalid_functionsr� r� r= r� Zvalid_functionr] r� r� Z missing_vmsZinvalid_func_vms�keyr# r r r r� � s� � � �� �� zCloud.do_actionc C s | � |�}t|�dkrtd�|d�dd� |D �����|�� \}}|� d|� �}|| jvr6td�|||���t�d||� t j j j | j| d �||g�d ��* |re||| j| d |d �iiW d � S ||| j| d d�iiW d � S 1 s{w Y d S )z= Perform a function against a cloud provider r z=More than one results matched '{}'. Please specify one of: {}r� c S s g | ] \}}|� d |� ��qS )r@ r )r r� r= r r r r" s z%Cloud.do_function.<locals>.<listcomp>r� zUThe '{}' cloud provider alias, for the '{}' driver, does not define the function '{}'z4Trying to execute '%s' with the following kwargs: %sr@ r� �function)r' r Nr& ) r� r� r r( r. rH r� r) r� rD rF r� r� )rO r� r r r� r� r= r] r r r r� � s2 �� ����$�zCloud.do_functionc C s< | j d �� �� D ]�\}}|�� D ]r}|� d�}|| jvrIt�d|||||� | j d | �|� || j d vr9q| j d | sH| j d �|� qtjj j | j| d� ||g�d��! | j| � du rtt�d||� | j d | �|� W d � n1 s~w Y q|| j d vr�q | j d | s�| j d �|� q dS ) zV Remove any mis-configured cloud providers from the available listing r< z.get_configured_provideraN The cloud driver, '%s', configured under the '%s' cloud provider alias, could not be loaded. Please check your provider configuration files and ensure all required dependencies are installed for the '%s' driver. In rare cases, this could indicate the '%s()' function could not be found. Removing '%s' from the available providers listr@ r� Fz�The cloud driver, '%s', configured under the '%s' cloud provider alias is not properly configured. Removing it from the available providers list.N) rC rY rI r� r) r rH rD rF r� r� r. )rO r� r� r= r] r r r Z __filter_non_working_providers sJ ���� ����z$Cloud.__filter_non_working_providers�rm F)rm FN)r� �F)Tr� r� ) r� r� r� r� rR r� r� r� r� rq r� r� rk ri rd r� r� r� r� r� r� � staticmethodr r� r� r� r� r� r r r r r� � s: + %A �9 " ) ( ( + !V` r� c @ s` e Zd ZdZdd� Zddd�Zdd d �Zd d � Zd d� Zddd�Z dd� Z ddd�Z dd� Z dS )ra z3 Create a VM stateful map execution object c C s t �| |� | �� | _d S r� )r� rR �read� rendered_mapr� r r r rR S s z Map.__init__rm Fc C sz | � � �� }i }|�� D ]�\}}t|�}|| jd vr8d|vr#i |d< d�|d�|��}t�|� ||d |< q | � |||�} | �� D ]B\} } | �� D ]9\} } | �� D ]0\}}| |vr_i || < | || vrki || | < ||| | |< z|� |� W qS t y� Y qSw qKqC|s�q | jd | }|d � d�\} } |D ] }| |vr�i || < | || vr�i || | < d|| | |< q�q |S )Nr> �ErrorszBNo provider for the mapped '{}' profile was found. Skipped VMS: {}r� r? r@ �Absent) r0 rY rI r� rC r( r. r) r� r� r� r rK )rO rs r� r1 �interpolated_maprA Z mapped_vmsr� r7 r� r� r� r= r� r� r� r" r r r r4 W sR � ��� �zMap.interpolated_mapNc C s� | j |d�}|�� �� D ]B\}}|dkrq |�� �� D ])\}}|�� �� D ]\}}|dkr6|| | �|� q%|| | sD|| �|� q|| sN|�|� q |S )N)rs r2 r3 )r4 rY rI rH ) rO rs � query_mapr� r� r= r� r� r� r r r � delete_map� s � � �zMap.delete_mapc C s� | � d�}dgddgddgd�}g }|�� D ]>\}}|�� D ]5\}}|�� D ],\} } z|| } W n ty@ t�d|� t� �w | dkrR| d �� | v rR|�| � q&q q|S ) Nrm �stoppedZrunningZactive)r �stopr� zxThe use of '%s' as an action is not supported in this context. Only 'start', 'stop', and 'reboot' are supported options.r3 �state)r4 rI r r) r* r r� r� ) rO r� r5 Zmatching_statesZvm_namesr� r� r= r� r� r� Z state_actionr r r �get_vmnames_by_action� s2 � �� ���zMap.get_vmnames_by_actionc C s d}| j �dd�du rH| j �dd�du rB| j �dd�du r n�| j �d�| j �d�vr6t�d| j d � t� �| j d | j �d� }n�| j d }n�t�| j �}d|d< tj� |�| _t j � | j d �sv| j d � d �svt�d | j d � t� �| j d � d �r�| jjd | j d �}n| j d }z%| j �d d �}tj�| j i �}| j �d�}| j �d�}t|||||�}W n! ty� } ztjd| j d |tjd� i W Y d}~S d}~ww d|v r�tjj|| j d dd�}|s�i S |�� �� D ]�\} } t| ttf��rNi } | D ]H} t| t��r | di} | �� D ]6\} }|du �s t|t ��r!i }z|� d| � W n t �y@ t�d� i Y S w || | < �q�q | || < q�t| t ��roi } | �� D ]\} }|� d| � || | < �qZ| || < q�t| t��rx| g} i || < | D ] } d| i|| | < �q~q�|S )zH Read in the specified map and return the map structure Nr+ r� Z map_pillarrB z8The specified map not found in pillar at 'cloud:maps:%s'�localZ file_clientzsalt://z+The specified map file does not exist: '%s'z cp.cache_file�rendererz jinja|yamlZrenderer_blacklistZrenderer_whitelistz)Rendering map %s failed, render error: %sr� �includeF)�verboserQ z�Cannot use 'name' as a minion id in a cloud map as it is a reserved word. Please change 'name' to a different minion id reference.) rC r, r) r* r rY r rD r� Z MasterMinionr� rP r� r� Z functionsr� Zrenderr r r� r� rE Zinclude_configrI r~ r* �tupler �bool� setdefault�AttributeErrorr� )rO �map_Zlocal_minion_optsZ cached_mapr< ZrendZ blacklistZ whitelistr rA Zmapped�entries�mappingrQ r r r r r0 � s� � � ���� �� � �zMap.readc C s� |d u r6|d � � D ])}g }z|d }W n ty g }Y nw |D ]}| j|t|�|d�r2 dS q"q dS ||v r<dS |�|� z |d | d }W n tyV g }Y nw |D ]}| j|t|�|d�rh dS qYdS )Nr� �requires)�seenr# TF)rZ r � _has_loopr* r� )rO r� rG r# rZ Zmachines�machiner r r rH & s6 ���� ��z Map._has_loopc C s� z|d }W n t y | Y S w g }|D ]:}z|d | }W n$ t yD z|d | }W n t yA d}t�|� t|��w Y nw |�| �||||�� qt|�d }|S )NrF r� �existingz Missing dependency in cloud mapr )r r) r* r r� �_calcdep�max) rO r� rI rb �levelZdeplistZlevelsrQ r7 r r r rK @ s, � ��� z Map._calcdepc s di i}| j |d�� t� }t� }t�| j�}|�� D ]�\}}|| jd vrGd�|d�dd� |D ���}t � |� d|vr@i |d< ||d |< q| jd � |�} |�� D ]�\} } d | v rn| d | d krn| � d �� d �\} } n | � d �� d �\} } t�| jd | | �}|d= t jj�|| � t�|�}d D ]}d |� �}|| v r�t �d|| |� | �|�| |< q�d| v r�d|v r�d| d v r�d|d v r�|d d �| d d � | d d= | d s�| d= t jj�|| �}||d | < |d � d �\} } |�| | | f� qSq� fdd�}� �� D ]\\} }|�� D ]R\} }|�� D ]H\}}|�| | |f� ||d v�r.�q||�}|�s7�q|D ]&}||d v�rD n t �d|� d|v�rSi |d< |d �|�|d |< �q9�q�q�q d| jv �r�| jd �r�| jd du �r~td��|�|�|d< |S )z9 Create a data map of what to execute on r� r� r> zjThe required profile, '{}', defined in the map does not exist. The defined nodes, {}, will not be created.r� c s s � | ] }d |� d �V qdS )r� Nr )r r� r r r � <genexpr>c s � z Map.map_data.<locals>.<genexpr>�errorsr? r@ r< )r r� r� ZvolumesrF rC z�The use of '%s' on the '%s' mapping has been deprecated. The preferred way now is to just define '%s'. For now, salt-cloud will do the proper thing and convert the deprecated mapping into the preferred one.r� r c sZ i }� � � D ]$\}}|� � D ]\}}|� � D ]\}}|| kr(||vr(|d ||< qqq|S )Nr9 )rI )rQ r� r� r� r= r� r� r� �r� r r �get_matching_by_name� s ���z*Map.map_data.<locals>.get_matching_by_namez0%r already exists, removing from the create map.rJ ZhardZenable_hard_mapsFz�The --hard map can be extremely dangerous to use, and therefore must explicitly be enabled in the main configuration file, by setting 'enable_hard_maps' to Truer� )rq r� rY r r1 rI rC r( r. r) r* r, rK rD rF r rJ r rH r� r r) )rO r� r ZexistZdefinedr1 Z profile_namer� r7 Z profile_data�nodenamer r� r= r$ ZnodedataZsettingZ deprecatedrQ r� r� rQ r� r� �itemr rP r r� T s� �� � � � 8 � ����z Map.map_datac $ C s| | � |�rd}t�|� t|��|d �� D ]#\}}t�d|� d}| �||||�}t�d||� ||d | d< qz|d �� }W n tyO i �� }Y nw |D ]#\}}t�d|� d}| �||||�}t�d||� ||d | d< qRt |d �� dd � d �}i }| j d r�g } d } d } d } d } �z^t d d� |D ��\} }| } t�d| � t j �d|| j �du r�td��t�d|d � t jj�t j �d|| j ��\}}||d< ||d< t jj�� }t jj�|d�� }|�|� W d � n1 s�w Y t jjj|| j d d�} t�|� |�dd �d u �r=|� d i � d |d v �r'|d d } d |d v�r=d |d d < | d u�r=| |d!< |D ]F\}}t j jd|| j d d"�}|du �rU�q?t�d#|d � t jj�t j �d|| j ��\}}||d$< ||d%< |� d&i � |d& � ||i� �q?d}|d �d'd��r�|d �d d �d u�r�d }| j ||d(�}t |t ��s�t�d)|� nd*|v �r�td+�!|d* ���| j �d,d�d u �r�|�d-i ��p�|�"d-i �}|�d.|�d/d ��} | d u �r�td0�!| ���||| < W n, t#�y t�d1� tj$�%| j d2 d3�}tj$�&|��r t jjj|| j d d�} Y nw | j �'� }| j d �r3t�d4� d|d5< | d u }|D ]�\}}|| | fv �rF�q9d |v �ra|d �d'd��ra|d �d d �d u�rad }| d u�ro|du �ro| |d!< | d u�r�|� d i � |d � d | � | j d �r�| �(||||d6�� �q9z+| j ||d(�||< | j �d,d�du �r�d-|v �r�t || t ��r�|| �"d-d � W �q9 t�y� } ztjd7||t)j*d8� d9t+|�i||< W Y d }~�q9d }~ww |�d:d;�D ] }| �,|�||< �q�| j d �r�| �r�d<| j v �r | j d< } nt-| �} t�d=| � t.t/| | d>�} | j d? �r�g } d@} t0|d �1� dAd � �D ] \}}| �(g � | dB7 } |D ] } | | �(| d � �qA�q2i }| D ]=}!t�dC| j d? dD�%|!�� t j2�3� � }"|� |"j4dE�%|!�| j d? | j dF dG dHdI�� W d � n 1 �s�w Y �qT| D ]}#|t t5|#�6� �� t t5|#�1� ��dJ< |� |#� �q�|S | D ]}#|� |#� �q�|S )Kz4 Execute the contents of the VM map z,Uh-oh, that cloud map has a dependency loop!r� z Calculating dependencies for %sr z Got execution order %s for %srM rJ c S s | d d S )Nr rM r ��xr r r �<lambda>� s z Map.run_map.<locals>.<lambda>)r+ rS Nc s s, � | ]\}}|� d d�du r||fV qdS )r� FTN)r, )r rQ rA r r r rN � s � ��z Map.run_map.<locals>.<genexpr>zCreating new master '%s'rT FzTCannot proceed with 'make_master' when salt deployment is disabled(ex: --no-deploy).z Generating master keys for '%s'rQ r� r� r� �wZ hash_type)Zsum_type� make_minionTr� r� r� z 127.0.0.1� master_fingerr� r� r� r� Zpreseed_minion_keysr �r z/Master creation details is not a dictionary: %sr2 z?An error occurred while creating the master, not continuing: {}rU r Z salt_host�hostz2Host for new master {} was not found, aborting mapzNo make_master found in mapr� z master.pubziSince parallel deployment is in use, ssh console output is disabled. All ssh output will be logged thoughZdisplay_ssh_output)rC rQ rA r � Failed to deploy '%s'. Error: %sr� r r� r r4 zCloud pool size: %sr� r r c S s | d S )NrM r rT r r r rV � s r r r� r| r r r* )r Ztgt_typer )7rH r) r* r rI r� rK r� r �sortedrC rL rD rE r� r rF r` r r Zmkstempr �writeZcryptZ pem_fingerr� �unlinkr, rA rJ r� r~ r� r( rH � StopIterationrP r. r� rY r� r� r� r r� r� r: �_create_multiprocessingr rZ r r r rM rN )$rO r� r7 r+ r# rM Z existing_listZ create_listr� r� Z master_nameZmaster_minion_nameZ master_hostrY Zmaster_profiler r Zmaster_temp_pubZmtprQ rA rX r �outr r� rC r r4 r� Z actionlist�grprS �groupr r� r r r r� � s� � �� ��� � � � � � � � � � �� ��� � � �� ��� �� � �� �� �� $�z Map.run_mapr- r� )NNr. ) r� r� r� r� rR r4 r6 r: r0 rH rK r� r� r r r r ra N s . s ra c C s t � t jt j� dS )zh Make every worker ignore KeyboarInterrup's since it will be handled by the parent process. N)�signal�SIGINT�SIG_IGNr r r r r� � s r� c C s� d| d d< t | d �}z |j| d | d d�}W n( tyA } z tjd| d |tjd � | d d t|�iiW Y d }~S d }~ww | d �d d �d u rWt |t �rW|� dd � | d t j j�|�iS )z� This function will be called from another process when running a map in parallel mode. The result from the create is always a json object. �jsonrC r� rA r rZ r\ rQ r� r NrU Fr )r� r� r r) r* r� r� r r, r~ r� rH rD rF rb rc )r� r r` r� r r r r �create_multiprocessing� s* �� �� � ri c C s� d| d d< t j�| d �}z3|d�| d � }t jjj|d�| d | d g�d�� || d �}W d � n1 s;w Y W n( tyi } z t j d | d |t j d � | d d t |�iiW Y d }~S d }~ww | d t jj�|�iS )z� This function will be called from another process when running a map in parallel mode. The result from the destroy is always a json object. rh rC r� z {}.destroyr= r@ r� r� rQ Nz Failed to destroy %s. Error: %sr� r )rD r� r� r( rF r� r� r. r r) r* r� r� r rb rc )r� r r� r] r� r r r r �destroy_multiprocessing s0 �� ��� �� rj c C s� t | d �}z?tjjj|j| d d�| d | d g�d�� | d | d tjj�|j| d � �fW d � W S 1 s>w Y W dS t yl } zt j d| d |t j d � | d | d d fW Y d}~S d}~ww ) z` This function will be called from another process when building the providers map. rC r] r@ r� r= r� Nr� r� r )r� rD rF r� r� r� r. rb rc r r) r� r� r� )rb r r` r� r r r � run_parallel_map_providers_query s* ��(� � ��rk c O � t t�| d i |��S �Nr )r rk �r �kwr r r r� < � r� c O rl rm )r rj rn r r r r� @ rp r� c O rl rm )r ri rn r r r ra D rp ra )NNNNNNNr� )0r� rY r� r� r$ r� re r0 r � itertoolsr Z salt.clientrD Z salt.configZ salt.loaderZ salt.syspathsZsalt.utils.argsZsalt.utils.cloudZsalt.utils.contextZsalt.utils.cryptZsalt.utils.dataZsalt.utils.dictupdateZsalt.utils.filesZsalt.utils.userZsalt.utils.verifyZsalt.utils.yamlZsalt.exceptionsr r r r Z salt.templater � getLoggerr� r) r r: r; r� ra r� ri rj rk r� r� ra r r r r �<module> sz �d E h
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings