File manager - Edit - /opt/saltstack/salt/lib/python3.10/site-packages/salt/log_handlers/__pycache__/fluent_mod.cpython-310.pyc
Back
o ;j*B � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddl Zddl m Z e� e �ZdZdaddddddd d d �Zd d � Zdd� Zdd� Zdd� ZG dd� dej�ZG dd� dej�ZG dd� d�ZdS )aX Fluent Logging Handler ====================== .. versionadded:: 2015.8.0 This module provides some fluentd_ logging handlers. Fluent Logging Handler ---------------------- In the `fluent` configuration file: .. code-block:: text <source> type forward bind localhost port 24224 </source> Then, to send logs via fluent in Logstash format, add the following to the salt (master and/or minion) configuration file: .. code-block:: yaml fluent_handler: host: localhost port: 24224 To send logs via fluent in the Graylog raw json format, add the following to the salt (master and/or minion) configuration file: .. code-block:: yaml fluent_handler: host: localhost port: 24224 payload_type: graylog tags: - salt_master.SALT The above also illustrates the `tags` option, which allows one to set descriptive (or useful) tags on records being sent. If not provided, this defaults to the single tag: 'salt'. Also note that, via Graylog "magic", the 'facility' of the logged message is set to 'SALT' (the portion of the tag after the first period), while the tag itself will be set to simply 'salt_master'. This is a feature, not a bug :) Note: There is a third emitter, for the GELF format, but it is largely untested, and I don't currently have a setup supporting this config, so while it runs cleanly and outputs what LOOKS to be valid GELF, any real-world feedback on its usefulness, and correctness, will be appreciated. Log Level ......... The ``fluent_handler`` configuration section accepts an additional setting ``log_level``. If not set, the logging level used will be the one defined for ``log_level`` in the global configuration file section. .. admonition:: Inspiration This work was inspired in `fluent-logger-python`_ .. _fluentd: http://www.fluentd.org .. _`fluent-logger-python`: https://github.com/fluent/fluent-logger-python � N)� LOG_LEVELSZfluent� � � � � � )ZEMERG�ALERTZCRITZERR�WARNINGZNOTICE�INFO�DEBUGc K s* |� dd�}|� dd�}t| ||d�ad S )N�host� localhost�port�^ �r r )�get� FluentSender�_global_sender)�tag�kwargsr r � r �P/opt/saltstack/salt/lib/python3.10/site-packages/salt/log_handlers/fluent_mod.py�setupl s r c C s t S �N)r r r r r �get_global_sendert s r c C s t dtv g�st�d� dS tS )N�fluent_handlerz�The required configuration section, 'fluent_handler', was not found the in the configuration. Not loading the fluent logging handlers module.F)�any�__opts__�logZtrace�__virtualname__r r r r � __virtual__x s �r! c c s � d } }dt v rt d �dd �} t d �dd �}t d �dd �}t d �ddg�}|r0|d nd}|dkr9d}n|d kr@d }n d }t d �d d �}| d u rX|d u rXt�d� n't|||d�}t|| |d�}|�|� |�tt d �dt �dd�� � |V | d u r�|d u r�dV d S d S d S )Nr r r � payload_type�tags�saltr Zgraylog�gelfg�������?Zlogstash�version� z�The required 'fluent_handler' configuration keys, 'host' and/or 'port', are not properly configured. Not enabling the fluent logging handler.)r" r& r# r Z log_level�errorF) r r r �debug�MessageFormatter� FluentHandler� setFormatter�setLevelr )r r r" r# r r& � formatterr r r r �setup_handlers� sD ��� ��� �r/ c sH e Zd Zd� fdd� Zddd�Zdd� Zdd � Zd d � Zd d � Z� Z S )r* Nc sx || _ || _|r |d nd| _|| _|r|n|| _|r |n|| _d|� d|� ��dd�}t| |�| _t � j d d d� d S )Nr r$ Zformat_Z_v�.�_)�fmt�datefmt) r" r& r r# �msg_path�msg_type�replace�getattr�format�super�__init__)�selfr" r& r# r5 r4 Z format_func�� __class__r r r: � s zMessageFormatter.__init__c C s. | j dkr|jS tj�|j��� d d� d S )Nr% ����Z)r" �created�datetime�utcfromtimestamp� isoformat)r; �recordr3 r r r � formatTime� s zMessageFormatter.formatTimec C s� |� � | �|�t�|jd�| jd�}|jr"| �|j�}|�d|i� |j � � D ]'\}}|dv r0q'|du s?t |t t ttttf�rB|}nt|�}|�|� |i� q'|S )a Graylog 'raw' format is essentially the raw record, minimally munged to provide the bare minimum that td-agent requires to accept and route the event. This is well suited to a config where the client td-agents log directly to Graylog. r )�message� timestamp�levelr � full_message��args�asctimeZ bracketlevelZ bracketnameZbracketprocessr@ �exc_info�exc_text�id� levelname�levelno�msecsrR rF �msg�relativeCreatedr& N)� getMessagerE � syslog_levelsr rP r rM �formatException�update�__dict__�items� isinstance�str�bool�dict�float�int�list�repr�r; rD � message_dictrM �key�value�valr r r �format_graylog_v0� s � z"MessageFormatter.format_graylog_v0c C s� | j tjj�� |�� | �|�t�|j d�| j d�}|j r)| � |j �}|� d|i� |j�� D ])\}}|dv r7q.|du sFt|ttttttf�rI|}nt|�}|� d|� �|i� q.|S )z� If your agent is (or can be) configured to forward pre-formed GELF to Graylog with ZERO fluent processing, this function is for YOU, pal... r )r& r Z short_messagerG rH Z_tagrI rJ Nr1 )r& r$ �utils�network�get_fqhostnamerU rE rV r rP r rM rW rX rY rZ r[ r\ r] r^ r_ r` ra rb rc r r r �format_gelf_v1_1� s$ � z!MessageFormatter.format_gelf_v1_1c C s� t jj�� }| �|�|j|j|j|j|j |j |j |j d�|� � | j� d|� d| j� �|| j| j| jd�}|jrA| �|j�|d d< |j�� D ].\}}|dv rOqF|du rZ||d |< qFt|ttttttf�rl||d |< qFt |�|d |< qF|S ) �G Messages are formatted in logstash's expected format. )rP �logger�lineno�pathname�process� threadName�funcName� processNamez://�/)� @timestamp�@fieldsz@messagez@sourcez @source_hostz @source_pathz@tagsz@typerw rM �rK rL r@ rM rN �filenamers rO rP rQ ro �modulerR rR rF rS �namerp rq rt rT �threadrr N) r$ ri rj rk rE rP r{ ro rp rq rr rs rt rU r5 r4 r# rM rW rY rZ r[ r\ r] r^ r_ r` ra rb )r; rD r rd re rf r r r �format_logstash_v0% s> � � z#MessageFormatter.format_logstash_v0c C s� d| � |�tjj�� |j|j|j|j|j |j |j |j |� � | j| jd�}|jr/| �|j�|d< |j�� D ](\}}|dv r=q4|du rF|||< q4t|ttttttf�rV|||< q4t|�||< q4|S )rm r' )z@versionrv r rP rn ro rp rq rr rs rt rF r# �typerM rx N) rE r$ ri rj rk rP r{ ro rp rq rr rs rt rU r# r5 rM rW rY rZ r[ r\ r] r^ r_ r` ra rb )r; rD rd re rf r r r �format_logstash_v1j s8 �z#MessageFormatter.format_logstash_v1)NNr ) �__name__� __module__� __qualname__r: rE rh rl r} r � __classcell__r r r< r r* � s 13Er* c @ s* e Zd ZdZd dd�Zdd � Zd d � Zd S )r+ z% Logging Handler for fluent. r r � @Fc C s* || _ t|||||d�| _tj�| � d S )N)r r �timeout�verbose)r r �sender�logging�Handlerr: )r; r r r r� r� r r r r: � s �zFluentHandler.__init__c C s | � |�}| j�d |� d S r )r8 r� �emit)r; rD �datar r r r� � s zFluentHandler.emitc C s8 | � � z| j�� tj�| � W | �� d S | �� w r )�acquirer� �_closer� r� �close�release�r; r r r r� � s zFluentHandler.closeN)r r r� F)r� r� r� �__doc__r: r� r� r r r r r+ � s r+ c @ sX e Zd Z ddd�Zdd � Zd d � Zd d � Zdd� Zdd� Zdd� Z dd� Z dS )r r r � r� Fc C sf || _ || _|| _|| _|| _|| _d | _d | _t� � | _ z| � � W d S t y2 | � � Y d S w r )r r r �bufmaxr� r� �socket�pendings� threading�Lock�lock� _reconnect� Exceptionr� )r; r r r r� r� r� r r r r: � s �zFluentSender.__init__c C s t t�� �}| �|||� d S r )r` �time�emit_with_time)r; �labelr� Zcur_timer r r r� � s zFluentSender.emitc C s | � |||�}| �|� d S r )� _make_packet�_send)r; r� rG r� �bytes_r r r r� � s zFluentSender.emit_with_timec C sB |r d� | j|f�}n| j}|||f}| jrt|� tjj�|�S )Nr0 )�joinr r� �printr$ ri ZmsgpackZpackb)r; r� rG r� r Zpacketr r r r� � s zFluentSender._make_packetc C s2 | j �� z | �|� W | j �� d S | j �� w r )r� r� �_send_internalr� �r; r� r r r r� � s zFluentSender._sendc C s� | j r | j |7 _ | j }z| �� | j�|� d | _ W d S ty? | �� | j r9t| j �| jkr9d | _ Y d S || _ Y d S w r )r� r� r� �sendallr� r� �lenr� r� r r r r� � s �zFluentSender._send_internalc C s� | j s@| j�d�r$t � t jt j�}|�| j� |�| jtd�d � � nt � t j t j�}|�| j� |�| j| j f� || _ d S d S )Nzunix://) r� r � startswith�AF_UNIX� SOCK_STREAM� settimeoutr� �connectr� �AF_INETr )r; �sockr r r r� s �zFluentSender._reconnectc C s | j r| j �� d | _ d S r )r� r� r� r r r r� s zFluentSender._closeN)r r r� r� F) r� r� r� r: r� r� r� r� r� r� r� r r r r r � s � r )r� rA r� Zlogging.handlersr� r� r� Zsalt.utils.msgpackr$ Zsalt.utils.networkZ salt._loggingr � getLoggerr� r r r rV r r r! r/ � Formatterr* r� r+ r r r r r �<module> s< J � - }
| ver. 1.4 |
Github
|
.
| PHP 8.2.30 | Generation time: 0 |
proxy
|
phpinfo
|
Settings