| Current File : //lib/python2.7/site-packages/sos/archive.pyc |
�
u��ec @ s d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m
Z
m Z y d d l Z Wn e
k
r� n Xd d l Z e j r� e Z n d Z d Z d Z d Z d e f d � � YZ d
e f d � � YZ d e f d
� � YZ d S( i����N( t Lock( t sos_get_command_outputt
is_executablet filet linkt nodet dirt Archivec B s� e Z d Z e d � � Z e j d � Z d Z e Z
e � Z d � Z
d � Z d � Z d � Z d � Z d � Z d d
� Z d d � Z d
� Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( s! Abstract base class for archives.c C s | j S( s6 Returns the archive class's name as a string.
( t __name__( t cls( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt archive_type* s t sost unsetc C s d | j � | f S( Ns [archive:%s] %s( R
( t selft msg( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt _format_msg7 s c C s
| | _ d S( N( t _debug( R
t debug( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt set_debug: s c C s | j j | j | � � d S( N( t logt errorR ( R
R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt log_error= s c C s | j j | j | � � d S( N( R t warningR ( R
R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt log_warn@ s c C s | j j | j | � � d S( N( R t infoR ( R
R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt log_infoC s c C s* | j s
d S| j j | j | � � d S( N( R R R R ( R
R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt log_debugF s c C s
t � d S( N( t NotImplementedError( R
t srct dest( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt add_fileN s t wc C s
t � d S( N( R ( R
t contentR t mode( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt
add_stringQ s c C s
t � d S( N( R ( R
R R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt
add_binaryT s c C s
t � d S( N( R ( R
t sourcet link_name( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt add_linkW s c C s
t � d S( N( R ( R
t path( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt add_dirZ s c C s
t � d S( N( R ( R
R' R! t device( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt add_node] s c C s
t � d S( s� Return a temporary directory that clients of the archive may
use to write content to. The content of the path is guaranteed
to be included in the generated archive.N( R ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt get_tmp_dir` s c C s
t � d S( s� Return the maximum file name length this archive can support.
This is the lesser of the name length limit of the archive
format and any temporary file system based cache.N( R ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt name_maxf s c C s d S( sT Return a string representing the path to the temporary
archive. For archive classes that implement in-line handling
this will be the archive file itself. Archives that use a
directory based cache prior to packaging should return the
path to the temporary directory where the report content is
locatedN( ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt get_archive_pathl s c C s d S( s: Clean up any temporary resources used by an Archive class.N( ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt cleanupu s c C s | j � d S( s Finalize an archive object via method. This may involve creating
An archive that is subsequently compressed or simply closing an
archive that supports in-line handling. If method is automatic then
the following methods are tried in order: xz, bz2 and gzipN( t close( R
t method( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt finalizey s N( R t
__module__t __doc__t classmethodR
t loggingt getLoggerR t _namet FalseR R t
_path_lockR R R R R R t NoneR R" R# R& R( R* R+ R, R- R. R1 ( ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR ' s. t FileCacheArchivec B s� e Z d Z d Z d Z d Z d � Z d � Z d � Z d d � Z d e d � Z d d � Z
d d
� Z d � Z d � Z d
� Z d � Z d � Z d � Z d � Z d d � Z d � Z d � Z d � Z d � Z RS( sd Abstract superclass for archive types that use a temporary cache
directory in the file system. t c C s� | | _ | | _ | | _ | | _ | | _ | | _ t j j | | � | _ | j
� t j | j d � Wd QX| j d | j f � d S( Ni� s* initialised empty FileCacheArchive at '%s'(
R7 t _tmp_dirt _policyt _threadst enc_optst sysroott osR' t joint
_archive_rootR9 t makedirsR ( R
t namet tmpdirt policyt threadsR@ RA ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt __init__� s
c C s= t j j | � r' | j t j � } n t j j | j | � S( N( RB R' t isabst lstript sepRC RD ( R
RF ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt dest_path� s c C sL | j | j � r | S| d t j k r6 | d } n t j j | j | � S( Ni i ( t
startswithRA RB RM R' RC ( R
R' ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt join_sysroot� s
i� c sa | j d | � | j � | } � f d � } | j d � sG | } n7 t j j | j | � � rh | n t j j | � d } | } g } xG | d k r� | d k r� t j j | � \ } } | j | � | } q� W| j � � }
d } xp| D]h} t j j
|
| � }
| |
� s q� n t j j
| | � } t j j |
� s� | j d |
� t j j | � r/t j j | � r/t j
| � }
t j j | � d } t j j
| |
� } | j | d | �} t j j | � } t j j |
� rt j j |
| � }
n | j d |
|
f � t j |
|
� qY| j d |
� t j |
| � | } q� q� W| S(
s� Create leading path components
The standard python `os.makedirs` is insufficient for our
needs: it will only create directories, and ignores the fact
that some path components may be symbolic links.
:param src: The source path in the host file system for which
leading components should be created, or the path
to an sos_* virtual directory inside the archive.
Host paths must be absolute (initial '/'), and
sos_* directory paths must be a path relative to
the root of the archive.
:param mode: An optional mode to be used when creating path
components.
:returns: A rewritten destination path in the case that one
or more symbolic links in intermediate components
of the path have altered the path destination.
s Making leading paths for %sc s | j t j j � d � � S( s> Test whether path ``path`` is inside the archive.
R< ( RO RB R' RC ( R' ( t root( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt
in_archive� s t /i R< s Making path %sR! s Making symlink '%s' -> '%s's Making directory %s( R RD RO RB R' t isdirRP t splitt appendt reverseRC t existst islinkt readlinkt _make_leading_pathst normpathRK t relpatht symlinkt mkdir( R
R R! R RR t src_dirR' t
path_compst headt tailt abs_patht src_patht compt targett
target_dirt
target_src( ( RQ s/ /usr/lib/python2.7/site-packages/sos/archive.pyR[ � sN !
$
c
C s� | p | j | � } | t k r* | } n t j j | � d } | sJ | St j j | � r� t j j | � r� t d | � � nJ t j j | � s� | t k r� | n t j j | � d } | j | � n d � } | r� | St j j | � r�t j | � } d } | t
k r>t j | j
� r>t | | d f � � n | t k rvt j | j
� rvt | | d f � � n | t k r�| | j
� r�t | | d f � � n | t k r�t j | j
� r�t | | d f � � n d S| S(
s4 Check a new destination path in the archive.
Since it is possible for multiple plugins to collect the same
paths, and since plugins can now run concurrently, it is possible
for two threads to race in archive methods: historically the
archive class only needed to test for the actual presence of a
path, since it was impossible for another `Archive` client to
enter the class while another method invocation was being
dispatched.
Deal with this by implementing a locking scheme for operations
that modify the path structure of the archive, and by testing
explicitly for conflicts with any existing content at the
specified destination path.
It is not an error to attempt to create a path that already
exists in the archive so long as the type of the object to be
added matches the type of object already found at the path.
It is an error to attempt to re-create an existing path with
a different path type (for example, creating a symbolic link
at a path already occupied by a regular file).
:param src: the source path to be copied to the archive
:param path_type: the type of object to be copied
:param dest: an optional destination path
:param force: force file creation even if the path exists
:returns: An absolute destination path if the path should be
copied now or `None` otherwise
i s' path '%s' exists and is not a directoryc S s: t t j | � t j | � t j | � t j | � g � S( N( t anyt statt S_ISBLKt S_ISCHRt S_ISFIFOt S_ISSOCK( R! ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt
is_special. s
s path '%s' exists and is not a %ss regular files
symbolic links special filet directoryN( RN t P_DIRRB R' RU RX RT t
ValueErrorR[ t lstatt P_FILERk t S_ISREGt st_modet P_LINKt S_ISLNKt P_NODEt S_ISDIRR: (
R
R t path_typeR t forcet dest_dirR` Rp t stt ve_msg( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt _check_path� s8 %
( c C s� | j ��| s | } n | j | t � } | s5 d St | d d � s�y t j | | � Wnn t k
r� } | j d � s� | j d � r� q� | j d | | f � n$ t
k
r� } | j d | � n Xy� t j | � } | j d � s� | j d � r.t j
| | � t j | d | j | j f �n t j | | � t j | | j | j � Wn* t k
r�} | j d | | f � n Xd | } nI | j d � t | d
� �% } x | D] } | j | � q�WWd QXd } | j d | | j f � Wd QXd S(
Nt reads /sys/s /proc/s caught '%s' copying '%s's File not collected: '%s't nss& caught '%s' setting attributes of '%s's '%s'i R s open files! added %s to FileCacheArchive '%s'( R9 R� Ru t getattrR: t shutilt copyt IOErrorRO R t OSErrorRB Rk t copymodet utimet st_atime_nst st_mtime_nst copystatt chownt st_uidt st_gidt ExceptionR t seekt opent writeRD ( R
R R t eRk t file_namet ft line( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR J sB
"
R c C s� | j �� | } | j | t d t �} t j | | d d �} t | t � rd | j d d � } n | j | � t
j j | � r� y t
j | | � Wq� t k
r� } | j d | | f � q� Xn | j d | | j f � Wd QXd S( NR} t encodings utf-8t utf8t ignores! Unable to add '%s' to archive: %ss- added string at '%s' to FileCacheArchive '%s'( R9 R� Ru t Truet codecsR� t
isinstancet bytest decodeR� RB R' RX R� R� R� R R RD ( R
R R R! R R� R� ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR" { s
c C so | j �` | j | t � } | s& d St j | d d d �} | j | � | j d | | j f � Wd QXd S( Nt wbR� s, added binary content at '%s' to archive '%s'( R9 R� Ru R� R� R: R� R RD ( R
R R R� ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR# � s
c C s> | j d | | f � | j �c | j | t � } | s= d St j j | � s t j | | � | j d | | | j f � n Wd QX| j d | | | f � t j j | � } t j j
t j j | | � � } | j | � } d � } t j j
| � s-t j j | � r�| } t j j | � } t j j | t j | � � } t j j | | � } | | | � r�| j d | | f � d S| j d | | f � | j | | � q-t j j | � r�| j d | � | j | � q-t j j | � r| j d | � | j | � q-| j d | | f � n | j d
� d S( Ns adding symlink at '%s' -> '%s's- added symlink at '%s' to '%s' in archive '%s's. Link follow up: source=%s link_name=%s dest=%sc S s� t j j | � } t j j | � sH t j j t j j | | � � } n t j j | � } | | k rj t Sy t j | � Wn) t k
r� } | j d k r� t S� n Xt
S( s� Return ``True`` if the symbolic link ``link_name`` is part
of a file system loop, or ``False`` otherwise.
i( ( RB R' t dirnameRK t realpathRC R� Rk R� t errnoR8 ( R% R$ t link_dirR� ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt is_loop� s $ s# Link '%s' - '%s' loops: skipping...s' Adding link %s -> %s for link follow ups Adding dir %s for link follow ups! Adding file %s for link follow ups) No link follow up: source=%s link_name=%ss leaving add_link()( R R9 R� Rx RB R' t lexistsR^ RD R� R� RC RN RX RY RZ R] R& RT R( t isfileR ( R
R$ R% R t
source_dirt host_path_namet dest_path_nameR� R~ ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR& � sJ
! c C s$ | j � | j | t � Wd QXd S( sm Create a directory in the archive.
:param path: the path in the host file system to add
N( R9 R� Rr ( R
R' ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR( � s
c C s� | j | t � } | s d St j j | � s� y t j | | | � WnL t k
r� } | j t j k r� d } | j d | | f � d S| � n Xt
j | | � n d S( Ns Operation not permitteds add_node: %s - mknod '%s'( R� Rz RB R' RX t mknodR� R� t EPERMR R� R� ( R
R' R! R) R R� R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR* � s
c C s7 d t j k r/ t j d } t j | j | � Sd Sd S( Nt PC_NAME_MAXi� ( RB t pathconf_namest pathconfRD ( R
t pc_name_max( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR, � s
c C s | j S( N( RD ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR+ s c C s | j S( N( RD ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR- s c C sC t j t j j | j | � d | �| j d | | j f � d S( ss Create path, including leading components.
Used by sos.sosreport to set up sos_* directories.
R! s2 created directory at '%s' in FileCacheArchive '%s'N( RB RE R' RC RD R ( R
R' R! ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyRE s % c C s+ | j | � } t j | d d d d d �S( Nt rR� s utf-8t errorsR� ( RN R� R� ( R
R' ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt open_file s c C s, t j j | j � r( t j | j � n d S( N( RB R' RT RD R� t rmtree( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR. s c C s | j d | j | f � | j � | j � | j d | j t j | j � j f � | | _ y | j � } Wn7 t
k
r� } d } | j d | | f � | j � SX| j
d r� y | j | � SWqt
k
r� } d } | j d | | f � | SXn | Sd S( Ns) finalizing archive '%s' using method '%s's built archive at '%s' (size=%d)s+ An error occurred compressing the archive: s %s %st encrypts) An error occurred encrypting the archive:( R RD t _build_archiveR. t
_archive_nameRB Rk t st_sizeR0 t _compressR� R RF R@ t _encrypt( R
R0 t resR� t exp_msg( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR1 s*
c C s, | j d d � } | d 7} d | } d } | j d r[ | d | j d 7} | | 7} n | j d r� d | j d j d d
� } i | d 6} | d 7} d
| } | | 7} n t | d d d | �} | d d k r� | S| d d k r| j d rd } q d } n d | d } t | � � d S( s� Encrypts the compressed archive using GPG.
If encryption fails for any reason, it should be logged by sos but not
cause execution to stop. The assumption is that the unencrypted archive
would still be of use to the user, and/or that the end user has another
means of securing the archive.
Returns the name of the encrypted archive, or raises an exception to
signal that encryption failed and the unencrypted archive name should
be used.
s
sosreport-s secured-sosreport-s .gpgs gpg --batch -o %s t keys --trust-model always -e -r %s t passwords %ss '"R< t sos_gpgs -c --passphrase-fd 0 s! /bin/bash -c "echo $sos_gpg | %s"t timeouti t envt statusi s Specified key not in keyrings Could not read passphrases gpg exited with code %sN( t replaceR: R@ R R� ( R
t archivet arc_namet enc_cmdR� t passwdR� R ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR� 5 s,
N( R R2 R3 R= RD R� RJ RN RP R[ R: R8 R� R R" R# R& R( R* R, R+ R- RE R� R. R1 R� ( ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR; � s.
\K 1 H t TarFileArchivec B se e Z d Z d Z e Z d � Z d d � Z d � Z d � Z
d � Z d � Z d � Z
d � Z RS(
s: archive class using python TarFile to create tar archivesc C sP t t | � j | | | | | | � d | _ t j j | | j � � | _ d S( Nt tar( t superR� RJ t _suffixRB R' RC RF R� ( R
RF RG RH RI R@ RA ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyRJ g s
c C sn | j | _ d | j | j d <d | j | j d <| rF | | _ n | j | _ | j | _ | j | _
d S( Ns %.9ft atimet ctime( t st_mtimet mtimet st_atimet pax_headerst st_ctimeR! Rw R� t uidR� t gid( R
t tar_infot fstatR! ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt set_tarinfo_from_statm s c C s� | j t t j j | j � d � } | s8 | j } n y t j | � } Wn t k
r_ | SX| j r� | j
| � } | r� | | j d <q� n | j | | � | S( Ni����s RHT.security.selinux(
RF t lenRB R' RU R7 RD Rk R� t _with_selinux_contextt get_selinux_contextR� R� ( R
t tarinfot orig_pathR� t context( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt copy_permissions_filterz s &
c C s6 y t j | � \ } } | SWn t k
r1 d SXd S( N( t selinuxt
getfileconR� R: ( R
R' t rct c( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR� � s
c C s d | j | j f S( Ns %s.%s( R7 R� ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyRF � s c C s t t | � j � S( N( R� R� R, ( R
( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR, � s c C sX t j | j d d �} | j | j d t j j | j � d d | j �| j
� d S( NR! R t arcnamei t filter( t tarfileR� R� t addRD RB R' RU R7 R� R/ ( R
R� ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR� � s (
c
C se g } xD d d d g D]3 } t | � r8 | j | � q | j d | � q W| j | k rk | j g } n d } t | � } x� | D]� } d | j d d � } | j j | | j � } y� d | | j � f } t
| d
t d d �} | d
r!| j | d � t d | | d
f � � n | j
| 7_
| j � SWq� t k
rV} | } q� Xq� W| � d S( Nt xzt bzip2t gzips# "%s" compression method unavailables No compression utilities found.t .t ipR< s %s %st stderrR� i R� t outputs %s exited with %s( R RV R R0 R� R� R> t get_cmd_for_compress_methodR? RF R R� R R� (
R
t methodsR0 R� t
last_errort cmdt suffixt exec_cmdR� R� ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR� � s0
N( R R2 R3 R: R0 R8 R� RJ R� R� R� RF R, R� R� ( ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyR� a s
( RB R� R� R5 R� R� Rk t threadingR t
sos.utilitiesR R R� t ImportErrort sixt PY3t intt longRu Rx Rz Rr t objectR R; R� ( ( ( s/ /usr/lib/python2.7/site-packages/sos/archive.pyt <module> s.
[� �