| Current File : //lib/python2.7/site-packages/passlib/utils/binary.pyo |
�
�
5Xc @` s� d Z d d l m Z m Z m Z d d l m Z m Z m Z m
Z d d l m
Z
m Z m Z d d l Z e j e � Z d d l m Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z m! Z! m" Z" m# Z# d d l$ m% Z% d d
d d d
d d d d d d d d d d d d d d d d g Z& e! d � Z' e! d � Z( e! d � Z) e! d! � Z* e' e! d" � Z+ e! d# � Z, e! d$ � Z- e! d% � Z. e e d& � � Z/ d' Z0 d( Z1 d" Z2 e3 e e/ � � Z4 e5 d) � Z6 d* � Z7 d+ � Z8 d, Z9 d" Z: d- Z; d. � Z< d/ � Z= d0 � Z
e6 i d1 d2 6d3 d4 6� Z> e2 d5 Z? d6 � Z d e@ f d7 � � YZA d eA f d8 � � YZB eB e) � ZC eB e) d9 eD �ZE eB e* d9 eD �ZF d S(: sC
passlib.utils.binary - binary data encoding/decoding/manipulation
i ( t absolute_importt divisiont print_function( t b64encodet b64decodet b32decodet b32encode( t
b2a_base64t
a2b_base64t ErrorN( t exc( t PY3t
bascii_to_strt iranget imapt iter_byte_charst join_byte_valuest join_byte_elemst
nextgettert suppress_causet ut unicodet unicode_or_bytes_types( t memoized_propertyt BASE64_CHARSt PADDED_BASE64_CHARSt
AB64_CHARSt HASH64_CHARSt BCRYPT_CHARSt HEX_CHARSt LOWER_HEX_CHARSt UPPER_HEX_CHARSt ALL_BYTE_VALUESt compile_byte_translationt ab64_encodet ab64_decodet b64s_encodet b64s_decodeR R t Base64Enginet LazyBase64Enginet h64t h64bigt bcrypt64s@ ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/s@ ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789./s@ ./0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzs@ ./ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789t =t 0123456789abcdefABCDEFt 0123456789ABCDEFt 0123456789abcdefi t t c C` s� | d k r t } n t t | � � } xc | j � D]U \ } } t | t � r_ t | � } n t | t � r� | j d � } n | | | <q5 Wt
j | � S( s�
return a 256-byte string for translating bytes using specified mapping.
bytes not specified by mapping will be left alone.
:param mapping:
dict mapping input byte (str or int) -> output byte (str or int).
:param source:
optional existing byte translation string to use as base.
(must be 255-length byte string). defaults to identity mapping.
:returns:
255-length byte string for passing to bytes().translate.
t asciiN( t Nonet _TRANSLATE_SOURCEt listR t itemst
isinstanceR t ordR t encodet B_EMPTYt join( t mappingt sourcet targett kt v( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR! n s
c C` s t | � j t � S( sr
encode using shortened base64 format which omits padding & whitespace.
uses default ``+/`` altchars.
( R t rstript
_BASE64_STRIP( t data( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR$ � s c C` s� t | t � rK y | j d � } WqK t k
rG t t d � � � qK Xn t | � d @} | d k rj n> | d k r� | t 7} n% | d k r� | t 7} n t d � � y t | � SWn% t
k
r� } t t | � � � n Xd S( sq
decode from shortened base64 format which omits padding & whitespace.
uses default ``+/`` altchars.
R1 s4 string argument should contain only ASCII charactersi i i s invalid base64 inputN( R6 R R8 t UnicodeEncodeErrorR t
ValueErrort lent _BASE64_PAD2t _BASE64_PAD1R t _BinAsciiErrort TypeError( RB t offt err( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR% � s"
s =
s ==c C` s t | � j d d � S( s�
encode using shortened base64 format which omits padding & whitespace.
uses custom ``./`` altchars.
it is primarily used by Passlib's custom pbkdf2 hashes.
t +t .( R$ t replace( RB ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR" � s c C` sa t | t � rK y | j d � } WqK t k
rG t t d � � � qK Xn t | j d d � � S( s�
decode from shortened base64 format which omits padding & whitespace.
uses custom ``./`` altchars, but supports decoding normal ``+/`` altchars as well.
it is primarily used by Passlib's custom pbkdf2 hashes.
R1 s4 string argument should contain only ASCII charactersRM RL ( R6 R R8 RC R RD R% RN ( RB ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR# � s
c C` s t t | � j t � � S( sh
wrapper around :func:`base64.b32encode` which strips padding,
and returns a native string.
( R t
_b32encodeR@ t B_EQUAL( R< ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR � s t Bt 8t Ot 0i c C` se t | t � r! | j d � } n | j t � } t | � d @} | rX | t | 7} n t | t � S( s�
wrapper around :func:`base64.b32decode`
which handles common mistyped chars.
padding optional, ignored if present.
R1 i ( R6 R R8 t translatet _b32_translateRE t _b32_decode_padt
_b32decodet True( R< t remainder( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR � s c B` s: e Z d Z d Z d Z d Z d Z d Z d Z e
d � Z e d � � Z
d � Z d � Z d � Z d � Z d � Z d � Z d � Z e d
� � Z e d � � Z d � Z d
� Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z! d � Z" d � Z# d � Z$ d � Z% d � Z& d � Z' RS( sc Provides routines for encoding/decoding base64 data using
arbitrary character mappings, selectable endianness, etc.
:arg charmap:
A string of 64 unique characters,
which will be used to encode successive 6-bit chunks of data.
A character's position within the string should correspond
to its 6-bit value.
:param big:
Whether the encoding should be big-endian (default False).
.. note::
This class does not currently handle base64's padding characters
in any way what so ever.
Raw Bytes <-> Encoded Bytes
===========================
The following methods convert between raw bytes,
and strings encoded using the engine's specific base64 variant:
.. automethod:: encode_bytes
.. automethod:: decode_bytes
.. automethod:: encode_transposed_bytes
.. automethod:: decode_transposed_bytes
..
.. automethod:: check_repair_unused
.. automethod:: repair_unused
Integers <-> Encoded Bytes
==========================
The following methods allow encoding and decoding
unsigned integers to and from the engine's specific base64 variant.
Endianess is determined by the engine's ``big`` constructor keyword.
.. automethod:: encode_int6
.. automethod:: decode_int6
.. automethod:: encode_int12
.. automethod:: decode_int12
.. automethod:: encode_int24
.. automethod:: decode_int24
.. automethod:: encode_int64
.. automethod:: decode_int64
Informational Attributes
========================
.. attribute:: charmap
unicode string containing list of characters used in encoding;
position in string matches 6bit value of character.
.. attribute:: bytemap
bytes version of :attr:`charmap`
.. attribute:: big
boolean flag indicating this using big-endian encoding.
c C` s t | t � r! | j d � } n$ t | t � sE t j | d � � n t | � d k rf t d � � n t t | � � d k r� t d � � n | | _ | j
| _ t d � t
| � D� � } | j
| _ | | _ | r� | j | _ | j | _ n | j | _ | j | _ d S( Ns latin-1t charmapi@ s' charmap must be 64 characters in lengths- charmap must not contain duplicate charactersc s` s! | ] \ } } | | f Vq d S( N( ( t .0t idxt value( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>] s ( R6 R R8 t bytesR
t ExpectedStringErrorRE RD t sett bytemapt __getitem__t _encode64t dictt enumeratet _decode64t bigt _encode_bytes_bigt
_encode_bytest _decode_bytes_bigt
_decode_bytest _encode_bytes_littlet _decode_bytes_little( t selfR[ Rh t lookup( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt __init__Q s$ c C` s | j j d � S( s charmap as unicodes latin-1( Rb t decode( Ro ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR[ s s c C` s� t | t � s+ t d t | � f � � n t t | � d � \ } } t ra t t | � � } n t d � | D� � } | j | | | � } t
t | j | � � } | S( s� encode bytes to base64 string.
:arg source: byte string to encode.
:returns: byte string containing encoded data.
s source must be bytes, not %si c s` s | ] } t | � Vq d S( N( R7 ( R\ t elem( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>� s (
R6 R_ RI t typet divmodRE R R t iterRj R R Rd ( Ro R< t chunkst tailt
next_valuet gent out( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_bytes{ s c c` s� d } xq | | k ry | � } | � } | � } | d @V| d @d >| d ?BV| d @d >| d ?BV| d ?V| d 7} q W| r� | � } | d k r� | d @V| d ?Vq� | � } | d @V| d @d >| d ?BV| d ?Vn d S(
s> helper used by encode_bytes() to handle little-endian encodingi i? i i i i i i N( ( Ro Ry Rw Rx R] t v1t v2t v3( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyRm � s& c c` s� d } xq | | k ry | � } | � } | � } | d ?V| d @d >| d ?BV| d @d >| d ?BV| d @V| d 7} q W| r� | � } | d k r� | d ?V| d @d >Vq� | � } | d ?V| d @d >| d ?BV| d @d >Vn d S(
s; helper used by encode_bytes() to handle big-endian encodingi i i i i i i? i N( ( Ro Ry Rw Rx R] R} R~ R ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyRi � s& c C` s� t | t � s+ t d t | � f � � n t t | � d � \ } } | d k ra t d � � n t t | j | � � } y t
| j | | | � � SWn- t k
r� } t d | j
d f � � n Xd S( s� decode bytes from base64 string.
:arg source: byte string to decode.
:returns: byte string containing decoded data.
s source must be bytes, not %si i s( input string length cannot be == 1 mod 4s invalid character: %ri N( R6 R_ RI Rt Ru RE RD R R Rg R Rl t KeyErrort args( Ro R< Rw Rx Ry RK ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_bytes� s c c` s� d } xu | | k r} | � } | � } | � } | � } | | d @d >BV| d ?| d @d >BV| d ?| d >BV| d 7} q W| r� | � } | � } | | d @d >BV| d k r� | � } | d ?| d @d >BVq� n d S( s> helper used by decode_bytes() to handle little-endian encodingi i i i i i i N( ( Ro Ry Rw Rx R] R} R~ R t v4( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyRn � s" c c` s� d } xu | | k r} | � } | � } | � } | � } | d >| d ?BV| d @d >| d ?BV| d @d >| BV| d 7} q W| r� | � } | � } | d >| d ?BV| d k r� | � } | d @d >| d ?BVq� n d S( s; helper used by decode_bytes() to handle big-endian encodingi i i i i i i N( ( Ro Ry Rw Rx R] R} R~ R R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyRk s" c ` sU t � f d � t | j � D� � } | j � f d � t | j � D� � t | � S( s2 helper to generate set of valid last chars & bytesc 3` s% | ] \ } } | � @s | Vq d S( N( ( R\ t it c( t bits( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>G s c 3` s% | ] \ } } | � @s | Vq d S( N( ( R\ R� R� ( R� ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>H s ( Ra Rf Rb t updateR[ t frozenset( Ro R� t pset( ( R� s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt
__make_padsetE s %&c C` s) | j r d n d } | | j | � f S( sD mask to clear padding bits, and valid last bytes (for strings 2 % 4)i i i< ( Rh t _Base64Engine__make_padset( Ro R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt _padinfo2K s c C` s) | j r d n d } | | j | � f S( sD mask to clear padding bits, and valid last bytes (for strings 3 % 4)i i i0 ( Rh R� ( Ro R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt _padinfo3R s c C` s t | � d @} | d k r. | j \ } } n: | d k rL | j \ } } n | s\ t | f St d � � | d } | | k r� t | f St | t � r� | j } | | j | � | @} n4 | j | j
| � | @� } t r� t | g � } n t
| d | f S( s helper to detect & clear invalid unused bits in last character.
:arg source:
encoded data (as ascii bytes or unicode).
:returns:
`(True, result)` if the string was repaired,
`(False, source)` if the string was ok as-is.
i i s source length must != 1 mod 4i����( RE R� R� t FalseRD R6 R R[ t indexRd Rg R R_ RY ( Ro R< Rx t maskt padsett lastt cm( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt check_repair_unusedY s&
c C` s | j | � d S( Ni ( R� ( Ro R< ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt
repair_unused� s c ` sT t � t � s+ t d t � � f � � n t � f d � | D� � } | j | � S( s> encode byte string, first transposing source using offset lists source must be bytes, not %sc 3` s | ] } � | Vq d S( N( ( R\ RJ ( R< ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>� s ( R6 R_ RI Rt R R| ( Ro R< t offsetst tmp( ( R< s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_transposed_bytes� s c C` sV | j | � } d g t | � } x' t | | � D] \ } } | | | <q2 Wt | � S( sG decode byte string, then reverse transposition described by offset listN( R� R2 RE t zipR ( Ro R< R� R� t bufRJ t char( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_transposed_bytes� s
c C` s t | t � s+ t d t | � f � � n | j } | d } | | d } t | � | k ru t d | f � � n | j } d } y; x4 | r� | n t | � D] } | d >| | � } q� WWn$ t k
r� t d | f � � n X| r| r� | | L} q| d | >d M} n | S( s� decode base64 string -> integer
:arg source: base64 string to decode.
:arg bits: number of bits in resulting integer.
:raises ValueError:
* if the string contains invalid base64 characters.
* if the string is not long enough - it must be at least
``int(ceil(bits/6))`` in length.
:returns:
a integer in the range ``0 <= n < 2**bits``
s source must be bytes, not %si s source must be %d charsi s invalid character in string: %ri (
R6 R_ RI Rt Rh RE RD Rg t reversedR� ( Ro R< R� Rh t padt charsRr R{ R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt _decode_int� s&
c C` s� t | t � s+ t d t | � f � � n t | � d k rL t d � � n t r_ | d } n y | j | � SWn t k
r� t d � � n Xd S( s( decode single character -> 6 bit integers source must be bytes, not %si s source must be exactly 1 bytei s invalid characterN( R6 R_ RI Rt RE RD R Rg R� ( Ro R< ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_int6� s
c C` s� t | t � s+ t d t | � f � � n t | � d k rL t d � � n | j } yM | j r� | | d � | | d � d >S| | d � | | d � d >SWn t k
r� t d � � n Xd S( s' decodes 2 char string -> 12-bit integers source must be bytes, not %si s source must be exactly 2 bytesi i i s invalid characterN( R6 R_ RI Rt RE RD Rg Rh R� ( Ro R< Rr ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_int12� s $
c C` s t | t � s+ t d t | � f � � n t | � d k rL t d � � n | j } y� | j r� | | d � | | d � d >| | d � d >| | d � d
>S| | d � | | d � d >| | d � d >| | d � d
>SWn t k
r t d � � n Xd S(
s' decodes 4 char string -> 24-bit integers source must be bytes, not %si s source must be exactly 4 bytesi i i i i i i s invalid characterN( R6 R_ RI Rt RE RD Rg Rh R� ( Ro R< Rr ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_int24� s DH
c C` s | j | d � S( s& decode 5 char string -> 30 bit integeri ( R� ( Ro R< ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_int30� s c C` s | j | d � S( s� decode 11 char base64 string -> 64-bit integer
this format is used primarily by des-crypt & variants to encode
the DES output value used as a checksum.
i@ ( R� ( Ro R< ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt decode_int64 s c ` sy | d } | | 7} | j rA t | d d d � } � | K� n t d | d � } t t | j � f d � | D� � � S( s� encode integer into base64 format
:arg value: non-negative integer to encode
:arg bits: number of bits to encode
:returns:
a string of length ``int(ceil(bits/6.0))``.
i i����i c 3` s | ] } � | ?d @Vq d S( i? N( ( R\ RJ ( R^ ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pys <genexpr>" s ( Rh R
R R Rd ( Ro R^ R� R� t itr( ( R^ s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt _encode_int s
c C` sP | d k s | d k r' t d � � n t r? | j | | d !S| j | � Sd S( s0 encodes 6-bit integer -> single hash64 characteri i? s value out of rangei N( RD R Rb Rd ( Ro R^ ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_int6( s
c C` sm | d k s | d k r' t d � � n | d @| d ?d @g } | j rW t | � } n t t | j | � � S( s' encodes 12-bit integer -> 2 char stringi i� s value out of rangei? i ( RD Rh R� R R Rd ( Ro R^ t raw( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_int121 s c C` s� | d k s | d k r' t d � � n | d @| d ?d @| d ?d @| d ?d @g } | j rm t | � } n t t | j | � � S( s' encodes 24-bit integer -> 4 char stringi i��� s value out of rangei? i i i ( RD Rh R� R R Rd ( Ro R^ R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_int24: s c C` s7 | d k s | d k r' t d � � n | j | d � S( s& decode 5 char string -> 30 bit integeri i���?s value out of rangei ( RD R� ( Ro R^ ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_int30D s c C` s7 | d k s | d k r' t d � � n | j | d � S( s� encode 64-bit integer -> 11 char hash64 string
this format is used primarily by des-crypt & variants to encode
the DES output value used as a checksum.
i l ���� s value out of rangei@ ( RD R� ( Ro R^ ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt encode_int64J s N(( t __name__t
__module__t __doc__R2 Rb Rh Rd Rg Rj Rl R� Rq t propertyR[ R| Rm Ri R� Rn Rk R� R R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� ( ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR& � sD ? " ' + # * ) (
c B` s/ e Z d Z d Z d � Z d � Z d � Z RS( s< Base64Engine which delays initialization until it's accessedc O` s | | f | _ d S( N( t
_lazy_opts( Ro R� t kwds( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyRq \ s c C` s; | j \ } } t t | � j | | � | ` t | _ d S( N( R� t superR' Rq R& t __class__( Ro R� R� ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt
_lazy_init_ s c C` s, | j d � s | j � n t j | | � S( Nt _( t
startswithR� t objectt __getattribute__( Ro t attr( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR� e s
N( R� R� R� R2 R� Rq R� R� ( ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyR' X s
Rh (G R� t
__future__R R R t base64R R R RX R RO t binasciiR R R RH t loggingt getLoggerR� t logt passlibR
t passlib.utils.compatR R R
R R R R R R R R R t passlib.utils.decorR t __all__R R R R R R R R R R9 t B_NULLRP R4 R3 R2 R! R$ R% RA RG RF R" R# RV RW R� R& R' R( RY R) R* ( ( ( s8 /usr/lib/python2.7/site-packages/passlib/utils/binary.pyt <module> sn " R !
� � ]