| Current File : //lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyc |
�
�jbc @ s� d d l Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z m
Z
d d l m Z d d l m Z
d d l m Z d d l m Z d d
l m Z e j e � Z e e
j g � Z d d d
f Z d Z d Z d Z d Z d Z e d Z e e g Z d e f d � � YZ! d e j" f d � � YZ# d e# f d � � YZ$ d � Z% d � Z& d � Z' d � Z( d � Z) d � Z* d � Z+ d! � Z, d" � Z- e. e. d# � Z/ e$ e j0 f f e# e j0 e j1 f f g Z2 d$ � Z3 d S(% i����N( t ec2_utils( t log( t net( t EphemeralDHCPv4t NoDHCPLeaseError( t sources( t
url_helper( t util( t warnings( t EventTypet
datasourcet Ec2t strict_idt warns latest/api/tokent _ec2_disable_api_tokent 21600s X-aws-ec2-metadata-tokens -ttl-secondst
CloudNamesc B s2 e Z d Z d Z d Z d Z d Z d Z d Z RS( t aliyunt awst brightboxt zstackt e24cloudt unknowns no-ec2-metadata( t __name__t
__module__t ALIYUNt AWSt BRIGHTBOXt ZSTACKt E24CLOUDt UNKNOWNt NO_EC2_METADATA( ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR ' s t
DataSourceEc2c B sC e Z d Z d d g Z d Z d g Z d Z d Z d Z e
j Z e
Z d � Z d � Z d � Z d
� Z e d � � Z e d � � Z d
� Z d � Z d d d � Z d � Z d � Z e d � � Z e d � � Z d � Z e d � � Z e d � � Z d � Z e! d � Z" d � Z# d � Z$ d d � Z% d d � Z& RS( R s http://169.254.169.254s http://instance-data.:8773s
2009-04-04s
2016-09-02ix i2 c C s) t t | � j | | | � d | _ d S( N( t superR t __init__t Nonet metadata_address( t selft sys_cfgt distrot paths( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR" N s c C s t � S( s5 Return the cloud name as identified during _get_data.( t identify_platform( R% ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt _get_cloud_nameR s c C s� t t j | j t t � d � \ } } t j d | | j | j
� | d k re | j t j k re t
S| j t j k r{ t
S| j r� t j � r� t j d � t
SyA t | j � �, t j d t j d d d | j � | _ Wd QXWq!t k
r� t
SXn' t j d t j d d d | j � | _ | j s.t
S| j j d d � | _ | j j d
d � | _ | j j d i � j d i � j d
i � | _ t S( NR
s0 strict_mode: %s, cloud_name=%s cloud_platform=%st trues1 FreeBSD doesn't support running dhclient with -sft logfunct msgs Crawl of metadata servicet funcs meta-datas user-datat dynamics instance-identityt document( s warnN( t read_strict_modeR t get_cfg_by_pathR& t STRICT_ID_PATHt STRICT_ID_DEFAULTR# t LOGt debugt
cloud_namet platformR R t FalseR t perform_dhcp_setupt
is_FreeBSDR t fallback_interfacet log_timet crawl_metadatat _crawled_metadataR t gett metadatat userdata_rawt identityt True( R% t strict_modet _sleep( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt _get_dataV s<
'c C sk | j s
t S| j j d i � j d i � } x6 | j d i � j � D] \ } } d | k rG t SqG Wt S( s6 Report if this instance type is Ec2 Classic (non-vpc).t networkt
interfacest macss vpc-id( RA R9 R@ t itemsRD ( R% t ifaces_mdt _mact mac_data( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt is_classic_instancey s !% c C s | j s
d S| j j d � S( Ns ami-launch-index( RA R# R@ ( R% ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt launch_index� s c C sI t | d � s$ t j j � | _ n | j sB t j j � | _ n | j S( Nt _platform_type( t hasattrR t dsnamet lowerRQ ( R% ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR8 � s
c C s� d } | j � } x� | j D]� } | j | j | � } y" t j d | d | d t � } Wn) t j k
r� } t j d | | � q X| j
d k r� t j d | � | S| j
d k r d } t j | | | j � q q W| j S(
sE Get the best supported api version from the metadata service.
Loop through all extended support metadata versions in order and
return the most-fully featured metadata api version discovered.
If extended_metadata_versions aren't present, return the datasource's
min_metadata_version.
s {0}/{1}/meta-data/instance-idt urlt headerst headers_redacts url %s raised exception %si� s# Found preferred metadata version %si� s0 Metadata api version %s not present. Headers: %s(
t _get_headerst extended_metadata_versionst formatR$ t uhelpt readurlt AWS_TOKEN_REDACTt UrlErrorR5 R6 t codeRV t min_metadata_version( R% t url_tmplRV t api_verRU t respt eR- ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt get_metadata_api_version� s
c C s� | j t j k r� t | d d � so | j � } t j | | j d | j d t
d | j �j d i � | _
n | j
j d | j d � S| j d Sd S( NRC t
headers_cbRW t exception_cbR0 t
instanceIds instance-id( R7 R R t getattrR# Re t ec2t get_instance_identityR$ RX R] t _refresh_stale_aws_token_cbR@ RC RA ( R% t api_version( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt get_instance_id� s c C s� | j t j k r d Sg } i } t } d } x7 | D]/ } d j | | � } | j | � | | | <q5 Wt j d � t j d | d d d d d | j
d | j d
| d t � \ } }
| r� |
r� |
| _
| | Sd S( Nt PUTs {0}/{1}s Fetching Ec2 IMDSv2 API Tokent urlst max_waiti t timeoutt status_cbRf t request_methodRW ( R7 R R t API_TOKEN_ROUTERZ t appendR5 R6 R[ t wait_for_urlt
_status_cbRX R] t
_api_token( R% t mdurlsRr Rq Rp t url2baset url_pathRt RU t curt response( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt _maybe_fetch_api_token� s$
c C s" | j } | j � } | j d k r( t S| j d | j � } g | D] } t j | � rD | ^ qD } t | � t | � k r� t j
d t t | � t | � � � n t | � r� | } n t j
d � | j } | j | � } | s�| j t k rt j
d � n g } i } d j d | j � } d }
x7 | D]/ } d j | | � } | j | � | | | <q3Wt j � }
t j d
| d | j d | j d
t j
d t d | j d |
� \ } } | r�| | } q�n | r�| | _ t j
d | j � n# t j d | t t j � |
� � t | � S( Ni t
metadata_urlss, Removed the following from metadata urls: %ss+ Empty metadata url list! using default lists Retrying with IMDSv1s {ver}/meta-data/instance-idt vert GETs {0}/{1}Rp Rq Rr Rs RW Rf Rt s Using metadata source: '%s's( Giving up on md from %s after %s seconds( t ds_cfgt get_url_paramst max_wait_secondsR9 R@ R� R t is_resolvable_urlt setR5 R6 t listt lent warningR Ry t API_TOKEN_DISABLEDRZ R` Rv t timeR[ Rw t timeout_secondsR] RX R$ t criticalt intt bool( R% t mcfgt
url_paramsRz t xt filteredR$ Rp R{ R| Rt RU R} t
start_timet _( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt wait_for_metadata_service� sP (
c C sA d | j k r d Sd } | j d } t | t � sI t j d | � d SxQ | j � D]C \ } } | | k rx | } Pn | d k rV | d k rV | } qV qV W| d k r� t j d | � d S| } | j d � s� d | } n t j j
| � r� | S| j t j j | � � } | r-t j d | | � | S| d k r=d S| S( Ns block-device-mappings+ block-device-mapping not a dictionary: '%s't ephemeralt
ephemeral0s Unable to convert %s to a devicet /s /dev/%ss Remapped device name %s => %s(
RA R# t
isinstancet dictR5 R6 RK t
startswitht ost patht existst
_remap_devicet basename( R% t namet foundt bdmt entnamet devicet ofoundt remapped( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt device_name_to_device s8
c C s\ yC | j t j k r3 | j j d | j d d � S| j d d SWn t k
rW d SXd S( Nt availabilityZonet placements availability-zone( R7 R R RC R@ RA t KeyErrorR# ( R% ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt availability_zoneG s
c C si | j t j k rH | j j d � } | j rD | rD | j d } n | S| j } | d k re | d Sd S( Nt regioni����( R7 R R RC R@ R� R# ( R% R� t az( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� S s c C s? | s
d S| j t j k r; t t j | t t � | � n d S( N( R7 R R t warn_if_necessaryR R2 R3 R4 ( R% t cfgt is_new_instance( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt activatea s c C s? | j t j k r | j S| j d k r9 t j d � d Sd } t d | j k o` | j t j
k � } | r� t j d � t j
d t j d d d | j � n | j } i | t j | � 6} | j j d � } t | t � r t | d | d | �} | j � r/| j d j t j � q/n t j d
| � | | _ | j S( s@ Return a network config dict for rendering ENI or netplan files.s8 Unexpected call to network_config when metadata is None.RH sP Metadata 'network' not present: Refreshing stale metadata from prior to upgrade.R, R- s Re-crawl of metadata serviceR. t macs_to_nicst fallback_nics% Metadata 'network' key not valid: %s.N( t _network_configR t UNSETRA R# R5 R� R� R7 R R R6 R R= t get_dataR< R t get_interface_macR@ R� R� t# convert_ec2_metadata_network_configRO t
update_eventst addR t BOOT( R% t resultt no_network_metadata_on_awst ifaceR� t net_md( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt network_configi s4
c C sV | j d k rO t | d d � } | r< | | _ d | _ qO t t | � j Sn | j S( NR� ( t _fallback_interfaceR# Ri R� R! R R< ( R% t
_legacy_fbnic( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR< � s c C sB | j � s i S| j � } t } i } | j t j k rO | j } | j } n
d
} } y� t j
| | j d | j d | d | �| d <t j
| | j d | j d | d | �| d <| j t j k rt j | | j d | j d | d | �} i | d 6| d <n Wn( t k
r3t j t d | j � i SX| | d <| S( s� Crawl metadata service when available.
@returns: Dictionary of crawled metadata content containing the keys:
meta-data, user-data and dynamic.
Rf RW Rg s user-datas meta-datas instance-identityR/ s' Failed reading from metadata address %st _metadata_api_versionN( R� Re R] R7 R R Rl t# _skip_or_refresh_stale_aws_token_cbR# Rj t get_instance_userdataR$ RX t get_instance_metadataRk t ExceptionR t logexcR5 ( R% Rm t redactt crawled_metadatat exc_cbt exc_cb_udRC ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR> � s>
c C s� | j t j k r d St j d � i | t 6} d j | j t � } y% t
j | d | d t d d �} Wn* t
j
k
r� } t j d | | � d SX| j S( s� Request new metadata API token.
@param seconds: The lifetime of the token in seconds
@return: The API token or None if unavailable.
s! Refreshing Ec2 metadata API tokens {}/{}RV RW Rt Ro s/ Unable to get API token: %s raised exception %sN( R7 R R R# R5 R6 t AWS_TOKEN_REQ_HEADERRZ R$ Ru R[ R\ R] R^ R� t contents( R% t secondst request_headert token_urlR~ Rd ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt _refresh_api_token� s
c C s2 t j t j | | � } | s" t S| j | | � S( sV Callback will not retry on SKIP_USERDATA_CODES or if no token
is available.( Rj t skip_retry_on_codest SKIP_USERDATA_CODESR9 Rl ( R% R- t exceptiont retry( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� � s
c C s> t | t j � r: | j d k r: t j d � d | _ n t S( s= Exception handler for Ec2 to refresh token if token is stale.i� s+ Clearing cached Ec2 API token due to expiryN( R� R[ R^ R_ R5 R6 R# Ry RD ( R% R- R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyRl � s !
c C s6 t j | � d | k r2 t j d � t | _ n d S( Ns Read timed outs. Cannot use Ec2 IMDSv2 API tokens, using IMDSv1( R5 R� R� Ry ( R% R- t exc( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyRx � s
t c C sx | j t j k s! | j t k r% i Si t t 6} t | k rB | S| j sj | j � | _ | j sj i Sn i | j t 6S( s� Return a dict of headers for accessing a url.
If _api_token is unset on AWS, attempt to refresh the token via a PUT
and then return the updated token header.
(
R7 R R Ry R� t AWS_TOKEN_TTL_SECONDSR� Ru R� t AWS_TOKEN_PUT_HEADER( R% RU t request_token_header( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyRX � s
N(' R R RS R� R` RY t url_max_waitt url_timeoutR# Ry R R� R� R9 R: R" R* RG RO t propertyRP R8 Re Rn R R� R� R� R� R� R� R< R> R� R� R� Rl Rx RX ( ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR 5 s> #
8 3 /
' t DataSourceEc2Localc B s e Z d Z e Z d � Z RS( sy Datasource run at init-local which sets up network to query metadata.
In init-local, no network is available. This subclass sets up minimal
networking with dhclient on a viable nic so that it can talk to the
metadata service. If the metadata service provides network configuration
then render the network configuration for that instance based on metadata.
c C sH t j f } | j | k r5 t j d | | j � t St t | � j � S( Ns+ Local Ec2 mode only supported on %s, not %s( R R R7 R5 R6 R9 R! R� R� ( R% t supported_platforms( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� s
( R R t __doc__RD R: R� ( ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� s c C s6 y t | � SWn! t k
r1 } t j | � | SXd S( N( t parse_strict_modet
ValueErrorR5 R� ( t cfgvalt defaultRd ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR1 # s
c C s� | t k r d S| t k r d S| s* d
S| j d � \ } } } | d k rg t d | | f � � n | r� y t | � } Wq� t k
r� t d | | f � � q� Xn d } | | f S( NR+ t falseR
i t ,sU Invalid mode '%s' in strict_id setting '%s': Expected one of 'true', 'false', 'warn'.s< Invalid sleep '%s' in strict_id setting '%s': not an integer( s trueN( R� N( s warni ( s trueR� s warn( RD R# R9 t partitionR� R� ( R� t modeR� t sleep( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� + s&
c C sj y t | � \ } } Wn! t k
r9 } t j | � d SX| d k rJ d St j d | d t d | �d S( NR� t
non_ec2_mdR� R� ( R� R� R5 R� R t show_warningRD ( R� R� R� R� Rd ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� I s
c C sB | d j d � r> | d d k s7 | d | d k r> t j Sd S( Nt uuidRj t uuid_sourcet
hypervisort serial( R� R R R# ( t data( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt identify_awsV s
c C s | d j d � r t j Sd S( NR� s .brightbox.com( t endswithR R ( R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt identify_brightbox` s c C s | d j d � r t j Sd S( Nt asset_tags
.zstack.io( R� R R ( R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt identify_zstacke s c C s | d d k r t j Sd S( Nt vendorR ( R R ( R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt identify_e24cloudj s c C s| t � } t t t t d � f } xT | D]L } y | | � } | rG | SWq( t k
rs } t j d | | | � q( Xq( Wd S( Nc S s t j S( N( R R ( R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt <lambda>s s s' calling %s with %s raised exception: %s( t _collect_platform_dataR� R� R� R� R� R5 R� ( R� t checkst checkerR� Rd ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR) o s
c C s i } y# t j d � j � } d | d <Wn* t k
rU t j d � } d | d <n X| d k rk d } n | j � | d <t j d � } | d k r� d } n | j � | d <t j d
� } | d k r� d } n | j � | d <t j d � } | r� | n d j � | d
<| S( s9 Returns a dictionary of platform info from dmi or /sys/hypervisor.
Keys in the dictionary are as follows:
uuid: system-uuid from dmi or /sys/hypervisor
uuid_source: 'hypervisor' (/sys/hypervisor/uuid) or 'dmi'
serial: dmi 'system-serial-number' (/sys/.../product_serial)
asset_tag: 'dmidecode -s chassis-asset-tag'
vendor: dmi 'system-manufacturer' (/sys/.../sys_vendor)
On Ec2 instances experimentation is that product_serial is upper case,
and product_uuid is lower case. This returns lower case values for both.
s /sys/hypervisor/uuidR� R� s system-uuidt dmiR� R� s system-serial-numberR� s chassis-asset-tagR� s system-manufacturerR� N( R t load_filet stripR� t
read_dmi_dataR# RT ( R� R� R� R� R� ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� ~ s*
c C s i d d 6g d 6} | s) t j � } n | d d } x� | j � D]� \ } } | j | � } | sk qD n i d d 6| d 6g d 6} | | d
<| | k s� | j d � s� | j d � r� | d j i d
d 6� n | j d � r� | d j i d d 6� n | d j | � qD W| S( s� Convert ec2 metadata to network config version 1 data dict.
@param: network_md: 'network' portion of EC2 metadata.
generally formed as {"interfaces": {"macs": {}} where
'macs' is a dictionary with mac address as key and contents like:
{"device-number": "0", "interface-id": "...", "local-ipv4s": ...}
@param: macs_to_nics: Optional dict of mac addresses and nic names. If
not provided, get_interfaces_by_mac is called to get it from the OS.
@param: fallback_nic: Optionally provide the primary nic interface name.
This nic will be guaranteed to minimally have a dhcp4 configuration.
@return A dict of network config version 1 based on the metadata and macs.
i t versiont configRI RJ t physicalt typeR� t subnetst mac_addresss public-ipv4ss local-ipv4st dhcp4t ipv6st dhcp6( R t get_interfaces_by_macRK R@ Rv ( t
network_mdR� R� t netcfgt
macs_metadatat mact nic_namet nic_metadatat nic_cfg( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyR� � s"
c C s t j | t � S( N( R t list_from_dependst datasources( t depends( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt get_datasource_list� s (4 R� R� t cloudinitR Rj R t loggingR t cloudinit.net.dhcpR R R R R[ R R t cloudinit.eventR t getLoggerR R5 t frozensett NOT_FOUNDt SKIP_METADATA_URL_CODESR3 R4 Ru R� R� R� R� R] t objectR t
DataSourceR R� R1 R� R� R� R� R� R� R) R� R# R� t DEP_FILESYSTEMt DEP_NETWORKR R ( ( ( sC /usr/lib/python2.7/site-packages/cloudinit/sources/DataSourceEc2.pyt <module> sL
� �
+ #