Dashboard
PHP:
8.2.30
OS:
Linux
User:
dh_nv8b2m
/
/
usr
/
lib
/
python3
/
dist-packages
/
awscli
/
customizations
/
emr
/
__pycache__
📤 Upload
📝 New File
📁 New Folder
Close
Editing: steputils.cpython-310.pyc
o .&�a"! � @ s� d dl mZ d dl mZ d dl mZ dd� Zdd� Zdd � Zd d d �Zd d� Zd dd�Z dd� Z d dd�Z d dd�Z dd� Z dd� Zdd � Zd S ) � )�emrutils)� constants)� exceptionsc C s� g }| D ]j}|� d�}|d u rtj}|�� }i }|tjkr#t|d�}nF|tjkr/t||d�}n:|tjkr<t|||d�}n-|tj krIt |||d�}n |tj krVt |||d�}n|tj krct|||d�}ntj|d��|�|� q|S )N�Type)� parsed_step)r � release_label)r �regionr �� step_type)�getr � CUSTOM_JAR�lower�build_custom_jar_step� STREAMING�build_streaming_step�HIVE�build_hive_step�PIG�build_pig_step�IMPALA�build_impala_step�SPARK�build_spark_stepr �UnknownStepTypeError�append)�parsed_step_listr r �step_config_list�stepr � step_config� r �E/usr/lib/python3/dist-packages/awscli/customizations/emr/steputils.py�build_step_config_list sH � � � � � r! c C st t | �d�tjd�}t | �d�tjd�}tjtjd| �d�d� tj| �d�| �d�||| �d�t� | �d��d �S ) N�Name��arg�value�ActionOnFailure�Jar�� structure�namer% �Args� MainClass� Properties)�jar�argsr* �action_on_failure� main_class� properties) �_apply_default_valuer r � DEFAULT_CUSTOM_JAR_STEP_NAME�DEFAULT_FAILURE_ACTIONr �check_required_field�CUSTOM_JAR_STEP_CONFIG� build_step�parse_key_value_string)r r* r0 r r r r 9 s. �����r c C s� t | �d�tjd�}t | �d�tjd�}| �d�}tjtjd|d� tjd|d� g }|r7tj }|� tj � ntj }||7 }tj ||||d�S )Nr" r# r& r+ r( �r* r% �r. r/ r* r0 )r3 r r �DEFAULT_STREAMING_STEP_NAMEr5 r r6 �STREAMING_STEP_CONFIG�check_empty_string_list�COMMAND_RUNNERr �HADOOP_STREAMING_COMMAND�HADOOP_STREAMING_PATHr8 )r r r* r0 r/ � args_listr. r r r r N s6 �� ��r Nc C �r | � d�}tjtjd|d� tjd|d� t| � d�tjd�}t| � d�tjd�}tj t ||�t |||�||d�S �Nr+ r( r: r" r# r& r; ) r r r6 r �HIVE_STEP_CONFIGr> r3 �DEFAULT_HIVE_STEP_NAMEr5 r8 �_get_runner_jar�_build_hive_args�r r r r/ r* r0 r r r r m s( ���� �r c C �l g }|r |� tj� n |� tjtj|d�� |� tj� |s*|� tj� |� tj� |� tj � || 7 }|S �N�� relative_pathr ) r r �HIVE_SCRIPT_COMMANDr � build_s3_link�HIVE_SCRIPT_PATH�RUN_HIVE_SCRIPT� HIVE_VERSIONS�LATEST�ARGS�r/ r r rB r r r rH � � � rH c C rC rD ) r r r6 r �PIG_STEP_CONFIGr> r3 �DEFAULT_PIG_STEP_NAMEr5 r8 rG �_build_pig_argsrI r r r r � s& ��� �r c C rJ rK ) r r �PIG_SCRIPT_COMMANDr rO �PIG_SCRIPT_PATH�RUN_PIG_SCRIPT� PIG_VERSIONSrS rT rU r r r rY � rV rY c C s� |r t jtjd��t| �d�tjd�}t| �d�tjd�}tj tj |d�tj g}| �d�}tj tj d|d� ||7 }tjt�|�|||d�S ) Nr r" r# r& rL r+ r( r; )r r r r r3 r �DEFAULT_IMPALA_STEP_NAMEr5 r rO �IMPALA_INSTALL_PATH�RUN_IMPALA_SCRIPTr6 �IMPALA_STEP_CONFIGr8 �get_script_runner)r r r r* r0 rB r/ r r r r � s4 ���� ��r c C sd t | �d�tjd�}t | �d�tjd�}| �d�}tjtjd|d� tjt ||�t |||�||d�S )Nr" r# r& r+ r( r; ) r3 r r �DEFAULT_SPARK_STEP_NAMEr5 r r6 �SPARK_STEP_CONFIGr8 rG �_build_spark_args)r r r r* r0 r/ r r r r � s$ �� � �r c C s. g }|r |� tj� n|� tj� || 7 }|S �N)r r �SPARK_SUBMIT_COMMAND�SPARK_SUBMIT_PATHrU r r r re � s re c C s | d u r|} | S rf r r# r r r r3 � s r3 c C s | rt jS t�|�S rf )r r? r rb )r r r r r rG � s �rG rf )�awscli.customizations.emrr r r r! r r r rH r rY r r re r3 rG r r r r �<module> s &
Save
Cancel