Dashboard
PHP:
8.2.30
OS:
Linux
User:
dh_nv8b2m
/
/
usr
/
lib
/
python3
/
dist-packages
/
sqlparse
/
__pycache__
📤 Upload
📝 New File
📁 New Folder
Close
Editing: lexer.cpython-310.pyc
o �e}_� � @ sP d Z ddlmZ ddlmZ ddlmZ ddlmZ G dd� d�Z d d d �Z dS ) z SQL Lexer� )� TextIOBase)�tokens)� SQL_REGEX)�consumec @ s e Zd ZdZeddd��ZdS )�Lexerz?Lexer Empty class. Leaving for backwards-compatibility Nc c s � t | t�r | �� } t | t�rn,t | t�r3|r | �|�} n z| �d�} W n ty2 | �d�} Y n w td�t | ����t | �}|D ]>\}}t D ]1\}}|| |�}|sTqHt |t j �rb||�� fV n t|�rm||�� �V t||�� | d � nt j|fV qBdS )a� Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}� N)� isinstancer �read�str�bytes�decode�UnicodeDecodeError� TypeError�format�type� enumerater r � _TokenType�group�callabler �end�Error)�text�encoding�iterable�pos�char�rexmatch�action�m� r �0/usr/lib/python3/dist-packages/sqlparse/lexer.py� get_tokens s> � � � ��zLexer.get_tokens�N)�__name__� __module__� __qualname__�__doc__� staticmethodr! r r r r r s r Nc C s t � �| |�S )z�Tokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )r r! )�sqlr r r r �tokenizeL s r) r" ) r& �ior �sqlparser �sqlparse.keywordsr �sqlparse.utilsr r r) r r r r �<module> s 6
Save
Cancel