5?jf6dZddlmZmZddlmZddlZddiZddZdd ZGd d Z Gd de Z Gdde Z GddZ Gdde e Z Gdde Z ddZdS)zHImplements the generic progress logger class, and the ProgressBar class.)tqdm tqdm_notebook) OrderedDictNnotebookFonc*|dkrdndtd<dS)NrTFr)SETTINGS)turns @C:\Projects\Historical\venv\Lib\site-packages\proglog/proglog.pyrr s$(DLL44uHZcFt||kr|n |d|dzS)Nz...)len)s max_lengths r troncate_stringrs)Q*$$11AkzkNU,BCr cFeZdZdZd dZdZd dZdZdZdZ d Z d Z dS) ProgressLoggerzGeneric class for progress loggers. A progress logger contains a "state" dictionary. Parameters ---------- init_state : dict Dictionary representing the initial state. Nczi|_i|_g|_d|_||j|dSdS)Nr)statestoredlogs log_indentupdate)self init_states r __init__zProgressLogger.__init__sH     ! J  j ) ) ) ) ) " !r cP|jd|jz|zdS)N )rappendr)rmessages r logzProgressLogger.log&s* #/7:;;;;;r c|Xt|d5}|d|jddddS#1swxYwYdSd|jS)Na )openwritejoinr)rfilepathfs r dump_logszProgressLogger.dump_logs)s  h$$ . $),,--- . . . . . . . . . . . . . . . . . .99TY'' 's.AAAc dS)zExecute something after the state has been updated by the given state elements. This default callback does nothing, overwrite it by subclassing. Nrkws r callbackzProgressLogger.callback0 r c T|j||jdi|dS)aStore objects in the logger and trigger ``self.store_callback``. This works exactly like ``logger()``, but the later is meant for simple data objects (text, numbers) that will be sent over the network or written to a file. The ``store`` method expects rather large objects which are not necessarily serializable, and will be used eg to draw plots on the fly. Nr-)rrstore_callbackr.s r storezProgressLogger.store8s9 2!!b!!!!!r c dS)zExecute something after the store has been updated by the given state elements. This default callback does nothing, overwrite it by subclassing Nr-r.s r r3zProgressLogger.store_callbackDr1r c+dK|D]\}}|D]}|di||i|VdS)aIterate through a list while updating the state. Examples -------- >>> for username in logger.iter(user=['tom', 'tim', 'lea']): >>> # At every loop, logger.state['user'] is updated >>> print(username) Nr-)items)rr/fielditerableits r iterzProgressLogger.iterLsf "xxzz  OE8  ##r{###   r c T|j||jdi|dS)Nr-)rrr0r.s r __call__zProgressLogger.__call__Zs6 " r N) __name__ __module__ __qualname____doc__rr"r+r0r4r3r;r=r-r r rrs****<<<((((    " " "      r rcheZdZdZdZ ddZedZdZd Z d Z dd Z dd Z dZ dS)ProgressBarLoggeraGeneric class for progress loggers. A progress logger contains a "state" dictionary. Parameters ---------- init_state : dict Initial state of the logger. bars : None, list, tuple, or dict, optional Either None (will be initialized with no bar) or a list/tuple of bar names (e.g., ['main', 'sub']) which will be initialized with index -1 and no total, or a dictionary (possibly ordered) of bars, of the form `{bar_1: {title: 'bar1', index: 2, total: 23}, bar_2: {...}}`. ignored_bars : None, list of str, or 'all_others', optional Either None (newly met bars will be added) or a list of blacklisted bar names, or 'all_others' to signify that all bar names not already in `self.bars` will be ignored. logged_bars min_time_interval : int or float Time in seconds between progress bar updates. ignore_bars_under : int Nallrcjt|||t}n5t|tt frtd|D}t|tt frt |}||_||_||j d<||_ ||_ dS)Nc :g|]}|t|ddddfS)Nr)titleindextotalr!indent)dict).0bs r z.ProgressBarLogger.__init__..sA1BdDQRSSSTr bars) rrr isinstancelisttupleset ignored_bars logged_barsrmin_time_intervalignore_bars_under)rrrRrWrXrYrZs r rzProgressBarLogger.__init__ys j111 <==DD tUm , , !D lT5M 2 2 -|,,L(&! 6!2!2r c|jdS)zReturn ``self.state['bars'].``rR)r)rs r rRzProgressBarLogger.barssz&!!r cN|jdS|jdkr ||jvS||jvS)NF all_others)rWrRrbars r bar_is_ignoredz ProgressBarLogger.bar_is_ignoreds9   $5  , . .di' '$++ +r c@|jsdS|jdkrdS||jvS)NFrFT)rXr^s r bar_is_loggedzProgressBarLogger.bar_is_loggeds3 +5   & &4$** *r cbt|drt|nd}|duo ||jkS)N__len__)hasattrrrZ)rr9lengths r iterable_is_too_shortz'ProgressBarLogger.iterable_is_too_shorts8")(I">">HXDd"I$2H)HIr c Jd|vr|dnd|\srS|zt drdidzt ifd}|S)aIterate through a list while updating a state bar. Parameters ---------- bar_prefix : str Bar prefix. Examples -------- >>> for username in logger.iter_bar(user=['tom', 'tim', 'lea']): >>> # At every loop, logger.state['bars']['user'] is updated >>> # to {index: i, total: 3, title:'user'} >>> print (username) bar_messageNrd__totalc 3lKtj}d}tD]W\}}tj}|dks||z jkr'didz|ididz|i|}|VXjd|kr didz|ididz|dzidS)Nr __message__indexrKr-)time enumeraterYrR) last_timeir:now_timer_rjr9rs r new_iterablez0ProgressBarLogger.iter_bar..new_iterables IA"8,,  29;;FF9 4t7M M M".DDk 1;;r??CDDDD00C)OQ/000 (Iy~g&!++,,i+,,, D , ,C)OQU+ , , , , ,r r-)poppopitemr`rgrer)r bar_prefixr/rur_rjr9s` @@@r iter_barzProgressBarLogger.iter_bars B  &&//KKK X   s # # t'A'A('K'K O3 8Y ' ' 5 D 4 4C)OS]]3 4 4 4 - - - - - - - - |~~r cdS)aExecute a custom action after the progress bars are updated. Parameters ---------- bar Name/ID of the bar to be modified. attr Attribute of the bar attribute to be modified value New value of the attribute old_value Previous value of this bar's attribute. This default callback does nothing, overwrite it by subclassing. Nr-)rr_attrvalue old_values r bars_callbackzProgressBarLogger.bars_callbacks & r c t|d}|D]7\}}d|vr,|d\}}||r9||||jvrt |ddd|j|<|j||}||ru|dko||k}|dks|r|j|j|d<n|j|d|_| d |d |d ||xj|j z c_||j||<| ||||9|j ||jd i|dS) Nc:|dd S)NrrL)endswith)kvs r z,ProgressBarLogger.__call__..sbennW6M6M2Mr )key__rI)rJrKrLr!rKrLrM[z] z: r-)sortedr7splitr`rvrRrNrbrr" bar_indentr~rrr0) rr/r7rr|r_r{r}new_bars r r=zProgressBarLogger.__call__srxxzz'M'MNNN @ @JCs{{IIdOO T&&s++s di''%)2TSW%X%X%XDIcN IcN40 %%c**7#wGUY5FGW37? #x00*.)C.*BHHHccc444?@@@OOt6OO', #t$""3eY??? " r )NNNrFrr)rhr>)r?r@rArBrrpropertyrRr`rbrgryr~r=r-r r rDrD_s.J 33336""X",,,+++JJJ,,,,\    *r rDcDeZdZdZ d dZd Zd Zd Zd ZdS)TqdmProgressBarLoggera^Tqdm-powered progress bar for console or Notebooks. Parameters ---------- init_state : dict Initial state of the logger. bars : None, list, tuple, or dict, optional Either None (will be initialized with no bar) or a list/tuple of bar names (e.g., ['main', 'sub']) which will be initialized with index -1 and no total, or a dictionary (possibly ordered) of bars, of the form `{bar_1: {title: 'bar1', index: 2, total: 23}, bar_2: {...}}`. leave_bars : bool, optional Whether to leave the progress bars displayed upon completion. ignored_bars : None, list of str, or 'all_others', optional Either None (newly met bars will be added) or a list of blacklisted bar names, or 'all_others' to signify that all bar names not already in `self.bars` will be ignored. notebook : bool, optional True will make the bars look nice (HTML) in the Jupyter notebook. It is advised to leave to 'default' as the default can be globally set from inside a notebook with `import proglog; proglog.notebook_mode()`. print_messages : bool If True, every `logger(message='something')` will print a message in the console or notebook. min_time_interval : int or float Time in seconds between progress bar updates. ignore_bars_under : int NFrFdefaultTrc t|||||| |||_td|jD|_|dkr t d}||_||_|jrtnt|_ dS)N)rrRrWrXrZrYcg|]}|dfSr>r-)rOr_s r rQz2TqdmProgressBarLogger.__init__..@s%G%G%GcsDk%G%G%Gr rr) rDr leave_barsrrR tqdm_barsr rprint_messagesrr) rrrRrrWrXrrrYrZs r rzTqdmProgressBarLogger.__init__*s "" !%#// #   %$%G%GTY%G%G%GHH y  +H  ,%)] ! !s(;(G    $ $ $ #"ii.w_Sy1A-B-BCCDDD/ (  sr cj|j||js d|j|<dSdS)zClose and erase the tqdm bar.N)rcloserr^s r rz$TqdmProgressBarLogger.close_tqdm_barSsA s!!###} '"&DN3    ' 'r c\||jvs |j||||dkr||krW|j|d}|r||kr||dS|j|||z dS|||j||dzdS|dkr]|j|t t||j|ddSdS)NrKrLror!rr)rrrRrr set_postfixrr)rr_r{r|r}rLs r r~z#TqdmProgressBarLogger.bars_callbackYs= t~ % %4>#+>+F   c " " " 7?? !! #w/Beunn'',,,,,N3'..uy/@AAAAA!!#&&&s#**51955555 Y   N3  + +E 0K0K + L L L N3  & &q ) ) ) ) ) r c |jrLd|vrJ|drD|jrt|ddS|j|ddSdSdSdS)Nr!)rrprintrr'r.s r r0zTqdmProgressBarLogger.callbackjso   /IOOIO} /bm$$$$$ 9 .....  / /OOOOr ) NNFNrFrTrr) r?r@rArBrrrr~r0r-r r rr s> ====:    ''' ***"/////r rceZdZdZdZdS)RqWorkerProgressLoggerc||_d|jjvr*i|jjd<|jdSdSN progress_data)jobmetasave)rrs r rzRqWorkerProgressLogger.__init__ssA $(- / /-/DHM/ * HMMOOOOO 0 /r c `|j|jjd<|jdSr)rrrrr.s r r0zRqWorkerProgressLogger.callbackys%)- o&  r N)r?r@rArr0r-r r rrrs2 r rc eZdZ ddZdS)RqWorkerBarLoggerNr-rFrc|t||t||||||dS)N)rrRrWrXrY)rrrD)rrrrRrWrXrYs r rzRqWorkerBarLogger.__init__sS ''c222"" !%#/ #     r )NNr-rFr)r?r@rArr-r r rr~s9        r rceZdZdZdS)MuteProgressBarLoggercdS)NTr-r^s r r`z$MuteProgressBarLogger.bar_is_ignoredstr N)r?r@rAr`r-r r rrs#r rrFcZ|dkrt|||||S|tS|S)Nr_)rRrWrXrYrZ)rr)loggerrRrWrXrYrZs r default_bar_loggerrsK$%#//      $&&& r )r)r )NNrFrr)rBrr collectionsrrpr rrrrDrrrrrr-r r rsNN$$$$$$$$######  ====DDDDJJJJJJJJZjjjjjjjjZc/c/c/c/c/-c/c/c/L             .0A   ,-  r