o jEiT@sddlZddlZddlmZddlmZmZddlmZee Z edddZ edZ dd Z ed d d d dZdddZed d d dddZed d d dddZdddZdS)N)retry)datetime timedelta)timezoneizAmerica/TorontocCs6t|trt|dks|std|dSdS)N zInvalid ASIN format: FT) isinstancestrlenisalnumloggererror)asinr3/var/www/agentarbitrage/keepa_deals/stable_deals.py validate_asinsri)stop_max_attempt_number wait_fixedc Csntd|dtd|did|dddgddgd d gd d d gdddgdddgdddgddddddddddddd d!d"d!dd!ddddd#d$d%}tj|d&d!d'}td(|tj|}d)|d*|}d+d,i}td-|ztj ||d.d/}td0|j |j d1krt d2|j d3|j td2|j d3|j gWS|}| d4i d5g} td6t | d7d8d9| Dtd:t| d4itd;dd9| Dtd6t | d?| WSty6} zt d@t| td@t| gWYd} ~ Sd} ~ ww)ANzFetching deals page z for Percent Down 90...pagedomainId1excludeCategoriesincludeCategoriesiR priceTypes deltaRangeii&deltaPercentRange2isalesRankRangeiPi` currentRangeiiu minRatingrisLowestF isLowest90 isLowestOffer isOutOfStock titleSearchisRangeEnabledTisFilterEnabled3) filterEroticsingleVariation hasReviewsisPrimeExclusivemustHaveAmazonOffermustNotHaveAmazonOffersortType dateRange),:) separators sort_keyszRaw query JSON: zhttps://api.keepa.com/deal?key=z &selection=z User-Agentz>Mozilla/5.0 (Windows NT 10.0; Win64; x64) Chrome/90.0.4430.212z Deal URL: )headerstimeoutzFull deal response: zDeal fetch failed: z, dealsdrzFetched z deals: cSsg|]}|ddqS)r-)get.0drrr Gz)fetch_deals_for_deals..zDeal response structure: zAll deal keys: cSsg|]}t|qSr)listkeysr@rrrrCIrDz Deals data: c Ss~g|];}|dd|dgt|dgdkr#|ddgddndt|dgdkr9|ddgddnddqS)rr>current r)rrGz current[9]z current[1])r?r r@rrrrCJs~z dealszDeal fetch exception: )r debugprintjsondumpsurllibparsequoterequestsr?text status_coder r rErF Exceptionr ) rapi_key deal_query query_jsonencoded_selectionurlr9responsedatar<errrfetch_deals_for_dealss       $ r^c Cs\|r|nt}|dd}|dd}|d||dkr!d}ntt|d}|rtd|}|t}d }|d |d |d tj |d |d |d | |d |d |d| |d |d |dt|d |d |d| |d |d |d|j |d |d |d| d| iSddiS)Nr Unknown ASIN creationDaterzDeal found - raw ts=順minutesUTC deal_foundASIN:  - Timezone Debug (z) - KEEPA_EPOCH.tzinfo: z) - dt (naive UTC from Keepa): z) - utc_dt (aware UTC): z) - TORONTO_TZ object: z') - toronto_dt (converted to Toronto): z) - toronto_dt.tzinfo: z) - toronto_dt.utcoffset(): z Deal foundr>) r r?rK KEEPA_EPOCHrrlocalize astimezone TORONTO_TZtzinfo isoformat utcoffset) deal_object logger_paramcurrent_loggerrtsdtutc_dt toronto_dt func_namerrrreSs(         rec Cs|r|nt}|d|r|ddnd}g}g}|r}t|tr}|dr}t|dtr}t|ddkr}t|ddtr}d|ddvr}|ddd}t|ttfrq|dkrq|||d|d| d |d |n | d |d |d |d}t|ttfr|dkr|||d |d| d |d|n | d |d|d |rt|tr|dr|dd} t| ttfr| dkr|| |d| d| d |d| n | d |d| d|s| d |d|r|nddddiSt |} | d |d| d|d|| } | dkr;| d |d| dddiSz|t t| d} td | } | t}| d |d!t j| d |d"| | d |d#| | d |d$t| d |d%|| d |d&|j| d |d'||d(}| d)|d|iWSty}z| d*t|ddiWYd}~Sd}~ww)+Nrr_productsr lastUpdateraz%product_data.products[0].lastUpdate ()rfz - Found ts_product_general: z - ts_product_general (z) is invalid or None.zdeal_object.lastUpdate (z - Found ts_deal_general: z - ts_deal_general (statslastOffersUpdatez%product_data.stats.lastOffersUpdate (z - Found ts_offers_update: z - ts_offers_update (z-) from product_data.stats is invalid or None.zO - No valid timestamps found for last_update from any source. Sources checked: None.z last updater>z# - last_update: Selected latest_ts=z from candidates z. Sources considered: z? - No valid lastUpdate after considering all sources (final ts=rbrdz( - Timezone Debug - KEEPA_EPOCH.tzinfo: z/ - Timezone Debug - dt (naive UTC from Keepa): z( - Timezone Debug - utc_dt (aware UTC): z' - Timezone Debug - TORONTO_TZ object: z7 - Timezone Debug - toronto_dt (converted to Toronto): z' - Timezone Debug - toronto_dt.tzinfo: z, - Timezone Debug - toronto_dt.utcoffset(): %Y-%m-%d %H:%M:%Szlast update result: zlast_update failed: )r r?rdictrEr intfloatappendrKr maxinforhrrrirjrkrlrmrnstrftimerUr )rorp product_datarqrpossible_timestampssources_checkedts_product_generalts_deal_generalts_offers_update latest_tsrrrsrtru formattedr]rrr last_updateqst  "    ""    rc Cs,|r|nt}|d|r|ddnd}d}d}|rt|tr|drt|dtrt|ddkrt|ddtrd|ddvrt|dddtr|ddd}gd}g} |d |d ||D]F} | t|krt|| tr|| r|| d} t| trt| dkr| d} t| ttfr| d kr| | |d |d | d | qj| rt | }dt| d|d}| d |d|d| |d kr| d |d|d|dg} gd}g}|d |d|| rt| tr|D]A}|t| kr2| |} t| ttfr0| d kr0| | |d |d|d | q|d |d|dt| dq|dg}d}d}t||kr||dkr|d |d |d!|d"t| |kr| |}t|ttfr|d kr| ||d |d#|d$|n=|d |d%|d&|n.|d |d't| d(|d)nt||kr||nd*}|d |d+|d,|d-|rt |}d.t|d/}| d |d0|d1|n | d |d2| |d |d3|d4||d kr#d |d5|d}| |d6d7iSzKtt|d8}td9|}|t}d:}|d |d;|d<|d=|d>| |d?}| d |d@|dA|dB|d d6|iWSty}z| d |dC|d t|d6d7iWYd}~Sd}~ww)DNrr_rIzNo valid timestamp foundrwrcsv)rrfzE - Checking product_data.csv for used item timestamps using indices: raz3 - Found product_data.csv timestamp for used index z: zproduct_data.csv (max of z# used item timestamps from indices ryzE - Using product_data.csv for last used price change. Max timestamp: z . All found: zA - No valid used item timestamp from product_data.csv (latest_ts=z;). Falling back to deal_object.currentSince for used items. currentSince)rrJrzR - Checking deal_object.currentSince for used item timestamps using base indices: z; - Found deal_object.currentSince timestamp for used index z" - deal_object.currentSince index z out of bounds (len: z).rG rz( - Buy Box is Used (deal_object.current[z]==1). Checking currentSince[z] for Used Buy Box timestamp.zD - Found deal_object.currentSince timestamp for Used Buy Box (index z): z( - Used Buy Box timestamp (currentSince[z]) is invalid or not recent: z& - currentSince array too short (len: z) to check index z for Used Buy Box.zN/Az, - Buy Box is not Used (deal_object.current[z]=zD) or current array too short. Skipping Used Buy Box timestamp check.z!deal_object.currentSince (max of z7 used item timestamps including potential Used Buy Box)zM - Using deal_object.currentSince for last used price change. Max timestamp: z. All considered: z - No valid used item timestamps in deal_object.currentSince from specified indices (incl. Used Buy Box if applicable). Array was: z, - last used price change - selected raw ts=z from zO - No valid last *used* price change timestamp found from any source (final ts=zlast price changer>rbrdlast_price_changergz) - dt (naive UTC): z, utc_dt (aware UTC): z, toronto_dt: r~z/ - last price change (focused on used) result: z (from ts z via zL - last_price_change (focused on used) failed during date conversion for ts )r r?rrrEr rKrrrrrwarningr rhrrrirjrkrmrrUr )rorprrqrrsource_descriptionproduct_csv_datarelevant_used_csv_indicestimestamps_from_csvindex last_entryts_valcurrent_since_arrayrelevant_current_since_indicesvalid_current_since_tsicurrent_stats_arraybuy_box_is_used_indexbuy_box_used_price_ts_indexts_val_buy_box_usedbuy_box_is_used_val log_messagersrtrurvrr]rrrrs  "&"     &  $   4 $  rc Cs|r|nt}|dd}|rt|dtr|ds'|d|dddiS|d}dd d d d d ddddd }td}d}|D]T}|dg} t| dkrOq@z#t| d} t| d} | dkrbd} | | } | |krq| }|d}Wq@tt fy} z| d|d| d| WYd} ~ q@d} ~ ww|dur||vr||}| d|d|ddd|d |d! d"|vr| d"d#}d|iSd$|vr| d$d%}d|iS|d|d&|d'dd(|d!iS|d|d)ddiS)*Nrr_offersrfzA - Product data has no 'offers' list. Cannot determine condition. Conditionr>NewzUsed, like newzUsed, very goodz Used, goodzUsed, acceptable RefurbishedzCollectible, like newzCollectible, very goodzCollectible, goodzCollectible, acceptable) rrrr*rrrrHrinfofferCSVrrIr conditionz= - Could not parse price from offerCSV for one offer. Error: z . OfferCSV: z! - Found lowest priced offer at $dz.2fz with condition: z (ryzUsed, r'z Collectible, zC-z1 - Found lowest priced offer but condition code 'z ' is unknown.z Unknown (z0 - No valid offers found to determine condition.) r r?rrErrr r ValueError IndexErrorrKrreplace)rrprqrrcondition_mapping lowest_pricebest_condition_codeoffer offer_historypriceshipping total_pricer] condition_strrrr get_condition4sV           *  r)N)NN)loggingrMretryingrrrpytzr getLogger__name__r rhrkrr^rerrrrrrrs"       9   J w