YjodZddlmZddlZddlZddlZddlmZddlm Z m Z m Z m Z ddl mZddlmZddlmZmZejeZd%dZd&dZeGddZ d'd(d$ZdS))uPer-turn setup for ``run_conversation`` (the turn prologue). ``run_conversation`` opened with ~470 lines of straight-line setup before the tool-calling loop ever started: stdio guarding, runtime-main wiring, retry-counter resets, user-message sanitization, todo/nudge-counter hydration, system-prompt restore-or-build, crash-resilience persistence, preflight context compression, the ``pre_llm_call`` plugin hook, and external-memory prefetch. All of that is *prologue* — it runs once per turn, has no back-references into the loop, and produces a fixed set of values the loop then consumes. ``TurnContext`` captures those produced values; ``build_turn_context`` performs the setup work and returns one. ``run_conversation`` is left to unpack the context and run the loop, shrinking the orchestrator by the full prologue. The builder still mutates ``agent`` heavily (counters, thread id, cached prompt, session DB) exactly as the inline code did — those side effects are the point. The ``TurnContext`` it returns carries only the *locals* the loop reads back. Behavior is identical to the original inline prologue; this is a pure move-and-name refactor with no semantic change. ) annotationsN) dataclass)AnyDictListOptional)&conversation_history_after_compression)IterationBudget)estimate_messages_tokens_roughestimate_request_tokens_roughorig_lenintnew_len orig_tokens new_tokensreturnboolc0||krdS|dko||dzkS)uFReturn ``True`` if a compression pass materially reduced the request. Compression can succeed by summarising message contents — reducing the estimated request token count — without reducing the message row count. Treating row count as the sole progress signal false-positives on size-only wins and surfaces a misleading "Cannot compress further" failure even when post-compression tokens are well below the model context window. See issue #39548 for an observed case: 220 → 220 messages, ~288k → ~183k tokens on a 1M-context model still triggered auto-reset. The token reduction must be *material* (>5%) to count as progress — the same floor the overflow-handler retry path uses (conversation_loop.py, #39550) — so a sub-5% wobble doesn't keep the multi-pass loop spinning. Trgffffff?)r rrrs GC:\Users\server\AppData\Local\hermes\hermes-agent\agent\turn_context.py_compression_made_progressr)s-$t ? >zK$,>>>messagesList[Dict[str, Any]]protect_first_nprotect_last_nthreshold_tokensc^t|||zdzkrdSt||kS)uCheap gate for the (expensive) full preflight token estimate. Returns ``True`` when either: (a) message count exceeds the protected ranges (the historical gate), or (b) a cheap char-based estimate already crosses the configured threshold — the few-but-huge case from issue #27405 that the count-only gate would silently skip (a handful of very large messages never trips the count condition, so compression was never attempted and the turn hit a hard context-overflow error). Branch (b) uses ``estimate_messages_tokens_rough`` (the shared char-based estimator) so a single large base64 image isn't mistaken for ~250K tokens. It intentionally undercounts vs. the full request estimate — it omits the system prompt and tool schemas — because it is only a *hint* deciding whether to pay for the authoritative ``estimate_request_tokens_rough``, which (together with ``should_compress``) makes the real decision. T)lenr )rrrrs r_should_run_preflight_estimater!@s8. 8}}7!;;;t )( 3 37G GGrceZdZUdZded<ded<ded<ded <d ed <ded <ded <ded<dZded<dZded<dZded<dS) TurnContextzCValues produced by the turn prologue and consumed by the turn loop.str user_messageroriginal_user_messagerrOptional[List[Dict[str, Any]]]conversation_history Optional[str]active_system_prompteffective_task_idturn_idrcurrent_turn_user_idxFrshould_review_memoryplugin_user_contextext_prefetch_cacheN)__name__ __module__ __qualname____doc____annotations__r.r0r1rrrr#r#\sMM""""8888''''LLL!&&&&&!!!!!       rr#r%rsystem_messager)r(r'task_idpersist_user_message Optional[Any]persist_user_timestampOptional[float]cA|  ddlm}|tddpdtddpdtddpdtddpdtddpd n#t$rYnwxYw| j| td d  td d s,ddl}d|jvrddlm }m }|r |dn,#t$rt ddYnwxYwt|tr | |}t|tr | |}|_d_|_|_|ptt'j}|_jpdd|dt'jjdd}|_d_ddlm}||d_d_d_d_d_d_ d _!d_"d _#d _$d_%j&'d_(tj)dd}tU|r |d_+j,dkr; -r.dn#t$rYnwxYwj/r0d_/tcj2_3| |}ti|dkr |dddzn|}|5dd}t6d jpd!j7j8pd"j9pd"tipg|rtungAtd#d}||n|}t|tvr!|<d$|kr|}||d$<n!d%|d&}t|tvrd_=r.j>?s@rVjAdkrKtd'D}|dkr,|_AjCdkrjDdkr|jCz_DAE|tiAd(z }|_xjAd(z c_Ad_Ftd)d}||Gtd*d}||G||n|} d }!jCdkr9d+jHvr0j)r)xjDd(z c_DjDjCkr d}!d_Dtd,d}"|"0 dd-lImJ}#|#| }$|$r |"|$n#t$rYnwxYwjKsC| |}%Ld.|%dd/ti|%d/krdndd0jM ||jM}&td1d}'dYAfd4 }( |' |(n$|'5|(dddn #1swxYwYn4#t$r'tNd5jpd!dYnwxYwt|tvr|<d6rd_=n6#t|tvr|<d6rd_=wxYwjOrtAjQjRjQjSjQjTrtA|&pdjVpd7})jQ}*t|*d8d9}+|+|)},tddd:ko3ttd;d<pd<Wd=v}-|,s|*jX}.|.dkr |)|.kr|)|*_Xt|*d>d?}/|,r/t6d@|)dA|*jTdA|*jYdAn|/rFt6dBt|/<dCdDjpd!n_|-r,t6dEtd;d<n1|*[|)rt6dF|)dA|*jTdAj7|*j\dA.dG|)dAdH|*jTdAdItdJD]}0tiA}1|)}2^A||)|K\A}&tA|&pdjVpd7})t|1tiA|2|)snKtAd_d_ d_"d _#d _$|*[|)snd}3 ddLlamb}4|4dMj||| tuAt j7tdNdpdtdOdpdP }5g}6 ddQldme}7mf}8|7}9n#t$rd}8d}9YnwxYw|5D]}:d};t|:tvr+|:<dRrt|:dR};n-t|:tr|:gr|:};nq|8H |8|;jdS|9T};n2#t$r%}jvwjA|>n#t$rYnwxYwd}?jvrG t| tr| nd}@jvx|@pd}?n#t$rYnwxYwt|| A|&||||!|3|?X S)ZaRun the once-per-turn setup and return the loop's input context. The callables/helpers the original prologue referenced from the ``conversation_loop`` module are passed in explicitly to keep this module free of an import cycle with ``agent.conversation_loop``. r)set_runtime_mainproviderr/modelbase_urlapi_keyapi_mode)rArBrC_memory_write_originassistant_tool_skip_mcp_refreshFNztools.mcp_tool)has_registered_mcp_toolsrefresh_agent_mcp_toolsT) quiet_modez&between-turns MCP tool refresh skipped)exc_infosession:)note_turn_startreset_consolidation_failuresanthropic_messagesu~🔌 Detected stale connections from a previous provider issue — cleaned up automatically. Proceeding with fresh connection.Pz...  zPconversation turn: session=%s model=%s provider=%s platform=%s history=%d msg=%rnoneunknown_pending_cli_user_messagecontentuser)rolerWc3LK|]}|ddkdV dS)rYrXrN)get).0ms r z%build_turn_context..4s?  quuV}}/F/FA/F/F/F/F  rr_stream_context_scrubber_stream_think_scrubbermemoryreaction_callback)detect_reactionu💬 Starting conversation: '<'_session_persist_lockrNonec\dSN)_ensure_db_session_persist_session)agentr(rsr_ensure_and_persistz/build_turn_context.._ensure_and_persists2   """ x)=>>>>>rz:Early turn-start session persistence failed for session=%s _db_persisted) system_prompttools$should_defer_preflight_to_real_usagecdS)NFr)_tokenss rz$build_turn_context..sErcodex_app_server codex_app_server_auto_compactionnative>offrw'get_active_compression_failure_cooldowncdSrirrrrrtz$build_turn_context..sDrzpSkipping preflight compression: rough estimate ~%s >= %s, but last real provider prompt was %s after compression,z`Skipping preflight compression: same-session cooldown active (~%s seconds remaining, session %s)remaining_secondsgzsSkipping Hermes preflight compression for codex app-server (mode=%s); Hermes will not start thread compaction here.zDPreflight compression: ~%s tokens >= %s threshold (model %s, ctx %s)u📦 Preflight compression: ~z tokens >= z# threshold. This may take a moment.) approx_tokensr8) invoke_hook pre_llm_callplatform_user_id) session_idr8r,r%r( is_first_turnr@r sender_id)get_spill_configspill_if_oversizedcontextz plugin hook)rsourceconfigzhook context spill failed: %sz zpre_llm_call hook failed: %s) r%r&rr(r*r+r,r-r.r0r1)rrg)zagent.auxiliary_clientr>getattr Exceptionr_restore_primary_runtimesysmodulestools.mcp_toolrGrHloggerdebug isinstancer$_stream_callback_persist_user_message_idx_persist_user_message_override_persist_user_message_timestampuuiduuid4_current_task_idhex_current_turn_id_current_api_request_idagent.agent_runtime_helpersrN_invalid_tool_retries_invalid_json_retries_empty_content_retries_incomplete_scratchpad_retries_codex_incomplete_retries_thinking_prefill_retries_post_tool_empty_retried_last_content_with_tools$_last_content_tools_all_housekeeping_mute_post_response_unicode_sanitization_passes_tool_guardrailsreset_for_turn_tool_guardrail_halt_decision _memory_storecallable_vision_supportedrC_cleanup_dead_connections _emit_status_compression_warning_replay_compression_warningr max_iterationsiteration_budgetr replaceinfor@r?rlistdictr[rV _todo_store has_items_hydrate_todo_store_user_turn_countsum_memory_nudge_interval_turns_since_memoryappend_is_user_initiated_turnresetvalid_tool_namesagent.reactionsrcrI _safe_print_cached_system_promptwarningcompression_enabledr!context_compressorrrrr rplowerlast_prompt_tokenslast_real_prompt_tokensrshould_compresscontext_lengthrange_compress_contextrr hermes_cli.pluginsrrtools.hook_output_spillrrstripjoin_turn_failed_file_mutationsset_turn_file_mutation_paths_verification_stop_nudges_pre_verify_nudges threadingcurrent_threadident_execution_thread_id_set_interrupt_interrupt_requested _interrupt_thread_signal_pending_interrupt_message_memory_manager on_turn_start prefetch_allr#)Brlr%r7r(r8stream_callbackr9r;restore_or_build_system_promptinstall_safe_stdiosanitize_surrogatessummarize_user_message_for_logset_session_contextset_current_write_originrar>_sysrGrHr+r,rN _reset_consol _preview_text _msg_previewpending_cli_messageexpected_persist_contentuser_msgprior_user_turnsr-scrubberthink_scrubberr&r.rbrckind_print_previewr* persist_lockrm_preflight_tokens _compressor_defer_preflight_preflight_deferred_codex_native_auto_last_compression_cooldown_pass _orig_len _orig_tokensr0 _invoke_hook _pre_results _ctx_parts _spill_cfg_spill_if_oversized_spill_config_cachedr_piece _spill_excexc _turn_msgr1_queryrsB` ` @rbuild_turn_contextrws2  ;;;;;; E:r * * 0b E7B ' ' -2UJ339rE9b117RUJ339r            ()))WU,BDTUUVVV ""$$$Nu1599 D    4<//\\\\\\\\++--D++EdCCCC NNN = MMMMMN,$$9**<88 &,,I223GHH-E&*E#+?E(,BE)43tz||#4#4.E!.Y[[1B[[TZ\\EUVXWXVXEY[[G$E$&E!<;;;;;OE7####$E"#E#$E +,E(&'E#&'E#%*E"%)E"16E. %E)*E& ))+++*.E'E/1OQUVVM  "E ~--- ..00 """     D  !* ))+++%)"-U-ABBE32<@@M36}3E3E3J3JM#2#&..P]L''c22L KKZ "FEK1L9 #)S)=)C%D%D .BIt()))rH"%)DdKK 4 @l &-- 3  # #I . .2J J J&+"|<< )4 0 0 3.2E +8E$5$?$?$A$A8 !!"6777\ 6! ; ;  +      a  %5E "+a//E4MQR4R4R,RSSS 6 5"94@@L???????? 3     ! ! ! ! & &##%%% & & & & & & & & & & & & & & &     H   &       -t44 38K8O8OP_8`8` 3.2E +-t44 38K8O8OP_8`8` 3.2E + 2 2 2 2   l%C  0  /  1 &&l : .4"+%    . "  2 ! !   /./@AA E:t , ,0B B !6  egg ! # C2Ezz/%771B .!   5 L! ! ! !  ?  KKI$((/336::     #7  KK6)--.A3GGHH *F       0  KKKA8LL      ( (): ; ;*  KKV$((/33 -11       *0AM**!2B***    q  MM 0 161H1Hnm9m0m99 n(n##n(9r r"!r"/5s%% s21s2) r rrrrrrrrr) rrrrrrrrrrri)r%rr7r)r(r'r8r)r9r:r;r<rr#)r5 __future__rloggingrr dataclassesrtypingrrrragent.conversation_compressionr agent.iteration_budgetr agent.model_metadatar r getLoggerr2rrr!r#rrrrrsg,#""""" !!!!!!,,,,,,,,,,,,QQQQQQ222222  8 $ $????.HHHH8 !!!!!!! !D/3xxxxxxxr