Package evaluation to test LLMCheatsheets on Julia 1.14.0-DEV.2593 (15c2b67521*) started at 2026-07-04T04:36:02.806 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 15.82s ################################################################################ # Installation # Installing LLMCheatsheets... Resolving package versions... Installed CodecZlib ─────────── v0.7.8 Installed AbstractTrees ─────── v0.4.5 Installed ConcurrentUtilities ─ v2.5.1 Installed URIs ──────────────── v1.6.1 Installed ExprTools ─────────── v0.1.10 Installed Compat ────────────── v4.18.1 Installed ExceptionUnwrapping ─ v0.1.11 Installed TranscodingStreams ── v0.11.3 Installed LoggingExtras ─────── v1.2.0 Installed BitFlags ──────────── v0.1.10 Installed OpenAI ────────────── v0.9.1 Installed MbedTLS ───────────── v1.1.10 Installed OpenSSL ───────────── v1.6.1 Installed PrecompileTools ───── v1.3.4 Installed HTTP ──────────────── v1.11.0 Installed JSON3 ─────────────── v1.14.3 Installed Parsers ───────────── v2.8.6 Installed SimpleBufferStream ── v1.2.0 Installed JLLWrappers ───────── v1.8.0 Installed MbedTLS_jll ───────── v2.28.1010+0 Installed StructTypes ───────── v1.11.0 Installed Preferences ───────── v1.5.2 Installed LLMCheatsheets ────── v0.1.0 Installed Mocking ───────────── v0.8.1 Installed PromptingTools ────── v0.56.1 Installing 1 artifacts Installed artifact MbedTLS 1.0 MiB Updating `~/.julia/environments/v1.14/Project.toml` [bfa53fcd] + LLMCheatsheets v0.1.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [d1d4a3ce] + BitFlags v0.1.10 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.18.1 [f0e56b4a] + ConcurrentUtilities v2.5.1 [460bff9d] + ExceptionUnwrapping v0.1.11 [e2ba6199] + ExprTools v0.1.10 ⌅ [cd3eb016] + HTTP v1.11.0 [692b3bcd] + JLLWrappers v1.8.0 [0f8b85d8] + JSON3 v1.14.3 [bfa53fcd] + LLMCheatsheets v0.1.0 [e6f89c97] + LoggingExtras v1.2.0 [739be429] + MbedTLS v1.1.10 [78c3b35d] + Mocking v0.8.1 ⌅ [e9f21f70] + OpenAI v0.9.1 [4d8831e6] + OpenSSL v1.6.1 [69de0a69] + Parsers v2.8.6 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 ⌅ [670122d1] + PromptingTools v0.56.1 [777ac1f9] + SimpleBufferStream v1.2.0 [856f2bd8] + StructTypes v1.11.0 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] + LibCURL_jll v8.21.0+0 [e37daf67] + LibGit2_jll v1.9.4+0 [29816b5a] + LibSSH2_jll v1.11.101+0 [14a3606d] + MozillaCACerts_jll v2026.5.14 [458c3c95] + OpenSSL_jll v3.5.7+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.69.0+0 [3f19e933] + p7zip_jll v17.8.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 8.79s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling project... 9.1 s ✓ TestEnv 1 dependency successfully precompiled in 9 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling project... 39.5 s ✓ URIs 38.6 s ✓ BitFlags 75.8 s ✓ AbstractTrees 1.0 s ✓ ExprTools 56.3 s ✓ TranscodingStreams 0.9 s ✓ SimpleBufferStream 2.3 s ✓ ConcurrentUtilities 32.5 s ✓ StructTypes 32.2 s ✓ LoggingExtras 2.0 s ✓ Compat 31.7 s ✓ Preferences 38.2 s ✓ ExceptionUnwrapping 80.2 s ✓ OpenSSL 20.0 s ✓ CodecZlib 1.0 s ✓ Compat → CompatLinearAlgebraExt 32.2 s ✓ JLLWrappers 31.9 s ✓ PrecompileTools 49.1 s ✓ Aqua 1.3 s ✓ Mocking 32.4 s ✓ MbedTLS_jll 68.7 s ✓ Parsers 33.1 s ✓ MbedTLS 45.6 s ✓ JSON3 165.4 s ✓ HTTP 64.7 s ✓ OpenAI ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! └ @ PromptingTools ~/.julia/packages/PromptingTools/lqJyF/src/user_preferences.jl:165 ┌ Info: JuliaLowering threw given input: │ code = │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =# Core.@doc " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" function retrieve(retriever::AbstractRetriever, index::AbstractDocumentIndex, question::AbstractString; verbose::Integer = 1, top_k::Integer = 100, top_n::Integer = 5, api_kwargs::NamedTuple = NamedTuple(), rephraser::AbstractRephraser = retriever.rephraser, rephraser_kwargs::NamedTuple = NamedTuple(), embedder::AbstractEmbedder = retriever.embedder, embedder_kwargs::NamedTuple = NamedTuple(), processor::AbstractProcessor = retriever.processor, processor_kwargs::NamedTuple = NamedTuple(), finder::AbstractSimilarityFinder = retriever.finder, finder_kwargs::NamedTuple = NamedTuple(), tagger::AbstractTagger = retriever.tagger, tagger_kwargs::NamedTuple = NamedTuple(), filter::AbstractTagFilter = retriever.filter, filter_kwargs::NamedTuple = NamedTuple(), reranker::AbstractReranker = retriever.reranker, reranker_kwargs::NamedTuple = NamedTuple(), cost_tracker = Threads.Atomic{Float64}(0.0), kwargs...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1058 =# │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1082 =# │ rephraser_kwargs_ = if isempty(api_kwargs) │ rephraser_kwargs │ else │ merge(rephraser_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1084 =# │ rephrased_questions = rephrase(rephraser, question; verbose = verbose > 1, cost_tracker, rephraser_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1088 =# │ embeddings = if HasEmbeddings(index) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1089 =# │ embedder_kwargs_ = if isempty(api_kwargs) │ embedder_kwargs │ else │ merge(embedder_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1091 =# │ embeddings = get_embeddings(embedder, rephrased_questions; verbose = verbose > 1, cost_tracker, embedder_kwargs_...) │ else │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1094 =# │ embeddings = hcat([Float32[] for x = rephrased_questions]...) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1098 =# │ keywords = if HasKeywords(index) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1100 =# │ keywords = get_keywords(processor, rephrased_questions; verbose = verbose > 1, processor_kwargs..., return_keywords = true) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1103 =# │ verbose >= 1 && (keywords isa AbstractVector{<:AbstractVector{<:AbstractString}} || #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =# @warn("Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: $(typeof(processor))).")) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1105 =# │ keywords │ else │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1107 =# │ [String[] for x = rephrased_questions] │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1110 =# │ finder_kwargs_ = if isempty(api_kwargs) │ finder_kwargs │ else │ merge(finder_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1112 =# │ emb_candidates = find_closest(finder, index, embeddings, keywords; verbose = verbose > 1, top_k, finder_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1116 =# │ tagger_kwargs_ = if isempty(api_kwargs) │ tagger_kwargs │ else │ merge(tagger_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1118 =# │ tags = get_tags(tagger, rephrased_questions; verbose = verbose > 1, cost_tracker, tagger_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1121 =# │ filter_kwargs_ = if isempty(api_kwargs) │ filter_kwargs │ else │ merge(filter_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1123 =# │ tag_candidates = find_tags(filter, index, tags; verbose = verbose > 1, filter_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1128 =# │ filtered_candidates = if isnothing(tag_candidates) │ emb_candidates │ else │ emb_candidates & tag_candidates │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1135 =# │ reranker_kwargs_ = if isempty(api_kwargs) │ reranker_kwargs │ else │ merge(reranker_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1137 =# │ reranked_candidates = rerank(reranker, index, question, filtered_candidates; top_n, verbose = verbose > 1, cost_tracker, reranker_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1140 =# │ verbose > 0 && #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =# @info("Retrieval done. Identified $(length(positions(reranked_candidates))) chunks, total cost: \$$(round(cost_tracker[], digits = 2)).") │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# │ result = RAGResult(; question, answer = nothing, rephrased_questions, final_answer = nothing, context = collect(index[reranked_candidates, :chunks, sorted = true]), sources = collect(index[reranked_candidates, :sources, sorted = true]), emb_candidates, tag_candidates, filtered_candidates, reranked_candidates) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1157 =# │ return result │ end) │ st0 = │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ [macrocall] | │ @doc :: Identifier | mod=Core │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) :: Value | │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | │ [function] | │ [call] | │ retrieve :: Identifier | │ [parameters] | │ [kw] | │ [::] | │ verbose :: Identifier | │ Integer :: Identifier | │ 1 :: Value | │ [kw] | │ [::] | │ top_k :: Identifier | │ Integer :: Identifier | │ 100 :: Value | │ [kw] | │ [::] | │ top_n :: Identifier | │ Integer :: Identifier | │ 5 :: Value | │ [kw] | │ [::] | │ api_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ rephraser :: Identifier | │ AbstractRephraser :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ rephraser :: Identifier | │ [kw] | │ [::] | │ rephraser_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ embedder :: Identifier | │ AbstractEmbedder :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ embedder :: Identifier | │ [kw] | │ [::] | │ embedder_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ processor :: Identifier | │ AbstractProcessor :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ processor :: Identifier | │ [kw] | │ [::] | │ processor_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ finder :: Identifier | │ AbstractSimilarityFinder :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ finder :: Identifier | │ [kw] | │ [::] | │ finder_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ tagger :: Identifier | │ AbstractTagger :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ tagger :: Identifier | │ [kw] | │ [::] | │ tagger_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ filter :: Identifier | │ AbstractTagFilter :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ filter :: Identifier | │ [kw] | │ [::] | │ filter_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ reranker :: Identifier | │ AbstractReranker :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ reranker :: Identifier | │ [kw] | │ [::] | │ reranker_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ cost_tracker :: Identifier | │ [call] | │ [curly] | │ [.] | │ Threads :: Identifier | │ [inert] | │ Atomic :: Identifier | │ Float64 :: Identifier | │ 0.0 :: Value | │ [...] | │ kwargs :: Identifier | │ [::] | │ retriever :: Identifier | │ AbstractRetriever :: Identifier | │ [::] | │ index :: Identifier | │ AbstractDocumentIndex :: Identifier | │ [::] | │ question :: Identifier | │ AbstractString :: Identifier | │ [block] | │ [=] | │ rephraser_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ rephraser_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ rephraser_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ rephrased_questions :: Identifier | │ [call] | │ rephrase :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ rephraser_kwargs_ :: Identifier | │ rephraser :: Identifier | │ question :: Identifier | │ [=] | │ embeddings :: Identifier | │ [if] | │ [call] | │ HasEmbeddings :: Identifier | │ index :: Identifier | │ [block] | │ [=] | │ embedder_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ embedder_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ embedder_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ embeddings :: Identifier | │ [call] | │ get_embeddings :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ embedder_kwargs_ :: Identifier | │ embedder :: Identifier | │ rephrased_questions :: Identifier | │ [block] | │ [=] | │ embeddings :: Identifier | │ [call] | │ hcat :: Identifier | │ [...] | │ [comprehension] | │ [generator] | │ [ref] | │ Float32 :: Identifier | │ [=] | │ x :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ keywords :: Identifier | │ [if] | │ [call] | │ HasKeywords :: Identifier | │ index :: Identifier | │ [block] | │ [=] | │ keywords :: Identifier | │ [call] | │ get_keywords :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [...] | │ processor_kwargs :: Identifier | │ [kw] | │ return_keywords :: Identifier | │ true :: Value | │ processor :: Identifier | │ rephrased_questions :: Identifier | │ [&&] | │ [call] | │ >= :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [||] | │ [call] | │ isa :: Identifier | │ keywords :: Identifier | │ [curly] | │ AbstractVector :: Identifier | │ [<:] | │ [curly] | │ AbstractVector :: Identifier | │ [<:] | │ AbstractString :: Identifier | │ [macrocall] | │ @warn :: Identifier | │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) :: Value | │ [string] | │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | │ [call] | │ typeof :: Identifier | │ processor :: Identifier | │ ")." :: Value | │ keywords :: Identifier | │ [block] | │ [comprehension] | │ [generator] | │ [ref] | │ String :: Identifier | │ [=] | │ x :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ finder_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ finder_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ finder_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ emb_candidates :: Identifier | │ [call] | │ find_closest :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ top_k :: Identifier | │ [...] | │ finder_kwargs_ :: Identifier | │ finder :: Identifier | │ index :: Identifier | │ embeddings :: Identifier | │ keywords :: Identifier | │ [=] | │ tagger_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ tagger_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ tagger_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ tags :: Identifier | │ [call] | │ get_tags :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ tagger_kwargs_ :: Identifier | │ tagger :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ filter_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ filter_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ filter_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ tag_candidates :: Identifier | │ [call] | │ find_tags :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [...] | │ filter_kwargs_ :: Identifier | │ filter :: Identifier | │ index :: Identifier | │ tags :: Identifier | │ [=] | │ filtered_candidates :: Identifier | │ [if] | │ [call] | │ isnothing :: Identifier | │ tag_candidates :: Identifier | │ emb_candidates :: Identifier | │ [call] | │ & :: Identifier | │ emb_candidates :: Identifier | │ tag_candidates :: Identifier | │ [=] | │ reranker_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ reranker_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ reranker_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ reranked_candidates :: Identifier | │ [call] | │ rerank :: Identifier | │ [parameters] | │ top_n :: Identifier | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ reranker_kwargs_ :: Identifier | │ reranker :: Identifier | │ index :: Identifier | │ question :: Identifier | │ filtered_candidates :: Identifier | │ [&&] | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 0 :: Value | │ [macrocall] | │ @info :: Identifier | │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) :: Value | │ [string] | │ "Retrieval done. Identified " :: Value | │ [call] | │ length :: Identifier | │ [call] | │ positions :: Identifier | │ reranked_candidates :: Identifier | │ " chunks, total cost: \$" :: Value | │ [call] | │ round :: Identifier | │ [ref] | │ cost_tracker :: Identifier | │ [kw] | │ digits :: Identifier | │ 2 :: Value | │ "." :: Value | │ [=] | │ result :: Identifier | │ [call] | │ RAGResult :: Identifier | │ [parameters] | │ question :: Identifier | │ [kw] | │ answer :: Identifier | │ nothing :: Identifier | │ rephrased_questions :: Identifier | │ [kw] | │ final_answer :: Identifier | │ nothing :: Identifier | │ [kw] | │ context :: Identifier | │ [call] | │ collect :: Identifier | │ [ref] | │ index :: Identifier | │ reranked_candidates :: Identifier | │ [inert] | │ chunks :: Identifier | │ [kw] | │ sorted :: Identifier | │ true :: Value | │ [kw] | │ sources :: Identifier | │ [call] | │ collect :: Identifier | │ [ref] | │ index :: Identifier | │ reranked_candidates :: Identifier | │ [inert] | │ sources :: Identifier | │ [kw] | │ sorted :: Identifier | │ true :: Value | │ emb_candidates :: Identifier | │ tag_candidates :: Identifier | │ filtered_candidates :: Identifier | │ reranked_candidates :: Identifier | │ [return] | │ result :: Identifier | │ │ st1 = │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ [block] | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ [if] | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ true :: Value | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ [=] | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ val :: Identifier | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ [function] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retrieve :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ top_k :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 100 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ top_n :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 5 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRephraser :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractEmbedder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractProcessor :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractSimilarityFinder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractTagger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractTagFilter :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractReranker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Threads :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Atomic :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Float64 :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 0.0 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRetriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractDocumentIndex :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrase :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ HasEmbeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ get_embeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ hcat :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [comprehension] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [generator] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Float32 :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ x :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ HasKeywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ get_keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ return_keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [&&] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [||] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractVector :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [<:] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractVector :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [<:] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [let] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Warn :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retrieval :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ ! :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ === :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1131#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools_Experimental_RAGTools_7aa4399b :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ Base.CoreLogging.shouldlog :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ fixup_stdlib_path :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1104 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [local] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [try] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [string] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ typeof :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ ")." :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1149#err :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ Base.CoreLogging.logging_error :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1149#err :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ false :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [comprehension] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [generator] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ x :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ find_closest :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ top_k :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tags :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ get_tags :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ find_tags :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tags :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isnothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ & :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rerank :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ top_n :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs_ :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [&&] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 0 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [let] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Info :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ retrieval :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ ! :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ === :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1154#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools_Experimental_RAGTools_30253e51 :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ Base.CoreLogging.shouldlog :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ fixup_stdlib_path :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 1141 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [local] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [try] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [string] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ "Retrieval done. Identified " :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ length :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ positions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ " chunks, total cost: \$" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ round :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ digits :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ 2 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ "." :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1172#err :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ Base.CoreLogging.logging_error :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1172#err :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ false :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ result :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ RAGResult :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ answer :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ final_answer :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ context :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ collect :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ chunks :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ sorted :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ sources :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ collect :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ sources :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ sorted :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [return] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ result :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ Base.Docs.doc! :: Value | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Docs.Binding :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(BorXSa2JA8b,Base,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),(. Base (inert @__MODULE__))], │ [inert] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc],jl_source=L47 │ retrieve :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Docs.docstr :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Core.svec :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Dict{Symbol, Any} :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ :path => "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ :linenumber => 946 :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ :module => PromptingTools.Experimental.RAGTools :: Value | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Union :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ Tuple :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRetriever :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractDocumentIndex :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ true :: Value | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ val :: Identifier | [old,SL(JlG3GRJitTA,Base.Docs,SL(Bv1W7ce77pn,PromptingTools.Experimental.RAGTools,)),@doc], │ │ file = "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" │ line = 946 └ mod = PromptingTools.Experimental.RAGTools ERROR: LoadError: LoweringError: #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# - invalid syntax: unknown form `kw` or number of arguments 2 Expression:  (kw sorted true) Containing expressions:  (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true))))  Detailed provenance:  (kw sorted true)  ├─ (kw sorted true)  │ └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144  └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result))))  └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result))))  └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946  Stacktrace:  [1] expand_forms_2(ctx::Base.JuliaLowering.MacroExpansionContext{Dict{Symbol, Dict{Int64, Any}}}, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/desugaring.jl:4496  [2] core_lowering_hook(code::Any, mod::Module, file::String, line::UInt64, world::UInt64, _warn::Bool)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/hooks.jl:30  [3] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [4] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:47  [5] eval(m::Module, e::Any)  @ Core boot.jl:522  [6] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745  [7] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined]  [8] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1  [9] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [10] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:18  [11] eval(m::Module, e::Any)  @ Core boot.jl:522  [12] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745  [13] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined]  [14] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1  [15] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [16] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:93  [17] include(mod::Module, _path::String)  @ Base Base.jl:325  [18] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [19] top-level scope  @ stdin:5  [20] eval(m::Module, e::Any)  @ Core boot.jl:522  [21] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [22] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [23] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [24] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:1 in expression starting at stdin:5 ✗ PromptingTools ERROR: LoadError: Precompiled image Base.PkgId(Base.UUID("670122d1-24a8-4d70-bfce-740807c42192"), "PromptingTools") not available with flags CacheFlags(; use_pkgimages=false, debug_level=1, check_bounds=1, inline=true, opt_level=0) Stacktrace:  [1] error(s::String)  @ Base error.jl:56  [2] __require_prelocked(pkg::Base.PkgId, env::String)  @ Base loading.jl:2837  [3] _require_prelocked(uuidkey::Base.PkgId, env::String)  @ Base loading.jl:2685  [4] macro expansion  @ loading.jl:2599 [inlined]  [5] macro expansion  @ lock.jl:376 [inlined]  [6] __require(into::Module, mod::Symbol)  @ Base loading.jl:2563  [7] require(into::Module, mod::Symbol)  @ Base loading.jl:2539 [inlined]  [8] eval_import_path(at::Module, from::Nothing, path::Expr, keyword::String)  @ Base module.jl:36 [inlined]  [9] eval_import_path_all(at::Module, path::Expr, keyword::String)  @ Base module.jl:60  [10] _eval_using(to::Module, path::Expr, flags::UInt8)  @ Base module.jl:137 [inlined]  [11] eval_using(to::Module, path::Expr)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/runtime.jl:130  [12] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:3  [13] include(mod::Module, _path::String)  @ Base Base.jl:325  [14] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [15] top-level scope  @ stdin:5  [16] eval(m::Module, e::Any)  @ Core boot.jl:522  [17] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [18] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [19] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [20] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:1 in expression starting at stdin:5 ✗ PromptingTools → MarkdownPromptingToolsExt ERROR: LoadError: Precompiled image Base.PkgId(Base.UUID("670122d1-24a8-4d70-bfce-740807c42192"), "PromptingTools") not available with flags CacheFlags(; use_pkgimages=false, debug_level=1, check_bounds=1, inline=true, opt_level=0) Stacktrace:  [1] error(s::String)  @ Base error.jl:56  [2] __require_prelocked(pkg::Base.PkgId, env::String)  @ Base loading.jl:2837  [3] _require_prelocked(uuidkey::Base.PkgId, env::String)  @ Base loading.jl:2685  [4] macro expansion  @ loading.jl:2599 [inlined]  [5] macro expansion  @ lock.jl:376 [inlined]  [6] __require(into::Module, mod::Symbol)  @ Base loading.jl:2563  [7] require(into::Module, mod::Symbol)  @ Base loading.jl:2539 [inlined]  [8] eval_import_path(at::Module, from::Nothing, path::Expr, keyword::String)  @ Base module.jl:36 [inlined]  [9] eval_import_path_all(at::Module, path::Expr, keyword::String)  @ Base module.jl:60  [10] _eval_using(to::Module, path::Expr, flags::UInt8)  @ Base module.jl:137 [inlined]  [11] eval_using(to::Module, path::Expr)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/runtime.jl:130  [12] top-level scope  @ ~/.julia/packages/LLMCheatsheets/zpbkp/src/LLMCheatsheets.jl:6  [13] include(mod::Module, _path::String)  @ Base Base.jl:325  [14] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [15] top-level scope  @ stdin:5  [16] eval(m::Module, e::Any)  @ Core boot.jl:522  [17] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [18] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [19] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [20] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/LLMCheatsheets/zpbkp/src/LLMCheatsheets.jl:1 in expression starting at stdin:5 ✗ LLMCheatsheets 25 dependencies successfully precompiled in 1176 seconds. 33 already precompiled. Precompilation completed after 1227.54s ################################################################################ # Testing # Testing LLMCheatsheets Status `/tmp/jl_Q2ctvX/Project.toml` [4c88cf16] Aqua v0.8.16 ⌅ [cd3eb016] HTTP v1.11.0 [0f8b85d8] JSON3 v1.14.3 [bfa53fcd] LLMCheatsheets v0.1.0 [78c3b35d] Mocking v0.8.1 ⌅ [670122d1] PromptingTools v0.56.1 [8dfed614] Test v1.11.0 Status `/tmp/jl_Q2ctvX/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [4c88cf16] Aqua v0.8.16 [d1d4a3ce] BitFlags v0.1.10 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [f0e56b4a] ConcurrentUtilities v2.5.1 [460bff9d] ExceptionUnwrapping v0.1.11 [e2ba6199] ExprTools v0.1.10 ⌅ [cd3eb016] HTTP v1.11.0 [692b3bcd] JLLWrappers v1.8.0 [0f8b85d8] JSON3 v1.14.3 [bfa53fcd] LLMCheatsheets v0.1.0 [e6f89c97] LoggingExtras v1.2.0 [739be429] MbedTLS v1.1.10 [78c3b35d] Mocking v0.8.1 ⌅ [e9f21f70] OpenAI v0.9.1 [4d8831e6] OpenSSL v1.6.1 [69de0a69] Parsers v2.8.6 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 ⌅ [670122d1] PromptingTools v0.56.1 [777ac1f9] SimpleBufferStream v1.2.0 [856f2bd8] StructTypes v1.11.0 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] LibCURL_jll v8.21.0+0 [e37daf67] LibGit2_jll v1.9.4+0 [29816b5a] LibSSH2_jll v1.11.101+0 [14a3606d] MozillaCACerts_jll v2026.5.14 [458c3c95] OpenSSL_jll v3.5.7+0 [efcefdf7] PCRE2_jll v10.47.0+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850ede] nghttp2_jll v1.69.0+0 [3f19e933] p7zip_jll v17.8.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! └ @ PromptingTools ~/.julia/packages/PromptingTools/lqJyF/src/user_preferences.jl:165 ┌ Info: JuliaLowering threw given input: │ code = │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =# Core.@doc " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" function retrieve(retriever::AbstractRetriever, index::AbstractDocumentIndex, question::AbstractString; verbose::Integer = 1, top_k::Integer = 100, top_n::Integer = 5, api_kwargs::NamedTuple = NamedTuple(), rephraser::AbstractRephraser = retriever.rephraser, rephraser_kwargs::NamedTuple = NamedTuple(), embedder::AbstractEmbedder = retriever.embedder, embedder_kwargs::NamedTuple = NamedTuple(), processor::AbstractProcessor = retriever.processor, processor_kwargs::NamedTuple = NamedTuple(), finder::AbstractSimilarityFinder = retriever.finder, finder_kwargs::NamedTuple = NamedTuple(), tagger::AbstractTagger = retriever.tagger, tagger_kwargs::NamedTuple = NamedTuple(), filter::AbstractTagFilter = retriever.filter, filter_kwargs::NamedTuple = NamedTuple(), reranker::AbstractReranker = retriever.reranker, reranker_kwargs::NamedTuple = NamedTuple(), cost_tracker = Threads.Atomic{Float64}(0.0), kwargs...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1058 =# │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1082 =# │ rephraser_kwargs_ = if isempty(api_kwargs) │ rephraser_kwargs │ else │ merge(rephraser_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1084 =# │ rephrased_questions = rephrase(rephraser, question; verbose = verbose > 1, cost_tracker, rephraser_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1088 =# │ embeddings = if HasEmbeddings(index) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1089 =# │ embedder_kwargs_ = if isempty(api_kwargs) │ embedder_kwargs │ else │ merge(embedder_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1091 =# │ embeddings = get_embeddings(embedder, rephrased_questions; verbose = verbose > 1, cost_tracker, embedder_kwargs_...) │ else │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1094 =# │ embeddings = hcat([Float32[] for x = rephrased_questions]...) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1098 =# │ keywords = if HasKeywords(index) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1100 =# │ keywords = get_keywords(processor, rephrased_questions; verbose = verbose > 1, processor_kwargs..., return_keywords = true) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1103 =# │ verbose >= 1 && (keywords isa AbstractVector{<:AbstractVector{<:AbstractString}} || #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =# @warn("Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: $(typeof(processor))).")) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1105 =# │ keywords │ else │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1107 =# │ [String[] for x = rephrased_questions] │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1110 =# │ finder_kwargs_ = if isempty(api_kwargs) │ finder_kwargs │ else │ merge(finder_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1112 =# │ emb_candidates = find_closest(finder, index, embeddings, keywords; verbose = verbose > 1, top_k, finder_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1116 =# │ tagger_kwargs_ = if isempty(api_kwargs) │ tagger_kwargs │ else │ merge(tagger_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1118 =# │ tags = get_tags(tagger, rephrased_questions; verbose = verbose > 1, cost_tracker, tagger_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1121 =# │ filter_kwargs_ = if isempty(api_kwargs) │ filter_kwargs │ else │ merge(filter_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1123 =# │ tag_candidates = find_tags(filter, index, tags; verbose = verbose > 1, filter_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1128 =# │ filtered_candidates = if isnothing(tag_candidates) │ emb_candidates │ else │ emb_candidates & tag_candidates │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1135 =# │ reranker_kwargs_ = if isempty(api_kwargs) │ reranker_kwargs │ else │ merge(reranker_kwargs, (; api_kwargs)) │ end │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1137 =# │ reranked_candidates = rerank(reranker, index, question, filtered_candidates; top_n, verbose = verbose > 1, cost_tracker, reranker_kwargs_...) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1140 =# │ verbose > 0 && #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =# @info("Retrieval done. Identified $(length(positions(reranked_candidates))) chunks, total cost: \$$(round(cost_tracker[], digits = 2)).") │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# │ result = RAGResult(; question, answer = nothing, rephrased_questions, final_answer = nothing, context = collect(index[reranked_candidates, :chunks, sorted = true]), sources = collect(index[reranked_candidates, :sources, sorted = true]), emb_candidates, tag_candidates, filtered_candidates, reranked_candidates) │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1157 =# │ return result │ end) │ st0 = │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ [macrocall] | │ @doc :: Identifier | mod=Core │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) :: Value | │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | │ [function] | │ [call] | │ retrieve :: Identifier | │ [parameters] | │ [kw] | │ [::] | │ verbose :: Identifier | │ Integer :: Identifier | │ 1 :: Value | │ [kw] | │ [::] | │ top_k :: Identifier | │ Integer :: Identifier | │ 100 :: Value | │ [kw] | │ [::] | │ top_n :: Identifier | │ Integer :: Identifier | │ 5 :: Value | │ [kw] | │ [::] | │ api_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ rephraser :: Identifier | │ AbstractRephraser :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ rephraser :: Identifier | │ [kw] | │ [::] | │ rephraser_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ embedder :: Identifier | │ AbstractEmbedder :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ embedder :: Identifier | │ [kw] | │ [::] | │ embedder_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ processor :: Identifier | │ AbstractProcessor :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ processor :: Identifier | │ [kw] | │ [::] | │ processor_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ finder :: Identifier | │ AbstractSimilarityFinder :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ finder :: Identifier | │ [kw] | │ [::] | │ finder_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ tagger :: Identifier | │ AbstractTagger :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ tagger :: Identifier | │ [kw] | │ [::] | │ tagger_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ filter :: Identifier | │ AbstractTagFilter :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ filter :: Identifier | │ [kw] | │ [::] | │ filter_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ [::] | │ reranker :: Identifier | │ AbstractReranker :: Identifier | │ [.] | │ retriever :: Identifier | │ [inert] | │ reranker :: Identifier | │ [kw] | │ [::] | │ reranker_kwargs :: Identifier | │ NamedTuple :: Identifier | │ [call] | │ NamedTuple :: Identifier | │ [kw] | │ cost_tracker :: Identifier | │ [call] | │ [curly] | │ [.] | │ Threads :: Identifier | │ [inert] | │ Atomic :: Identifier | │ Float64 :: Identifier | │ 0.0 :: Value | │ [...] | │ kwargs :: Identifier | │ [::] | │ retriever :: Identifier | │ AbstractRetriever :: Identifier | │ [::] | │ index :: Identifier | │ AbstractDocumentIndex :: Identifier | │ [::] | │ question :: Identifier | │ AbstractString :: Identifier | │ [block] | │ [=] | │ rephraser_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ rephraser_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ rephraser_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ rephrased_questions :: Identifier | │ [call] | │ rephrase :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ rephraser_kwargs_ :: Identifier | │ rephraser :: Identifier | │ question :: Identifier | │ [=] | │ embeddings :: Identifier | │ [if] | │ [call] | │ HasEmbeddings :: Identifier | │ index :: Identifier | │ [block] | │ [=] | │ embedder_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ embedder_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ embedder_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ embeddings :: Identifier | │ [call] | │ get_embeddings :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ embedder_kwargs_ :: Identifier | │ embedder :: Identifier | │ rephrased_questions :: Identifier | │ [block] | │ [=] | │ embeddings :: Identifier | │ [call] | │ hcat :: Identifier | │ [...] | │ [comprehension] | │ [generator] | │ [ref] | │ Float32 :: Identifier | │ [=] | │ x :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ keywords :: Identifier | │ [if] | │ [call] | │ HasKeywords :: Identifier | │ index :: Identifier | │ [block] | │ [=] | │ keywords :: Identifier | │ [call] | │ get_keywords :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [...] | │ processor_kwargs :: Identifier | │ [kw] | │ return_keywords :: Identifier | │ true :: Value | │ processor :: Identifier | │ rephrased_questions :: Identifier | │ [&&] | │ [call] | │ >= :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [||] | │ [call] | │ isa :: Identifier | │ keywords :: Identifier | │ [curly] | │ AbstractVector :: Identifier | │ [<:] | │ [curly] | │ AbstractVector :: Identifier | │ [<:] | │ AbstractString :: Identifier | │ [macrocall] | │ @warn :: Identifier | │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) :: Value | │ [string] | │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | │ [call] | │ typeof :: Identifier | │ processor :: Identifier | │ ")." :: Value | │ keywords :: Identifier | │ [block] | │ [comprehension] | │ [generator] | │ [ref] | │ String :: Identifier | │ [=] | │ x :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ finder_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ finder_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ finder_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ emb_candidates :: Identifier | │ [call] | │ find_closest :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ top_k :: Identifier | │ [...] | │ finder_kwargs_ :: Identifier | │ finder :: Identifier | │ index :: Identifier | │ embeddings :: Identifier | │ keywords :: Identifier | │ [=] | │ tagger_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ tagger_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ tagger_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ tags :: Identifier | │ [call] | │ get_tags :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ tagger_kwargs_ :: Identifier | │ tagger :: Identifier | │ rephrased_questions :: Identifier | │ [=] | │ filter_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ filter_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ filter_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ tag_candidates :: Identifier | │ [call] | │ find_tags :: Identifier | │ [parameters] | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ [...] | │ filter_kwargs_ :: Identifier | │ filter :: Identifier | │ index :: Identifier | │ tags :: Identifier | │ [=] | │ filtered_candidates :: Identifier | │ [if] | │ [call] | │ isnothing :: Identifier | │ tag_candidates :: Identifier | │ emb_candidates :: Identifier | │ [call] | │ & :: Identifier | │ emb_candidates :: Identifier | │ tag_candidates :: Identifier | │ [=] | │ reranker_kwargs_ :: Identifier | │ [if] | │ [call] | │ isempty :: Identifier | │ api_kwargs :: Identifier | │ reranker_kwargs :: Identifier | │ [call] | │ merge :: Identifier | │ reranker_kwargs :: Identifier | │ [tuple] | │ [parameters] | │ api_kwargs :: Identifier | │ [=] | │ reranked_candidates :: Identifier | │ [call] | │ rerank :: Identifier | │ [parameters] | │ top_n :: Identifier | │ [kw] | │ verbose :: Identifier | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 1 :: Value | │ cost_tracker :: Identifier | │ [...] | │ reranker_kwargs_ :: Identifier | │ reranker :: Identifier | │ index :: Identifier | │ question :: Identifier | │ filtered_candidates :: Identifier | │ [&&] | │ [call] | │ > :: Identifier | │ verbose :: Identifier | │ 0 :: Value | │ [macrocall] | │ @info :: Identifier | │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) :: Value | │ [string] | │ "Retrieval done. Identified " :: Value | │ [call] | │ length :: Identifier | │ [call] | │ positions :: Identifier | │ reranked_candidates :: Identifier | │ " chunks, total cost: \$" :: Value | │ [call] | │ round :: Identifier | │ [ref] | │ cost_tracker :: Identifier | │ [kw] | │ digits :: Identifier | │ 2 :: Value | │ "." :: Value | │ [=] | │ result :: Identifier | │ [call] | │ RAGResult :: Identifier | │ [parameters] | │ question :: Identifier | │ [kw] | │ answer :: Identifier | │ nothing :: Identifier | │ rephrased_questions :: Identifier | │ [kw] | │ final_answer :: Identifier | │ nothing :: Identifier | │ [kw] | │ context :: Identifier | │ [call] | │ collect :: Identifier | │ [ref] | │ index :: Identifier | │ reranked_candidates :: Identifier | │ [inert] | │ chunks :: Identifier | │ [kw] | │ sorted :: Identifier | │ true :: Value | │ [kw] | │ sources :: Identifier | │ [call] | │ collect :: Identifier | │ [ref] | │ index :: Identifier | │ reranked_candidates :: Identifier | │ [inert] | │ sources :: Identifier | │ [kw] | │ sorted :: Identifier | │ true :: Value | │ emb_candidates :: Identifier | │ tag_candidates :: Identifier | │ filtered_candidates :: Identifier | │ reranked_candidates :: Identifier | │ [return] | │ result :: Identifier | │ │ st1 = │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ [block] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ [if] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ true :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ [=] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ val :: Identifier | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ [function] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retrieve :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ top_k :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 100 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ top_n :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 5 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractEmbedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractProcessor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractSimilarityFinder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractTagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractTagFilter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractReranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Threads :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Atomic :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Float64 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 0.0 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRetriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractDocumentIndex :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrase :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ HasEmbeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ get_embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ hcat :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [comprehension] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [generator] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Float32 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ x :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ HasKeywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ get_keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ return_keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [&&] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [||] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractVector :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [<:] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractVector :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [<:] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [let] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Warn :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retrieval :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ ! :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ === :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools_Experimental_RAGTools_7aa4399b :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ Base.CoreLogging.shouldlog :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ fixup_stdlib_path :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1104 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [local] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [try] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [string] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ typeof :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ ")." :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1149#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ Base.CoreLogging.logging_error :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1149#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ false :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [comprehension] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [generator] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ x :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ find_closest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ top_k :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ get_tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ find_tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isnothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ & :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rerank :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ top_n :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [&&] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 0 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [let] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Info :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ retrieval :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ ! :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ === :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools_Experimental_RAGTools_30253e51 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ Base.CoreLogging.shouldlog :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ fixup_stdlib_path :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 1141 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [local] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [try] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [string] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ "Retrieval done. Identified " :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ length :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ positions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ " chunks, total cost: \$" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ round :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ digits :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ 2 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ "." :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1172#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ Base.CoreLogging.logging_error :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1172#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ false :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ result :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ RAGResult :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ answer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ final_answer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ context :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ collect :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ chunks :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ sorted :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ sources :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ collect :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ sources :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ sorted :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [return] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ result :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ Base.Docs.doc! :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Docs.Binding :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(DJe5gdCtOrM,Base,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),(. Base (inert @__MODULE__))], │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],jl_source=L47 │ retrieve :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Base.Docs.docstr :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Core.svec :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Dict{Symbol, Any} :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ :path => "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ :linenumber => 946 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ :module => PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Union :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ Tuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractRetriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractDocumentIndex :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ [if] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ true :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ val :: Identifier | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ file = "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" │ line = 946 └ mod = PromptingTools.Experimental.RAGTools ERROR: LoadError: LoweringError: #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# - invalid syntax: unknown form `kw` or number of arguments 2 Expression:  (kw sorted true) Containing expressions:  (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true))))  Detailed provenance:  (kw sorted true)  ├─ (kw sorted true)  │ └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144  └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result))))  └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result))))  └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946  Stacktrace:  [1] expand_forms_2(ctx::Base.JuliaLowering.MacroExpansionContext{Dict{Symbol, Dict{Int64, Any}}}, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/desugaring.jl:4496  [2] core_lowering_hook(code::Any, mod::Module, file::String, line::UInt64, world::UInt64, _warn::Bool)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/hooks.jl:30  [3] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [4] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:47  [5] eval(m::Module, e::Any)  @ Core boot.jl:522  [6] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745  [7] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined]  [8] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1  [9] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [10] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:18  [11] eval(m::Module, e::Any)  @ Core boot.jl:522  [12] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745  [13] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool})  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined]  [14] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1  [15] include(mapexpr::Function, mod::Module, _path::String)  @ Base Base.jl:326  [16] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:93  [17] include(mod::Module, _path::String)  @ Base Base.jl:325  [18] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [19] top-level scope  @ stdin:5  [20] eval(m::Module, e::Any)  @ Core boot.jl:522  [21] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [22] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [23] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [24] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:1 in expression starting at stdin:5 ERROR: LoadError: Precompiled image Base.PkgId(Base.UUID("670122d1-24a8-4d70-bfce-740807c42192"), "PromptingTools") not available with flags CacheFlags(; use_pkgimages=false, debug_level=1, check_bounds=1, inline=true, opt_level=0) Stacktrace:  [1] error(s::String)  @ Base error.jl:56  [2] __require_prelocked(pkg::Base.PkgId, env::String)  @ Base loading.jl:2837  [3] _require_prelocked(uuidkey::Base.PkgId, env::String)  @ Base loading.jl:2685  [4] macro expansion  @ loading.jl:2599 [inlined]  [5] macro expansion  @ lock.jl:376 [inlined]  [6] __require(into::Module, mod::Symbol)  @ Base loading.jl:2563  [7] require(into::Module, mod::Symbol)  @ Base loading.jl:2539 [inlined]  [8] eval_import_path(at::Module, from::Nothing, path::Expr, keyword::String)  @ Base module.jl:36 [inlined]  [9] eval_import_path_all(at::Module, path::Expr, keyword::String)  @ Base module.jl:60  [10] _eval_using(to::Module, path::Expr, flags::UInt8)  @ Base module.jl:137 [inlined]  [11] eval_using(to::Module, path::Expr)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/runtime.jl:130  [12] top-level scope  @ ~/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:3  [13] include(mod::Module, _path::String)  @ Base Base.jl:325  [14] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [15] top-level scope  @ stdin:5  [16] eval(m::Module, e::Any)  @ Core boot.jl:522  [17] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [18] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [19] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [20] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:1 in expression starting at stdin:5 ERROR: LoadError: Precompiled image Base.PkgId(Base.UUID("670122d1-24a8-4d70-bfce-740807c42192"), "PromptingTools") not available with flags CacheFlags(; use_pkgimages=false, debug_level=1, check_bounds=1, inline=true, opt_level=0) Stacktrace:  [1] error(s::String)  @ Base error.jl:56  [2] __require_prelocked(pkg::Base.PkgId, env::String)  @ Base loading.jl:2837  [3] _require_prelocked(uuidkey::Base.PkgId, env::String)  @ Base loading.jl:2685  [4] macro expansion  @ loading.jl:2599 [inlined]  [5] macro expansion  @ lock.jl:376 [inlined]  [6] __require(into::Module, mod::Symbol)  @ Base loading.jl:2563  [7] require(into::Module, mod::Symbol)  @ Base loading.jl:2539 [inlined]  [8] eval_import_path(at::Module, from::Nothing, path::Expr, keyword::String)  @ Base module.jl:36 [inlined]  [9] eval_import_path_all(at::Module, path::Expr, keyword::String)  @ Base module.jl:60  [10] _eval_using(to::Module, path::Expr, flags::UInt8)  @ Base module.jl:137 [inlined]  [11] eval_using(to::Module, path::Expr)  @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/runtime.jl:130  [12] top-level scope  @ ~/.julia/packages/LLMCheatsheets/zpbkp/src/LLMCheatsheets.jl:6  [13] include(mod::Module, _path::String)  @ Base Base.jl:325  [14] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing)  @ Base loading.jl:3303  [15] top-level scope  @ stdin:5  [16] eval(m::Module, e::Any)  @ Core boot.jl:522  [17] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String)  @ Base loading.jl:3132  [18] include_string(m::Module, txt::String, fname::String)  @ Base loading.jl:3142 [inlined]  [19] exec_options(opts::Base.JLOptions)  @ Base client.jl:353  [20] _start()  @ Base client.jl:596 in expression starting at /home/pkgeval/.julia/packages/LLMCheatsheets/zpbkp/src/LLMCheatsheets.jl:1 in expression starting at stdin:5 3 dependencies had output during precompilation: ┌ LLMCheatsheets │ [Output was shown above] └ ┌ PromptingTools │ ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! │ └ @ PromptingTools ~/.julia/packages/PromptingTools/lqJyF/src/user_preferences.jl:165 │ ┌ Info: JuliaLowering threw given input: │ │ code = │ │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =# Core.@doc " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" function retrieve(retriever::AbstractRetriever, index::AbstractDocumentIndex, question::AbstractString; verbose::Integer = 1, top_k::Integer = 100, top_n::Integer = 5, api_kwargs::NamedTuple = NamedTuple(), rephraser::AbstractRephraser = retriever.rephraser, rephraser_kwargs::NamedTuple = NamedTuple(), embedder::AbstractEmbedder = retriever.embedder, embedder_kwargs::NamedTuple = NamedTuple(), processor::AbstractProcessor = retriever.processor, processor_kwargs::NamedTuple = NamedTuple(), finder::AbstractSimilarityFinder = retriever.finder, finder_kwargs::NamedTuple = NamedTuple(), tagger::AbstractTagger = retriever.tagger, tagger_kwargs::NamedTuple = NamedTuple(), filter::AbstractTagFilter = retriever.filter, filter_kwargs::NamedTuple = NamedTuple(), reranker::AbstractReranker = retriever.reranker, reranker_kwargs::NamedTuple = NamedTuple(), cost_tracker = Threads.Atomic{Float64}(0.0), kwargs...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1058 =# │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1082 =# │ │ rephraser_kwargs_ = if isempty(api_kwargs) │ │ rephraser_kwargs │ │ else │ │ merge(rephraser_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1084 =# │ │ rephrased_questions = rephrase(rephraser, question; verbose = verbose > 1, cost_tracker, rephraser_kwargs_...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1088 =# │ │ embeddings = if HasEmbeddings(index) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1089 =# │ │ embedder_kwargs_ = if isempty(api_kwargs) │ │ embedder_kwargs │ │ else │ │ merge(embedder_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1091 =# │ │ embeddings = get_embeddings(embedder, rephrased_questions; verbose = verbose > 1, cost_tracker, embedder_kwargs_...) │ │ else │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1094 =# │ │ embeddings = hcat([Float32[] for x = rephrased_questions]...) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1098 =# │ │ keywords = if HasKeywords(index) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1100 =# │ │ keywords = get_keywords(processor, rephrased_questions; verbose = verbose > 1, processor_kwargs..., return_keywords = true) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1103 =# │ │ verbose >= 1 && (keywords isa AbstractVector{<:AbstractVector{<:AbstractString}} || #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =# @warn("Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: $(typeof(processor))).")) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1105 =# │ │ keywords │ │ else │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1107 =# │ │ [String[] for x = rephrased_questions] │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1110 =# │ │ finder_kwargs_ = if isempty(api_kwargs) │ │ finder_kwargs │ │ else │ │ merge(finder_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1112 =# │ │ emb_candidates = find_closest(finder, index, embeddings, keywords; verbose = verbose > 1, top_k, finder_kwargs_...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1116 =# │ │ tagger_kwargs_ = if isempty(api_kwargs) │ │ tagger_kwargs │ │ else │ │ merge(tagger_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1118 =# │ │ tags = get_tags(tagger, rephrased_questions; verbose = verbose > 1, cost_tracker, tagger_kwargs_...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1121 =# │ │ filter_kwargs_ = if isempty(api_kwargs) │ │ filter_kwargs │ │ else │ │ merge(filter_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1123 =# │ │ tag_candidates = find_tags(filter, index, tags; verbose = verbose > 1, filter_kwargs_...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1128 =# │ │ filtered_candidates = if isnothing(tag_candidates) │ │ emb_candidates │ │ else │ │ emb_candidates & tag_candidates │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1135 =# │ │ reranker_kwargs_ = if isempty(api_kwargs) │ │ reranker_kwargs │ │ else │ │ merge(reranker_kwargs, (; api_kwargs)) │ │ end │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1137 =# │ │ reranked_candidates = rerank(reranker, index, question, filtered_candidates; top_n, verbose = verbose > 1, cost_tracker, reranker_kwargs_...) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1140 =# │ │ verbose > 0 && #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =# @info("Retrieval done. Identified $(length(positions(reranked_candidates))) chunks, total cost: \$$(round(cost_tracker[], digits = 2)).") │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# │ │ result = RAGResult(; question, answer = nothing, rephrased_questions, final_answer = nothing, context = collect(index[reranked_candidates, :chunks, sorted = true]), sources = collect(index[reranked_candidates, :sources, sorted = true]), emb_candidates, tag_candidates, filtered_candidates, reranked_candidates) │ │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1157 =# │ │ return result │ │ end) │ │ st0 = │ │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ │ [macrocall] | │ │ @doc :: Identifier | mod=Core │ │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) :: Value | │ │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | │ │ [function] | │ │ [call] | │ │ retrieve :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ [::] | │ │ verbose :: Identifier | │ │ Integer :: Identifier | │ │ 1 :: Value | │ │ [kw] | │ │ [::] | │ │ top_k :: Identifier | │ │ Integer :: Identifier | │ │ 100 :: Value | │ │ [kw] | │ │ [::] | │ │ top_n :: Identifier | │ │ Integer :: Identifier | │ │ 5 :: Value | │ │ [kw] | │ │ [::] | │ │ api_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ rephraser :: Identifier | │ │ AbstractRephraser :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ rephraser :: Identifier | │ │ [kw] | │ │ [::] | │ │ rephraser_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ embedder :: Identifier | │ │ AbstractEmbedder :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ embedder :: Identifier | │ │ [kw] | │ │ [::] | │ │ embedder_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ processor :: Identifier | │ │ AbstractProcessor :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ processor :: Identifier | │ │ [kw] | │ │ [::] | │ │ processor_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ finder :: Identifier | │ │ AbstractSimilarityFinder :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ finder :: Identifier | │ │ [kw] | │ │ [::] | │ │ finder_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ tagger :: Identifier | │ │ AbstractTagger :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ tagger :: Identifier | │ │ [kw] | │ │ [::] | │ │ tagger_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ filter :: Identifier | │ │ AbstractTagFilter :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ filter :: Identifier | │ │ [kw] | │ │ [::] | │ │ filter_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ [::] | │ │ reranker :: Identifier | │ │ AbstractReranker :: Identifier | │ │ [.] | │ │ retriever :: Identifier | │ │ [inert] | │ │ reranker :: Identifier | │ │ [kw] | │ │ [::] | │ │ reranker_kwargs :: Identifier | │ │ NamedTuple :: Identifier | │ │ [call] | │ │ NamedTuple :: Identifier | │ │ [kw] | │ │ cost_tracker :: Identifier | │ │ [call] | │ │ [curly] | │ │ [.] | │ │ Threads :: Identifier | │ │ [inert] | │ │ Atomic :: Identifier | │ │ Float64 :: Identifier | │ │ 0.0 :: Value | │ │ [...] | │ │ kwargs :: Identifier | │ │ [::] | │ │ retriever :: Identifier | │ │ AbstractRetriever :: Identifier | │ │ [::] | │ │ index :: Identifier | │ │ AbstractDocumentIndex :: Identifier | │ │ [::] | │ │ question :: Identifier | │ │ AbstractString :: Identifier | │ │ [block] | │ │ [=] | │ │ rephraser_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ rephraser_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ rephraser_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ rephrased_questions :: Identifier | │ │ [call] | │ │ rephrase :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ cost_tracker :: Identifier | │ │ [...] | │ │ rephraser_kwargs_ :: Identifier | │ │ rephraser :: Identifier | │ │ question :: Identifier | │ │ [=] | │ │ embeddings :: Identifier | │ │ [if] | │ │ [call] | │ │ HasEmbeddings :: Identifier | │ │ index :: Identifier | │ │ [block] | │ │ [=] | │ │ embedder_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ embedder_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ embedder_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ embeddings :: Identifier | │ │ [call] | │ │ get_embeddings :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ cost_tracker :: Identifier | │ │ [...] | │ │ embedder_kwargs_ :: Identifier | │ │ embedder :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [block] | │ │ [=] | │ │ embeddings :: Identifier | │ │ [call] | │ │ hcat :: Identifier | │ │ [...] | │ │ [comprehension] | │ │ [generator] | │ │ [ref] | │ │ Float32 :: Identifier | │ │ [=] | │ │ x :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [=] | │ │ keywords :: Identifier | │ │ [if] | │ │ [call] | │ │ HasKeywords :: Identifier | │ │ index :: Identifier | │ │ [block] | │ │ [=] | │ │ keywords :: Identifier | │ │ [call] | │ │ get_keywords :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ [...] | │ │ processor_kwargs :: Identifier | │ │ [kw] | │ │ return_keywords :: Identifier | │ │ true :: Value | │ │ processor :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [&&] | │ │ [call] | │ │ >= :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ [||] | │ │ [call] | │ │ isa :: Identifier | │ │ keywords :: Identifier | │ │ [curly] | │ │ AbstractVector :: Identifier | │ │ [<:] | │ │ [curly] | │ │ AbstractVector :: Identifier | │ │ [<:] | │ │ AbstractString :: Identifier | │ │ [macrocall] | │ │ @warn :: Identifier | │ │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) :: Value | │ │ [string] | │ │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | │ │ [call] | │ │ typeof :: Identifier | │ │ processor :: Identifier | │ │ ")." :: Value | │ │ keywords :: Identifier | │ │ [block] | │ │ [comprehension] | │ │ [generator] | │ │ [ref] | │ │ String :: Identifier | │ │ [=] | │ │ x :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [=] | │ │ finder_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ finder_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ finder_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ emb_candidates :: Identifier | │ │ [call] | │ │ find_closest :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ top_k :: Identifier | │ │ [...] | │ │ finder_kwargs_ :: Identifier | │ │ finder :: Identifier | │ │ index :: Identifier | │ │ embeddings :: Identifier | │ │ keywords :: Identifier | │ │ [=] | │ │ tagger_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ tagger_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ tagger_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ tags :: Identifier | │ │ [call] | │ │ get_tags :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ cost_tracker :: Identifier | │ │ [...] | │ │ tagger_kwargs_ :: Identifier | │ │ tagger :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [=] | │ │ filter_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ filter_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ filter_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ tag_candidates :: Identifier | │ │ [call] | │ │ find_tags :: Identifier | │ │ [parameters] | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ [...] | │ │ filter_kwargs_ :: Identifier | │ │ filter :: Identifier | │ │ index :: Identifier | │ │ tags :: Identifier | │ │ [=] | │ │ filtered_candidates :: Identifier | │ │ [if] | │ │ [call] | │ │ isnothing :: Identifier | │ │ tag_candidates :: Identifier | │ │ emb_candidates :: Identifier | │ │ [call] | │ │ & :: Identifier | │ │ emb_candidates :: Identifier | │ │ tag_candidates :: Identifier | │ │ [=] | │ │ reranker_kwargs_ :: Identifier | │ │ [if] | │ │ [call] | │ │ isempty :: Identifier | │ │ api_kwargs :: Identifier | │ │ reranker_kwargs :: Identifier | │ │ [call] | │ │ merge :: Identifier | │ │ reranker_kwargs :: Identifier | │ │ [tuple] | │ │ [parameters] | │ │ api_kwargs :: Identifier | │ │ [=] | │ │ reranked_candidates :: Identifier | │ │ [call] | │ │ rerank :: Identifier | │ │ [parameters] | │ │ top_n :: Identifier | │ │ [kw] | │ │ verbose :: Identifier | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 1 :: Value | │ │ cost_tracker :: Identifier | │ │ [...] | │ │ reranker_kwargs_ :: Identifier | │ │ reranker :: Identifier | │ │ index :: Identifier | │ │ question :: Identifier | │ │ filtered_candidates :: Identifier | │ │ [&&] | │ │ [call] | │ │ > :: Identifier | │ │ verbose :: Identifier | │ │ 0 :: Value | │ │ [macrocall] | │ │ @info :: Identifier | │ │ :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) :: Value | │ │ [string] | │ │ "Retrieval done. Identified " :: Value | │ │ [call] | │ │ length :: Identifier | │ │ [call] | │ │ positions :: Identifier | │ │ reranked_candidates :: Identifier | │ │ " chunks, total cost: \$" :: Value | │ │ [call] | │ │ round :: Identifier | │ │ [ref] | │ │ cost_tracker :: Identifier | │ │ [kw] | │ │ digits :: Identifier | │ │ 2 :: Value | │ │ "." :: Value | │ │ [=] | │ │ result :: Identifier | │ │ [call] | │ │ RAGResult :: Identifier | │ │ [parameters] | │ │ question :: Identifier | │ │ [kw] | │ │ answer :: Identifier | │ │ nothing :: Identifier | │ │ rephrased_questions :: Identifier | │ │ [kw] | │ │ final_answer :: Identifier | │ │ nothing :: Identifier | │ │ [kw] | │ │ context :: Identifier | │ │ [call] | │ │ collect :: Identifier | │ │ [ref] | │ │ index :: Identifier | │ │ reranked_candidates :: Identifier | │ │ [inert] | │ │ chunks :: Identifier | │ │ [kw] | │ │ sorted :: Identifier | │ │ true :: Value | │ │ [kw] | │ │ sources :: Identifier | │ │ [call] | │ │ collect :: Identifier | │ │ [ref] | │ │ index :: Identifier | │ │ reranked_candidates :: Identifier | │ │ [inert] | │ │ sources :: Identifier | │ │ [kw] | │ │ sorted :: Identifier | │ │ true :: Value | │ │ emb_candidates :: Identifier | │ │ tag_candidates :: Identifier | │ │ filtered_candidates :: Identifier | │ │ reranked_candidates :: Identifier | │ │ [return] | │ │ result :: Identifier | │ │ │ │ st1 = │ │ SyntaxTree with attributes mod,kind,var_id,toplevel_pure,scope_type,context,syntax_flags,name_val,meta,value,jl_source,is_toplevel_thunk,source │ │ [block] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ [if] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ true :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ [=] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ val :: Identifier | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ [function] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retrieve :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ top_k :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 100 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ top_n :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Integer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 5 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractRephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractEmbedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractProcessor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractSimilarityFinder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractTagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractTagFilter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractReranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ NamedTuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Threads :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Atomic :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Float64 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 0.0 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractRetriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractDocumentIndex :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [::] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrase :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephraser :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ HasEmbeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ get_embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embedder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ hcat :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [comprehension] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [generator] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Float32 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ x :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ HasKeywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ get_keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ return_keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [&&] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [||] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractVector :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [<:] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractVector :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [<:] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [let] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Warn :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retrieval :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1128#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ ! :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ === :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ PromptingTools_Experimental_RAGTools_7aa4399b :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ Base.CoreLogging.shouldlog :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ fixup_stdlib_path :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1104 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [local] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [try] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [string] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ typeof :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ processor :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ ")." :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1149#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ Base.CoreLogging.logging_error :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1149#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ false :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1136#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1131#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1127#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1135#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1130#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1129#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1132#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1133#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1134#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [comprehension] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [generator] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ x :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ find_closest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ top_k :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ finder :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ embeddings :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ keywords :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ get_tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tagger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ find_tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filter :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tags :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isnothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ & :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isempty :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ merge :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ api_kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rerank :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ top_n :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker_kwargs_ :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [&&] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ > :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ verbose :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 0 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [let] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Info :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ >= :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.Threads.Atomic{Int32}(-1000) :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ retrieval :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.CoreLogging.current_logger_for_env :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1151#std_level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ ! :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ === :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ PromptingTools_Experimental_RAGTools_30253e51 :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ Base.CoreLogging.shouldlog :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ isa :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ String :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [.] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ fixup_stdlib_path :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 1141 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [local] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [try] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [string] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ "Retrieval done. Identified " :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ length :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ positions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ " chunks, total cost: \$" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ round :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ cost_tracker :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ digits :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ 2 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ "." :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [tuple] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1172#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ invokelatest :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ Base.CoreLogging.logging_error :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1172#err :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ false :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [block] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [isdefined] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ throw :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AssertionError :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base │ │ "Assertion to tell the compiler about the definedness of this variable" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.CoreLogging.handle_message_nothrow :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [...] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1159#kwargs :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1154#logger :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1150#level :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1158#msg :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1153#_module :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1152#group :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1155#id :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1156#file :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ #1157#line :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],mod=Base.CoreLogging │ │ [=] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ result :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ RAGResult :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [parameters] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ question :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ answer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ rephrased_questions :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ final_answer :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ nothing :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ context :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ collect :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ chunks :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ sorted :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ sources :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ collect :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [ref] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ index :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ sources :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [kw] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ sorted :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ true :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ emb_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ tag_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ filtered_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ reranked_candidates :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [return] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ result :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ Base.Docs.doc! :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.Docs.Binding :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ PromptingTools.Experimental.RAGTools :: Value | [old,SL(DJe5gdCtOrM,Base,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),(. Base (inert @__MODULE__))], │ │ [inert] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc],jl_source=L47 │ │ retrieve :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Base.Docs.docstr :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Core.svec :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [call] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Dict{Symbol, Any} :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ :path => "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ :linenumber => 946 :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ :module => PromptingTools.Experimental.RAGTools :: Value | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Union :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [curly] | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ Tuple :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractRetriever :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractDocumentIndex :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ AbstractString :: Identifier | [old,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,),@doc], │ │ [if] | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ true :: Value | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ val :: Identifier | [old,SL(AoA4igCW7yH,Base.Docs,SL(34ZPGA34xzM,PromptingTools.Experimental.RAGTools,)),@doc], │ │ │ │ file = "/home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl" │ │ line = 946 │ └ mod = PromptingTools.Experimental.RAGTools │ ERROR: LoadError: LoweringError: │ #= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 =# - invalid syntax: unknown form `kw` or number of arguments 2 │ Expression: │ (kw sorted true) │ Containing expressions: │ (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) │ │ Detailed provenance: │ (kw sorted true) │ ├─ (kw sorted true) │ │ └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1144 │ └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result)))) │ └─ (macrocall @doc :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 =#) " retrieve(retriever::AbstractRetriever,\n index::AbstractChunkIndex,\n question::AbstractString;\n verbose::Integer = 1,\n top_k::Integer = 100,\n top_n::Integer = 5,\n api_kwargs::NamedTuple = NamedTuple(),\n rephraser::AbstractRephraser = retriever.rephraser,\n rephraser_kwargs::NamedTuple = NamedTuple(),\n embedder::AbstractEmbedder = retriever.embedder,\n embedder_kwargs::NamedTuple = NamedTuple(),\n processor::AbstractProcessor = retriever.processor,\n processor_kwargs::NamedTuple = NamedTuple(),\n finder::AbstractSimilarityFinder = retriever.finder,\n finder_kwargs::NamedTuple = NamedTuple(),\n tagger::AbstractTagger = retriever.tagger,\n tagger_kwargs::NamedTuple = NamedTuple(),\n filter::AbstractTagFilter = retriever.filter,\n filter_kwargs::NamedTuple = NamedTuple(),\n reranker::AbstractReranker = retriever.reranker,\n reranker_kwargs::NamedTuple = NamedTuple(),\n cost_tracker = Threads.Atomic{Float64}(0.0),\n kwargs...)\n\nRetrieves the most relevant chunks from the index for the given question and returns them in the `RAGResult` object.\n\nThis is the main entry point for the retrieval stage of the RAG pipeline. It is often followed by `generate!` step.\n\nNotes:\n- The default flow is `build_context!` -> `answer!` -> `refine!` -> `postprocess!`.\n\nThe arguments correspond to the steps of the retrieval process (rephrasing, embedding, finding similar docs, tagging, filtering by tags, reranking).\nYou can customize each step by providing a new custom type that dispatches the corresponding function, \n eg, create your own type `struct MyReranker<:AbstractReranker end` and define the custom method for it `rerank(::MyReranker,...) = ...`.\n\nNote: Discover available retrieval sub-types for each step with `subtypes(AbstractRephraser)` and similar for other abstract types.\n\nIf you're using locally-hosted models, you can pass the `api_kwargs` with the `url` field set to the model's URL and make sure to provide corresponding \n `model` kwargs to `rephraser`, `embedder`, and `tagger` to use the custom models (they make AI calls).\n\n# Arguments\n- `retriever`: The retrieval method to use. Default is `SimpleRetriever` but could be `AdvancedRetriever` for more advanced retrieval.\n- `index`: The index that holds the chunks and sources to be retrieved from.\n- `question`: The question to be used for the retrieval.\n- `verbose`: If `>0`, it prints out verbose logging. Default is `1`. If you set it to `2`, it will print out logs for each sub-function.\n- `top_k`: The TOTAL number of closest chunks to return from `find_closest`. Default is `100`.\n If there are multiple rephrased questions, the number of chunks per each item will be `top_k ÷ number_of_rephrased_questions`.\n- `top_n`: The TOTAL number of most relevant chunks to return for the context (from `rerank` step). Default is `5`.\n- `api_kwargs`: Additional keyword arguments to be passed to the API calls (shared by all `ai*` calls).\n- `rephraser`: Transform the question into one or more questions. Default is `retriever.rephraser`.\n- `rephraser_kwargs`: Additional keyword arguments to be passed to the rephraser.\n - `model`: The model to use for rephrasing. Default is `PT.MODEL_CHAT`.\n - `template`: The rephrasing template to use. Default is `:RAGQueryOptimizer` or `:RAGQueryHyDE` (depending on the `rephraser` selected).\n- `embedder`: The embedding method to use. Default is `retriever.embedder`.\n- `embedder_kwargs`: Additional keyword arguments to be passed to the embedder.\n- `processor`: The processor method to use when using Keyword-based index. Default is `retriever.processor`.\n- `processor_kwargs`: Additional keyword arguments to be passed to the processor.\n- `finder`: The similarity search method to use. Default is `retriever.finder`, often `CosineSimilarity`.\n- `finder_kwargs`: Additional keyword arguments to be passed to the similarity finder.\n- `tagger`: The tag generating method to use. Default is `retriever.tagger`.\n- `tagger_kwargs`: Additional keyword arguments to be passed to the tagger. Noteworthy arguments:\n - `tags`: Directly provide the tags to use for filtering (can be String, Regex, or Vector{String}). Useful for `tagger = PassthroughTagger`.\n- `filter`: The tag matching method to use. Default is `retriever.filter`.\n- `filter_kwargs`: Additional keyword arguments to be passed to the tag filter.\n- `reranker`: The reranking method to use. Default is `retriever.reranker`.\n- `reranker_kwargs`: Additional keyword arguments to be passed to the reranker.\n - `model`: The model to use for reranking. Default is `rerank-english-v2.0` if you use `reranker = CohereReranker()`.\n- `cost_tracker`: An atomic counter to track the cost of the retrieval. Default is `Threads.Atomic{Float64}(0.0)`.\n\nSee also: `SimpleRetriever`, `AdvancedRetriever`, `build_index`, `rephrase`, `get_embeddings`, `get_keywords`, `find_closest`, `get_tags`, `find_tags`, `rerank`, `RAGResult`.\n\n# Examples\n\nFind the 5 most relevant chunks from the index for the given question.\n```julia\n# assumes you have an existing index `index`\nretriever = SimpleRetriever()\n\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n\n# or use the default retriever (same as above)\nresult = retrieve(retriever,\n index,\n \"What is the capital of France?\",\n top_n = 5)\n```\n\nApply more advanced retrieval with question rephrasing and reranking (requires `COHERE_API_KEY`).\nWe will obtain top 100 chunks from embeddings (`top_k`) and top 5 chunks from reranking (`top_n`).\n\n```julia\nretriever = AdvancedRetriever()\n\nresult = retrieve(retriever, index, question; top_k=100, top_n=5)\n```\n\nYou can use the `retriever` to customize your retrieval strategy or directly change the strategy types in the `retrieve` kwargs!\n\nExample of using locally-hosted model hosted on `localhost:8080`:\n```julia\nretriever = SimpleRetriever()\nresult = retrieve(retriever, index, question;\n rephraser_kwargs = (; model = \"custom\"),\n embedder_kwargs = (; model = \"custom\"),\n tagger_kwargs = (; model = \"custom\"), api_kwargs = (;\n url = \"http://localhost:8080\"))\n```\n" (function (call retrieve (parameters (kw (:: verbose Integer) 1) (kw (:: top_k Integer) 100) (kw (:: top_n Integer) 5) (kw (:: api_kwargs NamedTuple) (call NamedTuple)) (kw (:: rephraser AbstractRephraser) (. retriever (inert rephraser))) (kw (:: rephraser_kwargs NamedTuple) (call NamedTuple)) (kw (:: embedder AbstractEmbedder) (. retriever (inert embedder))) (kw (:: embedder_kwargs NamedTuple) (call NamedTuple)) (kw (:: processor AbstractProcessor) (. retriever (inert processor))) (kw (:: processor_kwargs NamedTuple) (call NamedTuple)) (kw (:: finder AbstractSimilarityFinder) (. retriever (inert finder))) (kw (:: finder_kwargs NamedTuple) (call NamedTuple)) (kw (:: tagger AbstractTagger) (. retriever (inert tagger))) (kw (:: tagger_kwargs NamedTuple) (call NamedTuple)) (kw (:: filter AbstractTagFilter) (. retriever (inert filter))) (kw (:: filter_kwargs NamedTuple) (call NamedTuple)) (kw (:: reranker AbstractReranker) (. retriever (inert reranker))) (kw (:: reranker_kwargs NamedTuple) (call NamedTuple)) (kw cost_tracker (call (curly (. Threads (inert Atomic)) Float64) 0.0)) (... kwargs)) (:: retriever AbstractRetriever) (:: index AbstractDocumentIndex) (:: question AbstractString)) (block (= rephraser_kwargs_ (if (call isempty api_kwargs) rephraser_kwargs (call merge rephraser_kwargs (tuple (parameters api_kwargs))))) (= rephrased_questions (call rephrase (parameters (kw verbose (call > verbose 1)) cost_tracker (... rephraser_kwargs_)) rephraser question)) (= embeddings (if (call HasEmbeddings index) (block (= embedder_kwargs_ (if (call isempty api_kwargs) embedder_kwargs (call merge embedder_kwargs (tuple (parameters api_kwargs))))) (= embeddings (call get_embeddings (parameters (kw verbose (call > verbose 1)) cost_tracker (... embedder_kwargs_)) embedder rephrased_questions))) (block (= embeddings (call hcat (... (comprehension (generator (ref Float32) (= x rephrased_questions))))))))) (= keywords (if (call HasKeywords index) (block (= keywords (call get_keywords (parameters (kw verbose (call > verbose 1)) (... processor_kwargs) (kw return_keywords true)) processor rephrased_questions)) (&& (call >= verbose 1) (|| (call isa keywords (curly AbstractVector (<: (curly AbstractVector (<: AbstractString))))) (macrocall @warn :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1104 =#) (string "Processed Keywords is not a vector of tokenized queries. Have you used the correct processor? (provided: " (call typeof processor) ").")))) keywords) (block (comprehension (generator (ref String) (= x rephrased_questions)))))) (= finder_kwargs_ (if (call isempty api_kwargs) finder_kwargs (call merge finder_kwargs (tuple (parameters api_kwargs))))) (= emb_candidates (call find_closest (parameters (kw verbose (call > verbose 1)) top_k (... finder_kwargs_)) finder index embeddings keywords)) (= tagger_kwargs_ (if (call isempty api_kwargs) tagger_kwargs (call merge tagger_kwargs (tuple (parameters api_kwargs))))) (= tags (call get_tags (parameters (kw verbose (call > verbose 1)) cost_tracker (... tagger_kwargs_)) tagger rephrased_questions)) (= filter_kwargs_ (if (call isempty api_kwargs) filter_kwargs (call merge filter_kwargs (tuple (parameters api_kwargs))))) (= tag_candidates (call find_tags (parameters (kw verbose (call > verbose 1)) (... filter_kwargs_)) filter index tags)) (= filtered_candidates (if (call isnothing tag_candidates) emb_candidates (call & emb_candidates tag_candidates))) (= reranker_kwargs_ (if (call isempty api_kwargs) reranker_kwargs (call merge reranker_kwargs (tuple (parameters api_kwargs))))) (= reranked_candidates (call rerank (parameters top_n (kw verbose (call > verbose 1)) cost_tracker (... reranker_kwargs_)) reranker index question filtered_candidates)) (&& (call > verbose 0) (macrocall @info :(#= /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:1141 =#) (string "Retrieval done. Identified " (call length (call positions reranked_candidates)) " chunks, total cost: \$" (call round (ref cost_tracker) (kw digits 2)) "."))) (= result (call RAGResult (parameters question (kw answer nothing) rephrased_questions (kw final_answer nothing) (kw context (call collect (ref index reranked_candidates (inert chunks) (kw sorted true)))) (kw sources (call collect (ref index reranked_candidates (inert sources) (kw sorted true)))) emb_candidates tag_candidates filtered_candidates reranked_candidates))) (return result)))) │ └─ @ /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 │ │ Stacktrace: │ [1] expand_forms_2(ctx::Base.JuliaLowering.MacroExpansionContext{Dict{Symbol, Dict{Int64, Any}}}, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/desugaring.jl:4496 │ [2] core_lowering_hook(code::Any, mod::Module, file::String, line::UInt64, world::UInt64, _warn::Bool) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/hooks.jl:30 │ [3] include(mapexpr::Function, mod::Module, _path::String) │ @ Base Base.jl:326 │ [4] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:47 │ [5] eval(m::Module, e::Any) │ @ Core boot.jl:522 │ [6] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745 │ [7] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool}) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined] │ [8] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1 │ [9] include(mapexpr::Function, mod::Module, _path::String) │ @ Base Base.jl:326 │ [10] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:18 │ [11] eval(m::Module, e::Any) │ @ Core boot.jl:522 │ [12] _eval(mod::Module, iter::Base.JuliaLowering.LoweringIterator{Dict{Symbol, Dict{Int64, Any}}}; soft_scope::Nothing) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:745 │ [13] eval(mod::Module, ex::Base.JuliaSyntax.SyntaxTree{Dict{Symbol, Dict{Int64, Any}}}; macro_world::UInt64, soft_scope::Nothing, opts::@Kwargs{expr_compat_mode::Bool}) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/eval.jl:718 [inlined] │ [14] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1 │ [15] include(mapexpr::Function, mod::Module, _path::String) │ @ Base Base.jl:326 │ [16] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:93 │ [17] include(mod::Module, _path::String) │ @ Base Base.jl:325 │ [18] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing) │ @ Base loading.jl:3303 │ [19] top-level scope │ @ stdin:5 │ [20] eval(m::Module, e::Any) │ @ Core boot.jl:522 │ [21] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) │ @ Base loading.jl:3132 │ [22] include_string(m::Module, txt::String, fname::String) │ @ Base loading.jl:3142 [inlined] │ [23] exec_options(opts::Base.JLOptions) │ @ Base client.jl:353 │ [24] _start() │ @ Base client.jl:596 │ in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/retrieval.jl:946 │ in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/RAGTools/RAGTools.jl:1 │ in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/Experimental/Experimental.jl:1 │ in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/src/PromptingTools.jl:1 │ in expression starting at stdin:5 └ ┌ PromptingTools → MarkdownPromptingToolsExt │ ERROR: LoadError: Precompiled image Base.PkgId(Base.UUID("670122d1-24a8-4d70-bfce-740807c42192"), "PromptingTools") not available with flags CacheFlags(; use_pkgimages=false, debug_level=1, check_bounds=1, inline=true, opt_level=0) │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] __require_prelocked(pkg::Base.PkgId, env::String) │ @ Base loading.jl:2837 │ [3] _require_prelocked(uuidkey::Base.PkgId, env::String) │ @ Base loading.jl:2685 │ [4] macro expansion │ @ loading.jl:2599 [inlined] │ [5] macro expansion │ @ lock.jl:376 [inlined] │ [6] __require(into::Module, mod::Symbol) │ @ Base loading.jl:2563 │ [7] require(into::Module, mod::Symbol) │ @ Base loading.jl:2539 [inlined] │ [8] eval_import_path(at::Module, from::Nothing, path::Expr, keyword::String) │ @ Base module.jl:36 [inlined] │ [9] eval_import_path_all(at::Module, path::Expr, keyword::String) │ @ Base module.jl:60 │ [10] _eval_using(to::Module, path::Expr, flags::UInt8) │ @ Base module.jl:137 [inlined] │ [11] eval_using(to::Module, path::Expr) │ @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/runtime.jl:130 │ [12] top-level scope │ @ ~/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:3 │ [13] include(mod::Module, _path::String) │ @ Base Base.jl:325 │ [14] include_package_for_output(pkg::Base.PkgId, input::String, syntax_version::VersionNumber, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt128}}, source::Nothing) │ @ Base loading.jl:3303 │ [15] top-level scope │ @ stdin:5 │ [16] eval(m::Module, e::Any) │ @ Core boot.jl:522 │ [17] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) │ @ Base loading.jl:3132 │ [18] include_string(m::Module, txt::String, fname::String) │ @ Base loading.jl:3142 [inlined] │ [19] exec_options(opts::Base.JLOptions) │ @ Base client.jl:353 │ [20] _start() │ @ Base client.jl:596 │ in expression starting at /home/pkgeval/.julia/packages/PromptingTools/lqJyF/ext/MarkdownPromptingToolsExt.jl:1 │ in expression starting at stdin:5 └ ERROR: LoadError: The following 3 packages failed to precompile: LLMCheatsheets Failed to precompile LLMCheatsheets [bfa53fcd-5caf-4eca-9d0c-bcc16d41cad3] to "/home/pkgeval/.julia/compiled/v1.14/LLMCheatsheets/jl_HXjrgB" (ProcessExited(1)). PromptingTools Failed to precompile PromptingTools [670122d1-24a8-4d70-bfce-740807c42192] to "/home/pkgeval/.julia/compiled/v1.14/PromptingTools/jl_pJ02Au" (ProcessExited(1)). PromptingTools → MarkdownPromptingToolsExt Failed to precompile MarkdownPromptingToolsExt [d0be87b4-40ad-5214-b203-6d62ab8a77ad] to "/home/pkgeval/.julia/compiled/v1.14/MarkdownPromptingToolsExt/jl_HQ4X23" (ProcessExited(1)). in expression starting at /home/pkgeval/.julia/packages/LLMCheatsheets/zpbkp/test/runtests.jl:2 Testing failed after 330.1s ERROR: LoadError: Package LLMCheatsheets errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3247 [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587 [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [7] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [8] include(mod::Module, _path::String) @ Base Base.jl:325 [9] exec_options(opts::Base.JLOptions) @ Base client.jl:355 [10] _start() @ Base client.jl:596 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 1610.11s: package fails to precompile