Package evaluation to test SARSOP on Julia 1.13.0-DEV.1319 (9cddfda8ef*) started at 2025-10-16T20:12:06.091 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 10.11s ################################################################################ # Installation # Installing SARSOP... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [cef570c6] + SARSOP v0.6.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [66dad0bd] + AliasTables v1.1.3 [ec485272] + ArnoldiMethod v0.4.0 [35d6a980] + ColorSchemes v3.31.0 [3da002f7] + ColorTypes v0.12.1 [c3611d14] + ColorVectorSpace v0.11.0 [5ae59095] + Colors v0.13.1 [d842c3ba] + CommonRLInterface v0.3.3 [34da2185] + Compat v4.18.1 [d38c429a] + Contour v0.6.3 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.8.0 [864edb3b] + DataStructures v0.19.1 [e2d170a0] + DataValueInterfaces v1.0.0 [31c24e10] + Distributions v0.25.122 [ffbed154] + DocStringExtensions v0.9.5 [1a297f60] + FillArrays v1.14.0 [53c48c17] + FixedPointNumbers v0.8.5 [86223c79] + Graphs v1.13.1 [34004b35] + HypergeometricFunctions v0.3.28 [d25df0c9] + Inflate v0.1.5 [842dd82b] + InlineStrings v1.4.5 [41ab1584] + InvertedIndices v1.3.1 [92d709cd] + IrrationalConstants v0.2.6 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.1 [b964fa9f] + LaTeXStrings v1.4.0 [9c8b4983] + LightXML v0.9.3 [2ab3a3ac] + LogExpFunctions v0.3.29 [77fc6e33] + MOMDPs v0.1.2 [1914dd2f] + MacroTools v0.5.16 [299715c1] + MarchingCubes v0.1.11 [e1d29d7a] + Missings v1.2.0 [77ba4419] + NaNMath v1.1.3 [d9ec5142] + NamedTupleTools v0.14.3 [bac558e1] + OrderedCollections v1.8.1 [90014a1f] + PDMats v0.11.35 [f3bd98c0] + POMDPLinter v0.1.3 [7588e00f] + POMDPTools v1.1.0 [c6f6ee83] + POMDPXFiles v0.3.1 [a93abf59] + POMDPs v1.0.0 [d96e819e] + Parameters v0.12.3 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.0 [08abe8d2] + PrettyTables v3.1.0 [92933f4c] + ProgressMeter v1.11.0 [43287f4e] + PtrArrays v1.3.0 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [cef570c6] + SARSOP v0.6.0 [91c51154] + SentinelArrays v1.4.8 [699a6c99] + SimpleTraits v0.9.5 [a2af1166] + SortingAlgorithms v1.2.2 [276daf66] + SpecialFunctions v2.6.1 [90137ffa] + StaticArrays v1.9.15 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.1 [2913bbd2] + StatsBase v0.34.6 [4c63d2b9] + StatsFuns v1.5.0 [892a3eda] + StringManipulation v0.4.1 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [62fd8b95] + TensorCore v0.1.1 [410a4b4d] + Tricks v0.1.12 [3a884ed6] + UnPack v1.0.2 [b8865327] + UnicodePlots v3.8.1 [94ce4f54] + Libiconv_jll v1.18.0+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [e478675d] + SARSOP_jll v0.96.1+0 [02c8fc9c] + XML2_jll v2.15.0+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.16.0+0 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.9.9 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.7+0 [458c3c95] + OpenSSL_jll v3.5.4+0 [efcefdf7] + PCRE2_jll v10.46.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.1+2 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.67.1+0 [3f19e933] + p7zip_jll v17.6.0+0 Installation completed after 6.25s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 Precompiling package dependencies... Precompilation completed after 193.91s ################################################################################ # Testing # Testing SARSOP Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Updating `/tmp/jl_9Qylar/Project.toml` [355abbd5] + POMDPModels v0.4.21 [8af83fb2] + QuickPOMDPs v0.2.15 [de008ff0] + RockSample v0.2.1 [cef570c6] + SARSOP v0.6.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_9Qylar/Manifest.toml` [861a8166] + Combinatorics v1.0.3 [a81c6b42] + Compose v0.9.6 ⌅ [864edb3b] ↓ DataStructures v0.19.1 ⇒ v0.18.22 [4b033969] + DiscreteValueIteration v0.4.8 [c8e1da08] + IterTools v1.10.0 ⌅ [682c06a0] + JSON v0.21.4 [9c8b4983] + LightXML v0.9.3 [442fdcdd] + Measures v0.3.2 [355abbd5] + POMDPModels v0.4.21 [c6f6ee83] + POMDPXFiles v0.3.1 [69de0a69] + Parsers v2.8.3 ⌅ [c8b314e2] + ParticleFilters v0.5.7 [8af83fb2] + QuickPOMDPs v0.2.15 [de008ff0] + RockSample v0.2.1 [cef570c6] + SARSOP v0.6.0 [94ce4f54] + Libiconv_jll v1.18.0+0 [e478675d] + SARSOP_jll v0.96.1+0 [02c8fc9c] + XML2_jll v2.15.0+0 [8dfed614] ~ Test ⇒ v1.11.0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Test Successfully re-resolved Status `/tmp/jl_9Qylar/Project.toml` [77fc6e33] MOMDPs v0.1.2 [f3bd98c0] POMDPLinter v0.1.3 [355abbd5] POMDPModels v0.4.21 [7588e00f] POMDPTools v1.1.0 [a93abf59] POMDPs v1.0.0 [8af83fb2] QuickPOMDPs v0.2.15 [de008ff0] RockSample v0.2.1 [cef570c6] SARSOP v0.6.0 [90137ffa] StaticArrays v1.9.15 [37e2e46d] LinearAlgebra v1.13.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_9Qylar/Manifest.toml` [66dad0bd] AliasTables v1.1.3 [ec485272] ArnoldiMethod v0.4.0 [35d6a980] ColorSchemes v3.31.0 [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.1 [861a8166] Combinatorics v1.0.3 [d842c3ba] CommonRLInterface v0.3.3 [34da2185] Compat v4.18.1 [a81c6b42] Compose v0.9.6 [d38c429a] Contour v0.6.3 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.8.0 ⌅ [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [4b033969] DiscreteValueIteration v0.4.8 [31c24e10] Distributions v0.25.122 [ffbed154] DocStringExtensions v0.9.5 [1a297f60] FillArrays v1.14.0 [53c48c17] FixedPointNumbers v0.8.5 [86223c79] Graphs v1.13.1 [34004b35] HypergeometricFunctions v0.3.28 [d25df0c9] Inflate v0.1.5 [842dd82b] InlineStrings v1.4.5 [41ab1584] InvertedIndices v1.3.1 [92d709cd] IrrationalConstants v0.2.6 [c8e1da08] IterTools v1.10.0 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 ⌅ [682c06a0] JSON v0.21.4 [b964fa9f] LaTeXStrings v1.4.0 [9c8b4983] LightXML v0.9.3 [2ab3a3ac] LogExpFunctions v0.3.29 [77fc6e33] MOMDPs v0.1.2 [1914dd2f] MacroTools v0.5.16 [299715c1] MarchingCubes v0.1.11 [442fdcdd] Measures v0.3.2 [e1d29d7a] Missings v1.2.0 [77ba4419] NaNMath v1.1.3 [d9ec5142] NamedTupleTools v0.14.3 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.35 [f3bd98c0] POMDPLinter v0.1.3 [355abbd5] POMDPModels v0.4.21 [7588e00f] POMDPTools v1.1.0 [c6f6ee83] POMDPXFiles v0.3.1 [a93abf59] POMDPs v1.0.0 [d96e819e] Parameters v0.12.3 [69de0a69] Parsers v2.8.3 ⌅ [c8b314e2] ParticleFilters v0.5.7 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.0 [08abe8d2] PrettyTables v3.1.0 [92933f4c] ProgressMeter v1.11.0 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [8af83fb2] QuickPOMDPs v0.2.15 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [de008ff0] RockSample v0.2.1 [cef570c6] SARSOP v0.6.0 [91c51154] SentinelArrays v1.4.8 [699a6c99] SimpleTraits v0.9.5 [a2af1166] SortingAlgorithms v1.2.2 [276daf66] SpecialFunctions v2.6.1 [90137ffa] StaticArrays v1.9.15 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.6 [4c63d2b9] StatsFuns v1.5.0 [892a3eda] StringManipulation v0.4.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [62fd8b95] TensorCore v0.1.1 [410a4b4d] Tricks v0.1.12 [3a884ed6] UnPack v1.0.2 [b8865327] UnicodePlots v3.8.1 [94ce4f54] Libiconv_jll v1.18.0+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [e478675d] SARSOP_jll v0.96.1+0 [02c8fc9c] XML2_jll v2.15.0+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.16.0+0 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.9.9 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.4+0 [efcefdf7] PCRE2_jll v10.46.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.67.1+0 [3f19e933] p7zip_jll v17.6.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Generating a pomdpx file: model.pomdpx Test Summary: | Pass Total Time POMDPFile | 2 2 11.7s Generating a pomdpx file: model.pomdpx Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 -20 92.8214 112.821 3 1 0 0 50 -10.3779 68.3971 78.775 16 19 0 0 100 -1.84296 55.4624 57.3054 10 19 0 1 239 15.9902 25.2824 9.29216 5 19 0 1 240 15.9902 25.2824 9.29216 6 19 0 1 250 16.3731 24.6458 8.27276 5 19 0 2 319 18.51 21.2418 2.73177 5 19 0 3 350 18.7656 20.6738 1.90818 14 19 0 3 400 19.1006 19.964 0.863334 9 19 0.01 4 539 19.3648 19.4911 0.126281 5 19 0.01 4 540 19.3648 19.4911 0.126281 6 19 0.01 4 550 19.3655 19.4776 0.112032 5 19 0.01 4 600 19.3689 19.4162 0.0473 11 19 0.01 4 650 19.3703 19.3909 0.0206536 6 19 0.01 5 765 19.3713 19.3724 0.00112993 5 19 0.01 5 765 19.3713 19.3724 0.00112993 5 19 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.010000 precision reached : 0.001130 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0.01 5 765 19.3713 19.3724 0.00112993 5 19 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out INFO: POMDPLinter requirements for solve(::SARSOPSolver, ::POMDP) and dependencies. ([✔] = implemented correctly; [X] = not implemented; [?] = could not determine) For solve(::SARSOPSolver, ::POMDP): [✔] discount(::TigerPOMDP) [✔] transition(::TigerPOMDP, ::Bool, ::Int64) [✔] reward(::TigerPOMDP, ::Bool, ::Int64) [✔] stateindex(::TigerPOMDP, ::Bool) [✔] obsindex(::TigerPOMDP, ::Bool) [✔] observations(::TigerPOMDP) [✔] observation(::TigerPOMDP, ::Int64, ::Bool) [✔] actionindex(::TigerPOMDP, ::Int64) [✔] actions(::TigerPOMDP, ::Bool) [✔] support(::BoolDistribution) [✔] pdf(::BoolDistribution, ::Bool) For ordered_states(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [✔] states(::TigerPOMDP) [✔] length(::Tuple{BoolBool}) For ordered_actions(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [✔] actions(::TigerPOMDP) [✔] length(::UnitRange{Int64}) For ordered_observations(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [No additional requirements] Generating a pomdpx file: model.pomdpx Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 10 14.2625 4.2625 6 1 0 2 9 13.3119 13.3119 0 6 4 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.010000 precision reached : 0.000000 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 2 9 13.3119 13.3119 0 4 4 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out Generating a pomdpx file: model.pomdpx Progress: 3%|█▏ | ETA: 0:00:04 Progress: 100%|█████████████████████████████████████████| Time: 0:00:00 Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 10 14.2625 4.2625 24 1 0 2 7 13.3119 13.3119 0 31 4 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.010000 precision reached : 0.000000 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 2 7 13.3119 13.3119 0 7 4 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out Test Summary: | Pass Total Time Basic interface | 1 1 23.5s Loading the model ... input file : model.pomdpx Loading the policy ... input file : policy.out Simulating ... action selection : one-step look ahead ----------------------------------- #Simulations | Exp Total Reward ----------------------------------- 1 9.025 2 13.3119 3 11.8829 4 13.3119 5 12.4545 ----------------------------------- Finishing ... ------------------------------------------------------------- #Simulations | Exp Total Reward | 95% Confidence Interval ------------------------------------------------------------- 5 12.4545 (8.77281, 16.1362) ------------------------------------------------------------- Loading the model ... input file : model.pomdpx Loading the policy ... input file : policy.out Simulating ... action selection : one-step look ahead ----------------------------------- #Simulations | Exp Total Reward ----------------------------------- 1 9.025 2 9.025 3 9.025 4 11.1684 5 12.4545 ----------------------------------- Finishing ... ------------------------------------------------------------- #Simulations | Exp Total Reward | 95% Confidence Interval ------------------------------------------------------------- 5 12.4545 (8.77281, 16.1362) ------------------------------------------------------------- Test Summary: | Total Time Simulator | 0 0.5s input file : model.pomdpx Use one-step look ahead Test Summary: | Pass Total Time Policy Graph | 1 1 0.2s Test Summary: | Pass Total Time Load policy | 2 2 0.6s Generating a pomdpx file: model.pomdpx Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 -47.3685 -16.0713 31.2971 2 1 0 5 51 -17.9323 -16.0492 1.88318 9 6 0 10 103 -16.3978 -16.2159 0.181953 2 8 0 14 151 -16.3124 -16.277 0.0353847 2 13 0 18 207 -16.3058 -16.2969 0.00887227 2 16 0 21 250 -16.3055 -16.3022 0.00329006 7 16 0 25 305 -16.3055 -16.3044 0.00111584 2 18 0 26 323 -16.3055 -16.3045 0.000944675 2 18 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.001000 precision reached : 0.000945 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 26 323 -16.3055 -16.3045 0.000944675 2 18 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out Test Summary: | Total Time Issue #39 | 0 3.4s Generating a pomdpx file: model.pomdpx Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 40.6515 89.0191 48.3675 3 1 0 1 50 49.271 88.43 39.159 12 46 0 1 100 57.3012 87.7201 30.4189 5 46 0 1 150 62.1646 87.7201 25.5556 13 81 0.01 2 203 66.5058 87.0412 20.5354 5 81 0.01 2 250 67.3742 87.0412 19.667 12 113 0.01 3 323 67.5436 85.7532 18.2096 17 122 0.01 3 350 68.6944 85.7532 17.0588 11 147 0.01 4 441 70.9835 85.2459 14.2624 6 175 0.01 4 450 71.1178 85.2459 14.1281 15 178 0.01 5 500 72.047 85.2459 13.1988 10 218 0.01 5 559 73.3356 84.7768 11.4412 5 218 0.01 5 600 73.8882 84.7768 10.8887 23 239 0.02 6 681 74.8299 84.4148 9.58489 21 253 0.02 6 700 75.0298 84.4148 9.38495 11 262 0.02 7 805 75.9481 83.9496 8.00151 5 291 0.02 7 806 75.9481 83.9496 8.00151 6 291 0.02 7 850 76.2742 83.9496 7.67545 5 323 0.02 8 927 76.6729 83.51 6.83712 4 334 0.03 8 950 76.6939 83.51 6.81615 5 354 0.03 9 1059 77.0322 83.2171 6.18491 3 373 0.03 9 1060 77.0322 83.2171 6.18491 4 373 0.03 9 1100 77.1807 83.2171 6.03643 11 405 0.03 10 1185 77.4499 82.9839 5.53397 3 424 0.03 10 1200 77.4765 82.9839 5.5074 7 437 0.04 11 1313 77.661 82.6517 4.99065 3 473 0.04 11 1314 77.661 82.6517 4.99065 4 473 0.04 11 1350 77.7081 82.6517 4.94362 7 500 0.04 12 1439 77.9116 82.3852 4.47361 4 512 0.04 12 1450 77.9163 82.3852 4.46883 4 519 0.04 12 1500 77.9326 82.3852 4.4526 10 554 0.05 13 1571 78.0049 82.1554 4.15056 4 558 0.05 13 1600 78.0096 82.1554 4.14579 11 583 0.05 14 1701 78.0582 81.8977 3.83944 4 599 0.05 14 1702 78.0582 81.8977 3.83944 5 599 0.05 14 1750 78.0635 81.8977 3.83413 9 625 0.06 15 1837 78.1119 81.7738 3.66192 4 634 0.06 15 1850 78.1157 81.7738 3.65805 6 638 0.06 15 1900 78.1401 81.7738 3.63372 12 665 0.06 16 1969 78.1712 81.725 3.5538 4 665 0.06 16 2000 78.1775 81.725 3.54751 13 672 0.06 17 2101 78.1888 81.6575 3.46875 4 676 0.06 17 2102 78.1888 81.6575 3.46875 5 676 0.07 17 2150 78.2038 81.6575 3.45368 9 705 0.07 18 2221 78.206 81.4166 3.21053 4 711 0.07 18 2250 78.2061 81.4166 3.21044 11 724 0.07 19 2351 78.2256 81.2202 2.99457 4 750 0.07 19 2352 78.2256 81.2202 2.99457 5 750 0.08 19 2400 78.2266 81.2202 2.99359 9 791 0.08 20 2483 78.2414 81.1022 2.86074 4 799 0.08 21 2513 78.2462 81.0627 2.81643 4 802 0.08 21 2550 78.2546 81.0627 2.80805 8 805 0.09 22 2649 78.2657 80.9699 2.70424 4 823 0.09 22 2650 78.2657 80.9699 2.70424 5 823 0.1 22 2700 78.2663 80.9699 2.70365 11 855 0.1 23 2781 78.2734 80.8511 2.57769 4 863 0.1 23 2800 78.2745 80.8511 2.57659 12 870 0.11 24 2913 78.2832 80.7519 2.46878 4 915 0.11 24 2914 78.2832 80.7519 2.46878 5 915 0.12 24 2950 78.2854 80.7519 2.4665 8 938 0.12 25 3043 78.289 80.6777 2.38869 4 961 0.12 25 3050 78.2891 80.6777 2.3886 11 961 0.12 25 3100 78.2893 80.6777 2.38833 6 979 0.13 26 3171 78.2918 80.5938 2.30201 4 982 0.13 26 3200 78.2919 80.5938 2.30192 11 987 0.13 27 3307 78.2925 80.5368 2.24429 4 989 0.13 27 3308 78.2925 80.5368 2.24429 5 989 0.13 27 3350 78.2938 80.5368 2.24294 14 1018 0.14 28 3441 78.2957 80.4099 2.11419 4 1033 0.14 28 3450 78.2957 80.4099 2.11416 13 1035 0.14 29 3500 78.2968 80.3516 2.05477 12 1055 0.15 30 3609 78.298 80.2961 1.99814 4 1075 0.15 30 3610 78.298 80.2961 1.99814 5 1075 0.16 30 3650 78.298 80.2961 1.99809 12 1082 0.16 31 3743 78.299 80.2633 1.96438 4 1087 0.16 31 3750 78.299 80.2633 1.96438 11 1090 0.16 31 3800 78.299 80.2633 1.96436 6 1111 0.17 32 3873 78.2996 80.2194 1.91977 4 1114 0.17 32 3900 78.2997 80.2194 1.91974 9 1120 0.17 33 4001 78.3002 80.1603 1.86004 4 1125 0.17 33 4002 78.3002 80.1603 1.86004 5 1125 0.17 34 4050 78.3005 80.1289 1.82842 9 1138 0.18 34 4100 78.3006 80.1289 1.82829 4 1158 0.18 35 4167 78.3009 80.0743 1.7734 4 1162 0.18 35 4200 78.3009 80.0743 1.77339 4 1179 0.19 36 4291 78.3012 79.9839 1.68271 4 1191 0.19 36 4300 78.3012 79.9839 1.68271 13 1191 0.19 36 4350 78.3012 79.9839 1.68269 8 1221 0.2 37 4415 78.3014 79.9456 1.64426 4 1223 0.2 37 4450 78.3014 79.9456 1.64424 6 1234 0.2 38 4549 78.3016 79.9286 1.62698 4 1235 0.2 38 4550 78.3016 79.9286 1.62698 5 1235 0.21 38 4600 78.3016 79.9286 1.62698 11 1276 0.21 39 4677 78.3017 79.8583 1.55657 4 1283 0.22 39 4700 78.3017 79.8583 1.55656 5 1292 0.22 40 4809 78.3019 79.798 1.49611 4 1322 0.23 40 4810 78.3019 79.798 1.49611 5 1322 0.23 40 4850 78.3019 79.798 1.4961 12 1334 0.24 41 4933 78.3019 79.747 1.44506 4 1337 0.24 41 4950 78.302 79.747 1.44506 10 1346 0.25 42 5057 78.302 79.6909 1.38891 4 1355 0.25 42 5058 78.302 79.6909 1.38891 5 1355 0.25 43 5100 78.3021 79.6714 1.36931 9 1362 0.26 44 5203 78.3021 79.6462 1.34412 4 1382 0.26 44 5204 78.3021 79.6462 1.34412 5 1382 0.27 44 5250 78.3021 79.6462 1.34412 7 1401 0.27 45 5315 78.3022 79.5868 1.28466 4 1403 0.28 45 5350 78.3022 79.5868 1.28465 6 1432 0.29 46 5400 78.3022 79.5386 1.23642 11 1435 0.29 46 5450 78.3022 79.5386 1.23642 6 1439 0.3 47 5517 78.3022 79.5182 1.21606 4 1443 0.31 47 5550 78.3022 79.5182 1.21606 4 1459 0.31 48 5613 78.3022 79.4876 1.18546 4 1465 0.32 48 5650 78.3022 79.4876 1.18546 8 1479 0.32 49 5729 78.3022 79.444 1.14184 4 1481 0.33 49 5750 78.3022 79.444 1.14184 14 1490 0.34 50 5855 78.3022 79.4234 1.12116 4 1514 0.34 50 5856 78.3022 79.4234 1.12116 5 1514 0.34 50 5900 78.3022 79.4234 1.12116 5 1532 0.35 51 5973 78.3022 79.3773 1.07506 4 1541 0.35 51 6000 78.3022 79.3773 1.07505 9 1551 0.36 52 6087 78.3022 79.3431 1.04085 4 1566 0.36 53 6103 78.3022 79.3373 1.03503 4 1567 0.37 53 6150 78.3023 79.3373 1.03502 7 1582 0.37 54 6209 78.3023 79.3283 1.02603 4 1584 0.38 54 6250 78.3023 79.3283 1.02603 12 1588 0.38 55 6337 78.3023 79.3079 1.00562 4 1598 0.39 55 6350 78.3023 79.3079 1.00562 6 1600 0.4 56 6449 78.3023 79.2785 0.976243 4 1615 0.4 56 6450 78.3023 79.2785 0.976243 5 1615 0.41 56 6500 78.3023 79.2785 0.976242 11 1624 0.41 57 6569 78.3023 79.2505 0.94824 4 1628 0.42 57 6600 78.3023 79.2505 0.94824 13 1630 0.43 58 6683 78.3023 79.2374 0.935169 4 1639 0.44 58 6700 78.3023 79.2374 0.935169 10 1653 0.45 59 6755 78.3023 79.2108 0.908526 4 1666 0.45 59 6800 78.3023 79.2108 0.908525 5 1672 0.46 60 6869 78.3023 79.1773 0.874981 4 1676 0.47 60 6900 78.3023 79.1773 0.874981 13 1691 0.48 61 6983 78.3023 79.154 0.851701 4 1699 0.48 61 7000 78.3023 79.154 0.851701 10 1699 0.49 62 7097 78.3023 79.1539 0.851603 4 1710 0.49 62 7100 78.3023 79.1539 0.851603 7 1710 0.5 63 7197 78.3023 79.0223 0.720012 4 1731 0.51 63 7200 78.3023 79.0223 0.720012 7 1731 0.51 63 7250 78.3023 79.0223 0.720012 13 1731 0.51 64 7315 78.3023 78.986 0.683756 4 1731 0.51 64 7350 78.3023 78.986 0.683756 6 1731 0.51 65 7451 78.3023 78.9555 0.65319 4 1731 0.52 65 7452 78.3023 78.9555 0.65319 5 1731 0.52 65 7500 78.3023 78.9555 0.65319 9 1739 0.53 66 7571 78.3023 78.9057 0.603393 4 1740 0.53 66 7600 78.3023 78.9057 0.603393 11 1740 0.53 67 7691 78.3023 78.8599 0.557646 4 1740 0.54 68 7703 78.3023 78.8526 0.550362 4 1743 0.54 68 7750 78.3023 78.8526 0.550361 7 1753 0.55 69 7815 78.3023 78.8095 0.507257 4 1754 0.55 69 7850 78.3023 78.8095 0.507257 6 1754 0.56 70 7949 78.3023 78.7851 0.482793 4 1759 0.56 70 7950 78.3023 78.7851 0.482793 5 1759 0.56 70 8000 78.3023 78.7851 0.482793 11 1762 0.57 71 8067 78.3023 78.7448 0.442559 4 1762 0.58 71 8100 78.3023 78.7448 0.442559 4 1764 0.58 72 8179 78.3023 78.702 0.399731 4 1764 0.58 73 8205 78.3023 78.6894 0.387096 4 1766 0.59 73 8250 78.3023 78.6894 0.387096 5 1766 0.59 74 8335 78.3023 78.6813 0.378974 4 1766 0.59 75 8350 78.3023 78.6622 0.359885 7 1766 0.6 76 8433 78.3023 78.6401 0.337841 4 1776 0.6 76 8450 78.3023 78.6401 0.337841 10 1776 0.6 77 8555 78.3023 78.6198 0.317516 4 1777 0.61 77 8556 78.3023 78.6198 0.317516 5 1777 0.61 77 8600 78.3023 78.6198 0.317516 5 1782 0.62 78 8659 78.3023 78.5902 0.287869 4 1786 0.62 78 8700 78.3023 78.5902 0.287869 12 1786 0.62 79 8789 78.3023 78.5823 0.279982 4 1787 0.62 79 8800 78.3023 78.5823 0.279982 4 1788 0.63 80 8877 78.3023 78.5636 0.261319 4 1789 0.63 81 8900 78.3023 78.56 0.257738 5 1789 0.63 82 8999 78.3023 78.5539 0.251589 4 1789 0.63 82 9000 78.3023 78.5539 0.251589 5 1789 0.64 83 9091 78.3023 78.541 0.238686 4 1798 0.64 83 9100 78.3023 78.541 0.238686 13 1798 0.65 84 9179 78.3023 78.5257 0.223423 4 1799 0.65 84 9200 78.3023 78.5257 0.223423 14 1799 0.65 85 9285 78.3023 78.5088 0.206507 4 1799 0.66 85 9300 78.3023 78.5088 0.206507 8 1800 0.67 86 9403 78.3023 78.4956 0.19332 4 1801 0.67 86 9404 78.3023 78.4956 0.19332 5 1801 0.67 86 9450 78.3023 78.4956 0.19332 7 1802 0.67 87 9505 78.3023 78.4683 0.16596 4 1805 0.67 87 9550 78.3023 78.4683 0.16596 5 1805 0.67 88 9601 78.3023 78.4468 0.144538 4 1806 0.68 89 9697 78.3023 78.438 0.135701 4 1806 0.68 89 9700 78.3023 78.438 0.135701 7 1806 0.68 89 9750 78.3023 78.438 0.135701 13 1806 0.68 90 9809 78.3023 78.4352 0.132862 4 1808 0.69 91 9887 78.3023 78.429 0.126664 4 1809 0.69 92 9903 78.3023 78.4271 0.124779 4 1810 0.69 93 9979 78.3023 78.4188 0.116464 4 1810 0.7 93 10000 78.3023 78.4188 0.116464 14 1814 0.7 94 10059 78.3023 78.4093 0.106961 4 1817 0.71 96 10100 78.3023 78.3798 0.0774599 12 1817 0.71 97 10213 78.3023 78.3781 0.0758121 4 1817 0.71 97 10214 78.3023 78.3781 0.0758121 5 1817 0.71 97 10250 78.3023 78.3781 0.0758121 8 1817 0.71 98 10309 78.3023 78.3624 0.0601264 4 1817 0.72 98 10350 78.3023 78.3624 0.0601264 12 1817 0.72 99 10429 78.3023 78.3548 0.0524753 4 1817 0.72 100 10450 78.3023 78.3535 0.0512377 5 1818 0.72 100 10500 78.3023 78.3535 0.0512377 11 1818 0.73 101 10583 78.3023 78.3527 0.0503851 4 1818 0.73 101 10600 78.3023 78.3527 0.0503851 10 1818 0.74 102 10679 78.3023 78.3445 0.0422225 4 1818 0.74 103 10700 78.3023 78.3432 0.0409203 14 1818 0.75 104 10801 78.3023 78.3395 0.0371664 4 1818 0.75 104 10802 78.3023 78.3395 0.0371664 5 1818 0.76 104 10850 78.3023 78.3395 0.0371664 9 1818 0.77 105 10907 78.3023 78.3358 0.0335543 4 1818 0.77 105 10950 78.3023 78.3358 0.0335543 14 1818 0.77 106 11035 78.3023 78.3339 0.0316074 4 1820 0.77 106 11050 78.3023 78.3339 0.0316074 8 1820 0.78 107 11127 78.3023 78.3316 0.0293092 4 1820 0.78 107 11150 78.3023 78.3316 0.0293092 5 1820 0.78 108 11217 78.3023 78.3291 0.0268402 4 1820 0.78 108 11250 78.3023 78.3291 0.0268402 4 1820 0.79 109 11300 78.3023 78.3203 0.0180055 5 1820 0.79 110 11350 78.3023 78.3199 0.0176405 11 1821 0.79 111 11441 78.3023 78.3187 0.0163741 4 1821 0.8 112 11457 78.3023 78.3185 0.016174 4 1821 0.8 112 11500 78.3023 78.3185 0.016174 14 1821 0.81 113 11573 78.3023 78.3163 0.0140419 4 1821 0.81 114 11600 78.3023 78.315 0.0127175 9 1821 0.82 115 11715 78.3023 78.3134 0.0110823 4 1821 0.82 115 11716 78.3023 78.3134 0.0110823 5 1821 0.82 116 11750 78.3023 78.3131 0.0108227 6 1821 0.83 117 11849 78.3023 78.3118 0.00955358 4 1821 0.83 117 11850 78.3023 78.3118 0.00955358 5 1821 0.84 117 11900 78.3023 78.3118 0.00955358 11 1824 0.84 118 11967 78.3023 78.3109 0.00861837 4 1824 0.84 118 12000 78.3023 78.3109 0.00861837 4 1824 0.85 119 12105 78.3023 78.3102 0.00793627 4 1827 0.85 119 12106 78.3023 78.3102 0.00793627 5 1827 0.86 119 12150 78.3023 78.3102 0.00793627 5 1827 0.86 120 12221 78.3023 78.3094 0.00708087 4 1827 0.87 120 12250 78.3023 78.3094 0.00708087 11 1827 0.87 121 12325 78.3023 78.3085 0.0062341 4 1827 0.88 121 12350 78.3023 78.3085 0.0062341 7 1827 0.88 122 12425 78.3023 78.3082 0.00586441 4 1827 0.88 122 12450 78.3023 78.3082 0.00586441 7 1827 0.89 123 12525 78.3023 78.3078 0.00548537 4 1827 0.89 123 12550 78.3023 78.3078 0.00548537 7 1827 0.9 124 12649 78.3023 78.3072 0.00487642 4 1845 0.9 124 12650 78.3023 78.3072 0.00487642 5 1845 0.91 125 12725 78.3023 78.3059 0.0035596 4 1845 0.92 126 12750 78.3023 78.3055 0.00324646 7 1845 0.92 127 12861 78.3023 78.305 0.00273337 4 1845 0.93 127 12862 78.3023 78.305 0.00273337 5 1845 0.93 127 12900 78.3023 78.305 0.00273337 10 1845 0.93 128 12993 78.3023 78.3047 0.00236197 4 1845 0.93 128 13000 78.3023 78.3047 0.00236197 11 1847 0.94 129 13065 78.3023 78.3046 0.0022747 4 1875 0.94 129 13100 78.3023 78.3046 0.0022747 6 1875 0.95 130 13203 78.3023 78.3043 0.00203219 4 1875 0.95 130 13204 78.3023 78.3043 0.00203219 5 1875 0.95 130 13250 78.3023 78.3043 0.00203219 7 1875 0.96 131 13329 78.3023 78.3041 0.0017869 4 1876 0.96 131 13350 78.3023 78.3041 0.0017869 14 1879 0.97 132 13441 78.3023 78.3039 0.00156965 4 1879 0.97 132 13450 78.3023 78.3039 0.00156965 13 1879 0.98 132 13500 78.3023 78.3039 0.00156965 8 1879 0.98 133 13563 78.3023 78.3037 0.00145284 4 1879 0.99 133 13600 78.3023 78.3037 0.00145284 8 1879 1 134 13677 78.3023 78.3036 0.00131472 4 1881 1.01 134 13700 78.3023 78.3036 0.00131472 5 1881 1.02 135 13773 78.3023 78.3035 0.00117078 4 1881 1.02 135 13800 78.3023 78.3035 0.00117078 9 1881 1.03 136 13867 78.3023 78.3031 0.000840962 4 1881 1.03 136 13867 78.3023 78.3031 0.000840962 4 1881 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.001000 precision reached : 0.000841 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 1.03 136 13867 78.3023 78.3031 0.000840962 4 1881 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out results_c["SARSOP"] = 77.94657503677806 Test Summary: | Pass Total Time Issue #40 | 1 1 14.6s Testing SARSOP tests passed Testing completed after 87.68s PkgEval succeeded after 313.63s