Package evaluation of SARSOP on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T17:01:08.389 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.8s ################################################################################ # Installation # Installing SARSOP... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [cef570c6] + SARSOP v0.5.8 Updating `~/.julia/environments/v1.11/Manifest.toml` [66dad0bd] + AliasTables v1.1.3 [ec485272] + ArnoldiMethod v0.4.0 [35d6a980] + ColorSchemes v3.29.0 [3da002f7] + ColorTypes v0.12.1 [c3611d14] + ColorVectorSpace v0.11.0 [5ae59095] + Colors v0.13.0 [d842c3ba] + CommonRLInterface v0.3.3 [34da2185] + Compat v4.16.0 [d38c429a] + Contour v0.6.3 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.7.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [31c24e10] + Distributions v0.25.118 [ffbed154] + DocStringExtensions v0.9.4 [1a297f60] + FillArrays v1.13.0 [53c48c17] + FixedPointNumbers v0.8.5 [86223c79] + Graphs v1.12.1 [34004b35] + HypergeometricFunctions v0.3.28 [d25df0c9] + Inflate v0.1.5 [842dd82b] + InlineStrings v1.4.3 [41ab1584] + InvertedIndices v1.3.1 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [b964fa9f] + LaTeXStrings v1.4.0 [9c8b4983] + LightXML v0.9.1 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.15 [299715c1] + MarchingCubes v0.1.11 [e1d29d7a] + Missings v1.2.0 [77ba4419] + NaNMath v1.1.3 [d9ec5142] + NamedTupleTools v0.14.3 [bac558e1] + OrderedCollections v1.8.0 [90014a1f] + PDMats v0.11.33 [f3bd98c0] + POMDPLinter v0.1.2 [7588e00f] + POMDPTools v1.1.0 [c6f6ee83] + POMDPXFiles v0.3.0 [a93abf59] + POMDPs v1.0.0 [d96e819e] + Parameters v0.12.3 [2dfb63ee] + PooledArrays v1.4.3 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [08abe8d2] + PrettyTables v2.4.0 [92933f4c] + ProgressMeter v1.10.4 [43287f4e] + PtrArrays v1.3.0 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [cef570c6] + SARSOP v0.5.8 [91c51154] + SentinelArrays v1.4.8 [699a6c99] + SimpleTraits v0.9.4 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.0 [90137ffa] + StaticArrays v1.9.13 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.4 [4c63d2b9] + StatsFuns v1.4.0 [892a3eda] + StringManipulation v0.4.1 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [62fd8b95] + TensorCore v0.1.1 [410a4b4d] + Tricks v0.1.10 [3a884ed6] + UnPack v1.0.2 [b8865327] + UnicodePlots v3.7.2 [94ce4f54] + Libiconv_jll v1.18.0+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [e478675d] + SARSOP_jll v0.96.1+0 [02c8fc9c] + XML2_jll v2.13.6+1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.58s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.11/activate_set.jl:63 Precompiling package dependencies... Precompilation completed after 26.1s ################################################################################ # Testing # Testing SARSOP ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_fMoche/Project.toml` [f3bd98c0] POMDPLinter v0.1.2 [355abbd5] POMDPModels v0.4.21 [7588e00f] POMDPTools v1.1.0 [c6f6ee83] POMDPXFiles v0.3.0 [a93abf59] POMDPs v1.0.0 [d96e819e] Parameters v0.12.3 [8af83fb2] QuickPOMDPs v0.2.15 [cef570c6] SARSOP v0.5.8 [e478675d] SARSOP_jll v0.96.1+0 [8dfed614] Test v1.11.0 Status `/tmp/jl_fMoche/Manifest.toml` [66dad0bd] AliasTables v1.1.3 [ec485272] ArnoldiMethod v0.4.0 [35d6a980] ColorSchemes v3.29.0 ⌅ [3da002f7] ColorTypes v0.11.5 ⌃ [c3611d14] ColorVectorSpace v0.10.0 ⌅ [5ae59095] Colors v0.12.11 [d842c3ba] CommonRLInterface v0.3.3 [34da2185] Compat v4.16.0 [a81c6b42] Compose v0.9.5 [d38c429a] Contour v0.6.3 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [31c24e10] Distributions v0.25.118 [ffbed154] DocStringExtensions v0.9.4 [1a297f60] FillArrays v1.13.0 [53c48c17] FixedPointNumbers v0.8.5 [86223c79] Graphs v1.12.1 [34004b35] HypergeometricFunctions v0.3.28 [d25df0c9] Inflate v0.1.5 [842dd82b] InlineStrings v1.4.3 [41ab1584] InvertedIndices v1.3.1 [92d709cd] IrrationalConstants v0.2.4 [c8e1da08] IterTools v1.10.0 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [b964fa9f] LaTeXStrings v1.4.0 [9c8b4983] LightXML v0.9.1 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.15 [299715c1] MarchingCubes v0.1.11 [442fdcdd] Measures v0.3.2 [e1d29d7a] Missings v1.2.0 [77ba4419] NaNMath v1.1.3 [d9ec5142] NamedTupleTools v0.14.3 [bac558e1] OrderedCollections v1.8.0 [90014a1f] PDMats v0.11.33 [f3bd98c0] POMDPLinter v0.1.2 [355abbd5] POMDPModels v0.4.21 [7588e00f] POMDPTools v1.1.0 [c6f6ee83] POMDPXFiles v0.3.0 [a93abf59] POMDPs v1.0.0 [d96e819e] Parameters v0.12.3 [69de0a69] Parsers v2.8.1 [2dfb63ee] PooledArrays v1.4.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [08abe8d2] PrettyTables v2.4.0 [92933f4c] ProgressMeter v1.10.4 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [8af83fb2] QuickPOMDPs v0.2.15 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [cef570c6] SARSOP v0.5.8 [91c51154] SentinelArrays v1.4.8 [699a6c99] SimpleTraits v0.9.4 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.0 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.4 [4c63d2b9] StatsFuns v1.4.0 [892a3eda] StringManipulation v0.4.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [62fd8b95] TensorCore v0.1.1 [410a4b4d] Tricks v0.1.10 [3a884ed6] UnPack v1.0.2 [b8865327] UnicodePlots v3.7.2 [94ce4f54] Libiconv_jll v1.18.0+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [e478675d] SARSOP_jll v0.96.1+0 [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [05823500] OpenLibm_jll v0.8.5+0 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Precompiling QuickPOMDPs... 17097.3 ms ✓ QuickPOMDPs 1 dependency successfully precompiled in 21 seconds. 109 already precompiled. Generating a pomdpx file: model.pomdpx Progress: 5%|██ | ETA: 0:00:00 Progress: 100%|█████████████████████████████████████████| Time: 0:00:01 Test Summary: | Pass Total Time POMDPFile | 2 2 10.6s Generating a pomdpx file: model.pomdpx Progress: 5%|██ | ETA: 0:00:00 Progress: 100%|█████████████████████████████████████████| Time: 0:00:00 Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 -20 92.8214 112.821 3 1 0 0 50 -10.3779 68.3971 78.775 16 19 0 0 100 -1.84296 55.4624 57.3054 10 19 0 1 239 15.9902 25.2824 9.29216 5 19 0 1 240 15.9902 25.2824 9.29216 6 19 0 1 250 16.3731 24.6458 8.27276 5 19 0 2 319 18.51 21.2418 2.73177 5 19 0 3 350 18.7656 20.6738 1.90818 14 19 0 3 400 19.1006 19.964 0.863334 9 19 0.01 4 539 19.3648 19.4911 0.126281 5 19 0.01 4 540 19.3648 19.4911 0.126281 6 19 0.01 4 550 19.3655 19.4776 0.112032 5 19 0.01 4 600 19.3689 19.4162 0.0473 11 19 0.01 4 650 19.3703 19.3909 0.0206536 6 19 0.01 5 765 19.3713 19.3724 0.00112993 5 19 0.01 5 765 19.3713 19.3724 0.00112993 5 19 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.010000 precision reached : 0.001130 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0.01 5 765 19.3713 19.3724 0.00112993 5 19 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out INFO: POMDPLinter requirements for solve(::SARSOPSolver, ::POMDP) and dependencies. ([✔] = implemented correctly; [X] = not implemented; [?] = could not determine) For solve(::SARSOPSolver, ::POMDP): [✔] discount(::TigerPOMDP) [✔] transition(::TigerPOMDP, ::Bool, ::Int64) [✔] reward(::TigerPOMDP, ::Bool, ::Int64) [✔] stateindex(::TigerPOMDP, ::Bool) [✔] obsindex(::TigerPOMDP, ::Bool) [✔] observations(::TigerPOMDP) [✔] observation(::TigerPOMDP, ::Int64, ::Bool) [✔] actionindex(::TigerPOMDP, ::Int64) [✔] actions(::TigerPOMDP, ::Bool) [✔] support(::BoolDistribution) [✔] pdf(::BoolDistribution, ::Bool) For ordered_states(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [✔] states(::TigerPOMDP) [✔] length(::Tuple{BoolBool}) For ordered_actions(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [✔] actions(::TigerPOMDP) [✔] length(::UnitRange{Int64}) For ordered_observations(::Union{MDP,POMDP}) (in solve(::SARSOPSolver, ::POMDP)): [No additional requirements] Test Summary: | Pass Total Time Basic interface | 1 1 12.2s Loading the model ... input file : model.pomdpx Loading the policy ... input file : policy.out Simulating ... action selection : one-step look ahead ----------------------------------- #Simulations | Exp Total Reward ----------------------------------- 1 5.40312 2 4.91915 3 5.08047 4 4.91915 5 5.01595 ----------------------------------- Finishing ... ------------------------------------------------------------- #Simulations | Exp Total Reward | 95% Confidence Interval ------------------------------------------------------------- 5 5.01595 (4.6003, 5.43159) ------------------------------------------------------------- Loading the model ... input file : model.pomdpx Loading the policy ... input file : policy.out Simulating ... action selection : one-step look ahead ----------------------------------- #Simulations | Exp Total Reward ----------------------------------- 1 -4.52438 2 -1.05975 3 -0.130074 4 0.503664 5 0.883908 ----------------------------------- Finishing ... ------------------------------------------------------------- #Simulations | Exp Total Reward | 95% Confidence Interval ------------------------------------------------------------- 5 0.883908 (-1.49745, 3.26527) ------------------------------------------------------------- Test Summary: | Total Time Simulator | 0 0.6s input file : model.pomdpx Use one-step look ahead Test Summary: | Pass Total Time Policy Graph | 1 1 0.3s Progress: 5%|██ | ETA: 0:00:00 Progress: 100%|█████████████████████████████████████████| Time: 0:00:00 Test Summary: | Pass Total Time Load policy | 2 2 0.5s Generating a pomdpx file: model.pomdpx Progress: 6%|██▌ | ETA: 0:00:00 Progress: 100%|█████████████████████████████████████████| Time: 0:00:00 Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 -47.3685 -16.0713 31.2971 2 1 0 5 51 -17.9323 -16.0492 1.88318 9 6 0 10 103 -16.3978 -16.2159 0.181953 2 8 0 14 151 -16.3124 -16.277 0.0353847 2 13 0 18 207 -16.3058 -16.2969 0.00887227 2 16 0 21 250 -16.3055 -16.3022 0.00329006 7 16 0 25 305 -16.3055 -16.3044 0.00111584 2 18 0 26 323 -16.3055 -16.3045 0.000944675 2 18 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.001000 precision reached : 0.000945 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 26 323 -16.3055 -16.3045 0.000944675 2 18 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out Test Summary: | Total Time Issue #39 | 0 3.5s Generating a pomdpx file: model.pomdpx Progress: 3%|█▎ | ETA: 0:00:00 Progress: 100%|█████████████████████████████████████████| Time: 0:00:00 Loading the model ... input file : model.pomdpx loading time : 0.00s SARSOP initializing ... initialization time : 0.00s ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0 0 0 40.6515 89.0191 48.3675 3 1 0.01 1 50 49.271 88.43 39.159 12 46 0.01 1 100 57.3012 87.7201 30.4189 5 46 0.01 1 150 62.1646 87.7201 25.5556 13 81 0.01 2 203 66.5058 87.0412 20.5354 5 81 0.01 2 250 67.3742 87.0412 19.667 12 113 0.01 3 323 67.5436 85.7532 18.2096 17 122 0.01 3 350 68.6944 85.7532 17.0588 11 147 0.01 4 441 70.9835 85.2459 14.2624 6 175 0.01 4 450 71.1178 85.2459 14.1281 15 178 0.02 5 500 72.047 85.2459 13.1988 10 218 0.02 5 559 73.3356 84.7768 11.4412 5 218 0.02 5 600 73.8882 84.7768 10.8887 23 239 0.02 6 681 74.8299 84.4148 9.58489 21 253 0.02 6 700 75.0298 84.4148 9.38495 11 262 0.02 7 805 75.9481 83.9496 8.00151 5 291 0.02 7 806 75.9481 83.9496 8.00151 6 291 0.03 7 850 76.2742 83.9496 7.67545 5 323 0.03 8 927 76.6729 83.51 6.83712 4 334 0.03 8 950 76.6939 83.51 6.81615 5 354 0.03 9 1059 77.0322 83.2171 6.18491 3 373 0.03 9 1060 77.0322 83.2171 6.18491 4 373 0.03 9 1100 77.1807 83.2171 6.03643 11 405 0.04 10 1185 77.4499 82.9839 5.53397 3 424 0.04 10 1200 77.4765 82.9839 5.5074 7 437 0.04 11 1313 77.661 82.6517 4.99065 3 473 0.04 11 1314 77.661 82.6517 4.99065 4 473 0.04 11 1350 77.7081 82.6517 4.94362 7 500 0.05 12 1439 77.9116 82.3852 4.47361 4 512 0.05 12 1450 77.9163 82.3852 4.46883 4 519 0.05 12 1500 77.9326 82.3852 4.4526 10 554 0.05 13 1571 78.0049 82.1554 4.15056 4 558 0.05 13 1600 78.0096 82.1554 4.14579 11 583 0.06 14 1701 78.0582 81.8977 3.83944 4 599 0.06 14 1702 78.0582 81.8977 3.83944 5 599 0.06 14 1750 78.0635 81.8977 3.83413 9 625 0.06 15 1837 78.1119 81.7738 3.66192 4 634 0.06 15 1850 78.1157 81.7738 3.65805 6 638 0.06 15 1900 78.1401 81.7738 3.63372 12 665 0.07 16 1969 78.1712 81.725 3.5538 4 665 0.07 16 2000 78.1775 81.725 3.54751 13 672 0.07 17 2101 78.1888 81.6575 3.46875 4 676 0.07 17 2102 78.1888 81.6575 3.46875 5 676 0.07 17 2150 78.2038 81.6575 3.45368 9 705 0.07 18 2221 78.206 81.4166 3.21053 4 711 0.08 18 2250 78.2061 81.4166 3.21044 11 724 0.08 19 2351 78.2256 81.2202 2.99457 4 750 0.08 19 2352 78.2256 81.2202 2.99457 5 750 0.08 19 2400 78.2266 81.2202 2.99359 9 791 0.09 20 2483 78.2414 81.1022 2.86074 4 799 0.09 21 2513 78.2462 81.0627 2.81643 4 802 0.09 21 2550 78.2546 81.0627 2.80805 8 805 0.09 22 2649 78.2657 80.9699 2.70424 4 823 0.09 22 2650 78.2657 80.9699 2.70424 5 823 0.1 22 2700 78.2663 80.9699 2.70365 11 855 0.1 23 2781 78.2734 80.8511 2.57769 4 863 0.1 23 2800 78.2745 80.8511 2.57659 12 870 0.11 24 2913 78.2832 80.7519 2.46878 4 915 0.11 24 2914 78.2832 80.7519 2.46878 5 915 0.11 24 2950 78.2854 80.7519 2.4665 8 938 0.11 25 3043 78.289 80.6777 2.38869 4 961 0.11 25 3050 78.2891 80.6777 2.3886 11 961 0.12 25 3100 78.2893 80.6777 2.38833 6 979 0.12 26 3171 78.2918 80.5938 2.30201 4 982 0.12 26 3200 78.2919 80.5938 2.30192 11 987 0.12 27 3307 78.2925 80.5368 2.24429 4 989 0.12 27 3308 78.2925 80.5368 2.24429 5 989 0.13 27 3350 78.2938 80.5368 2.24294 14 1018 0.13 28 3441 78.2957 80.4099 2.11419 4 1033 0.13 28 3450 78.2957 80.4099 2.11416 13 1035 0.14 29 3500 78.2968 80.3516 2.05477 12 1055 0.14 30 3609 78.298 80.2961 1.99814 4 1075 0.14 30 3610 78.298 80.2961 1.99814 5 1075 0.14 30 3650 78.298 80.2961 1.99809 12 1082 0.15 31 3743 78.299 80.2633 1.96438 4 1087 0.15 31 3750 78.299 80.2633 1.96438 11 1090 0.15 31 3800 78.299 80.2633 1.96436 6 1111 0.15 32 3873 78.2996 80.2194 1.91977 4 1114 0.16 32 3900 78.2997 80.2194 1.91974 9 1120 0.16 33 4001 78.3002 80.1603 1.86004 4 1125 0.16 33 4002 78.3002 80.1603 1.86004 5 1125 0.16 34 4050 78.3005 80.1289 1.82842 9 1138 0.17 34 4100 78.3006 80.1289 1.82829 4 1158 0.17 35 4167 78.3009 80.0743 1.7734 4 1162 0.17 35 4200 78.3009 80.0743 1.77339 4 1179 0.19 36 4291 78.3012 79.9839 1.68271 4 1191 0.19 36 4300 78.3012 79.9839 1.68271 13 1191 0.19 36 4350 78.3012 79.9839 1.68269 8 1221 0.2 37 4415 78.3014 79.9456 1.64426 4 1223 0.2 37 4450 78.3014 79.9456 1.64424 6 1234 0.2 38 4549 78.3016 79.9286 1.62698 4 1235 0.2 38 4550 78.3016 79.9286 1.62698 5 1235 0.21 38 4600 78.3016 79.9286 1.62698 11 1276 0.22 39 4677 78.3017 79.8583 1.55657 4 1283 0.22 39 4700 78.3017 79.8583 1.55656 5 1292 0.23 40 4809 78.3019 79.798 1.49611 4 1322 0.23 40 4810 78.3019 79.798 1.49611 5 1322 0.23 40 4850 78.3019 79.798 1.4961 12 1334 0.23 41 4933 78.3019 79.747 1.44506 4 1337 0.24 41 4950 78.302 79.747 1.44506 10 1346 0.24 42 5057 78.302 79.6909 1.38891 4 1355 0.24 42 5058 78.302 79.6909 1.38891 5 1355 0.25 43 5100 78.3021 79.6714 1.36931 9 1362 0.25 44 5203 78.3021 79.6462 1.34412 4 1382 0.25 44 5204 78.3021 79.6462 1.34412 5 1382 0.26 44 5250 78.3021 79.6462 1.34412 7 1401 0.26 45 5315 78.3022 79.5868 1.28466 4 1403 0.27 45 5350 78.3022 79.5868 1.28465 6 1432 0.27 46 5400 78.3022 79.5386 1.23642 11 1435 0.27 46 5450 78.3022 79.5386 1.23642 6 1439 0.28 47 5517 78.3022 79.5182 1.21606 4 1443 0.28 47 5550 78.3022 79.5182 1.21606 4 1459 0.29 48 5613 78.3022 79.4876 1.18546 4 1465 0.29 48 5650 78.3022 79.4876 1.18546 8 1479 0.3 49 5729 78.3022 79.444 1.14184 4 1481 0.3 49 5750 78.3022 79.444 1.14184 14 1490 0.31 50 5855 78.3022 79.4234 1.12116 4 1514 0.31 50 5856 78.3022 79.4234 1.12116 5 1514 0.32 50 5900 78.3022 79.4234 1.12116 5 1532 0.32 51 5973 78.3022 79.3773 1.07506 4 1541 0.32 51 6000 78.3022 79.3773 1.07505 9 1551 0.33 52 6087 78.3022 79.3431 1.04085 4 1566 0.33 53 6103 78.3022 79.3373 1.03503 4 1567 0.34 53 6150 78.3023 79.3373 1.03502 7 1582 0.34 54 6209 78.3023 79.3283 1.02603 4 1584 0.35 54 6250 78.3023 79.3283 1.02603 12 1588 0.35 55 6337 78.3023 79.3079 1.00562 4 1598 0.35 55 6350 78.3023 79.3079 1.00562 6 1600 0.36 56 6449 78.3023 79.2785 0.976243 4 1615 0.36 56 6450 78.3023 79.2785 0.976243 5 1615 0.37 56 6500 78.3023 79.2785 0.976242 11 1624 0.37 57 6569 78.3023 79.2505 0.94824 4 1628 0.38 57 6600 78.3023 79.2505 0.94824 13 1630 0.38 58 6683 78.3023 79.2374 0.935169 4 1639 0.39 58 6700 78.3023 79.2374 0.935169 10 1653 0.39 59 6755 78.3023 79.2108 0.908526 4 1666 0.4 59 6800 78.3023 79.2108 0.908525 5 1672 0.41 60 6869 78.3023 79.1773 0.874981 4 1676 0.41 60 6900 78.3023 79.1773 0.874981 13 1691 0.42 61 6983 78.3023 79.154 0.851701 4 1699 0.42 61 7000 78.3023 79.154 0.851701 10 1699 0.43 62 7097 78.3023 79.1539 0.851603 4 1710 0.43 62 7100 78.3023 79.1539 0.851603 7 1710 0.44 63 7197 78.3023 79.0223 0.720012 4 1731 0.44 63 7200 78.3023 79.0223 0.720012 7 1731 0.44 63 7250 78.3023 79.0223 0.720012 13 1731 0.44 64 7315 78.3023 78.986 0.683756 4 1731 0.44 64 7350 78.3023 78.986 0.683756 6 1731 0.45 65 7451 78.3023 78.9555 0.65319 4 1731 0.45 65 7452 78.3023 78.9555 0.65319 5 1731 0.45 65 7500 78.3023 78.9555 0.65319 9 1739 0.46 66 7571 78.3023 78.9057 0.603393 4 1740 0.46 66 7600 78.3023 78.9057 0.603393 11 1740 0.46 67 7691 78.3023 78.8599 0.557646 4 1740 0.46 68 7703 78.3023 78.8526 0.550362 4 1743 0.47 68 7750 78.3023 78.8526 0.550361 7 1753 0.48 69 7815 78.3023 78.8095 0.507257 4 1754 0.48 69 7850 78.3023 78.8095 0.507257 6 1754 0.48 70 7949 78.3023 78.7851 0.482793 4 1759 0.48 70 7950 78.3023 78.7851 0.482793 5 1759 0.49 70 8000 78.3023 78.7851 0.482793 11 1762 0.5 71 8067 78.3023 78.7448 0.442559 4 1762 0.5 71 8100 78.3023 78.7448 0.442559 4 1764 0.51 72 8179 78.3023 78.702 0.399731 4 1764 0.51 73 8205 78.3023 78.6894 0.387096 4 1766 0.52 73 8250 78.3023 78.6894 0.387096 5 1766 0.52 74 8335 78.3023 78.6813 0.378974 4 1766 0.53 75 8350 78.3023 78.6622 0.359885 7 1766 0.53 76 8433 78.3023 78.6401 0.337841 4 1776 0.54 76 8450 78.3023 78.6401 0.337841 10 1776 0.54 77 8555 78.3023 78.6198 0.317516 4 1777 0.55 77 8556 78.3023 78.6198 0.317516 5 1777 0.55 77 8600 78.3023 78.6198 0.317516 5 1782 0.55 78 8659 78.3023 78.5902 0.287869 4 1786 0.56 78 8700 78.3023 78.5902 0.287869 12 1786 0.56 79 8789 78.3023 78.5823 0.279982 4 1787 0.56 79 8800 78.3023 78.5823 0.279982 4 1788 0.57 80 8877 78.3023 78.5636 0.261319 4 1789 0.57 81 8900 78.3023 78.56 0.257738 5 1789 0.57 82 8999 78.3023 78.5539 0.251589 4 1789 0.57 82 9000 78.3023 78.5539 0.251589 5 1789 0.58 83 9091 78.3023 78.541 0.238686 4 1798 0.58 83 9100 78.3023 78.541 0.238686 13 1798 0.59 84 9179 78.3023 78.5257 0.223423 4 1799 0.59 84 9200 78.3023 78.5257 0.223423 14 1799 0.59 85 9285 78.3023 78.5088 0.206507 4 1799 0.6 85 9300 78.3023 78.5088 0.206507 8 1800 0.6 86 9403 78.3023 78.4956 0.19332 4 1801 0.6 86 9404 78.3023 78.4956 0.19332 5 1801 0.61 86 9450 78.3023 78.4956 0.19332 7 1802 0.61 87 9505 78.3023 78.4683 0.16596 4 1805 0.61 87 9550 78.3023 78.4683 0.16596 5 1805 0.62 88 9601 78.3023 78.4468 0.144538 4 1806 0.62 89 9697 78.3023 78.438 0.135701 4 1806 0.62 89 9700 78.3023 78.438 0.135701 7 1806 0.63 89 9750 78.3023 78.438 0.135701 13 1806 0.63 90 9809 78.3023 78.4352 0.132862 4 1808 0.63 91 9887 78.3023 78.429 0.126664 4 1809 0.63 92 9903 78.3023 78.4271 0.124779 4 1810 0.64 93 9979 78.3023 78.4188 0.116464 4 1810 0.64 93 10000 78.3023 78.4188 0.116464 14 1814 0.65 94 10059 78.3023 78.4093 0.106961 4 1817 0.65 96 10100 78.3023 78.3798 0.0774599 12 1817 0.65 97 10213 78.3023 78.3781 0.0758121 4 1817 0.65 97 10214 78.3023 78.3781 0.0758121 5 1817 0.66 97 10250 78.3023 78.3781 0.0758121 8 1817 0.66 98 10309 78.3023 78.3624 0.0601264 4 1817 0.66 98 10350 78.3023 78.3624 0.0601264 12 1817 0.66 99 10429 78.3023 78.3548 0.0524753 4 1817 0.67 100 10450 78.3023 78.3535 0.0512377 5 1818 0.67 100 10500 78.3023 78.3535 0.0512377 11 1818 0.67 101 10583 78.3023 78.3527 0.0503851 4 1818 0.68 101 10600 78.3023 78.3527 0.0503851 10 1818 0.68 102 10679 78.3023 78.3445 0.0422225 4 1818 0.68 103 10700 78.3023 78.3432 0.0409203 14 1818 0.68 104 10801 78.3023 78.3395 0.0371664 4 1818 0.68 104 10802 78.3023 78.3395 0.0371664 5 1818 0.69 104 10850 78.3023 78.3395 0.0371664 9 1818 0.69 105 10907 78.3023 78.3358 0.0335543 4 1818 0.7 105 10950 78.3023 78.3358 0.0335543 14 1818 0.7 106 11035 78.3023 78.3339 0.0316074 4 1820 0.7 106 11050 78.3023 78.3339 0.0316074 8 1820 0.71 107 11127 78.3023 78.3316 0.0293092 4 1820 0.71 107 11150 78.3023 78.3316 0.0293092 5 1820 0.71 108 11217 78.3023 78.3291 0.0268402 4 1820 0.72 108 11250 78.3023 78.3291 0.0268402 4 1820 0.72 109 11300 78.3023 78.3203 0.0180055 5 1820 0.73 110 11350 78.3023 78.3199 0.0176405 11 1821 0.73 111 11441 78.3023 78.3187 0.0163741 4 1821 0.74 112 11457 78.3023 78.3185 0.016174 4 1821 0.75 112 11500 78.3023 78.3185 0.016174 14 1821 0.75 113 11573 78.3023 78.3163 0.0140419 4 1821 0.76 114 11600 78.3023 78.315 0.0127175 9 1821 0.76 115 11715 78.3023 78.3134 0.0110823 4 1821 0.76 115 11716 78.3023 78.3134 0.0110823 5 1821 0.76 116 11750 78.3023 78.3131 0.0108227 6 1821 0.77 117 11849 78.3023 78.3118 0.00955358 4 1821 0.77 117 11850 78.3023 78.3118 0.00955358 5 1821 0.77 117 11900 78.3023 78.3118 0.00955358 11 1824 0.78 118 11967 78.3023 78.3109 0.00861837 4 1824 0.78 118 12000 78.3023 78.3109 0.00861837 4 1824 0.79 119 12105 78.3023 78.3102 0.00793627 4 1827 0.79 119 12106 78.3023 78.3102 0.00793627 5 1827 0.79 119 12150 78.3023 78.3102 0.00793627 5 1827 0.79 120 12221 78.3023 78.3094 0.00708087 4 1827 0.79 120 12250 78.3023 78.3094 0.00708087 11 1827 0.8 121 12325 78.3023 78.3085 0.0062341 4 1827 0.8 121 12350 78.3023 78.3085 0.0062341 7 1827 0.8 122 12425 78.3023 78.3082 0.00586441 4 1827 0.81 122 12450 78.3023 78.3082 0.00586441 7 1827 0.81 123 12525 78.3023 78.3078 0.00548537 4 1827 0.81 123 12550 78.3023 78.3078 0.00548537 7 1827 0.82 124 12649 78.3023 78.3072 0.00487642 4 1845 0.82 124 12650 78.3023 78.3072 0.00487642 5 1845 0.82 125 12725 78.3023 78.3059 0.0035596 4 1845 0.82 126 12750 78.3023 78.3055 0.00324646 7 1845 0.83 127 12861 78.3023 78.305 0.00273337 4 1845 0.83 127 12862 78.3023 78.305 0.00273337 5 1845 0.84 127 12900 78.3023 78.305 0.00273337 10 1845 0.84 128 12993 78.3023 78.3047 0.00236197 4 1845 0.85 128 13000 78.3023 78.3047 0.00236197 11 1847 0.85 129 13065 78.3023 78.3046 0.0022747 4 1875 0.86 129 13100 78.3023 78.3046 0.0022747 6 1875 0.86 130 13203 78.3023 78.3043 0.00203219 4 1875 0.86 130 13204 78.3023 78.3043 0.00203219 5 1875 0.87 130 13250 78.3023 78.3043 0.00203219 7 1875 0.87 131 13329 78.3023 78.3041 0.0017869 4 1876 0.88 131 13350 78.3023 78.3041 0.0017869 14 1879 0.88 132 13441 78.3023 78.3039 0.00156965 4 1879 0.88 132 13450 78.3023 78.3039 0.00156965 13 1879 0.89 132 13500 78.3023 78.3039 0.00156965 8 1879 0.9 133 13563 78.3023 78.3037 0.00145284 4 1879 0.9 133 13600 78.3023 78.3037 0.00145284 8 1879 0.91 134 13677 78.3023 78.3036 0.00131472 4 1881 0.91 134 13700 78.3023 78.3036 0.00131472 5 1881 0.92 135 13773 78.3023 78.3035 0.00117078 4 1881 0.92 135 13800 78.3023 78.3035 0.00117078 9 1881 0.93 136 13867 78.3023 78.3031 0.000840962 4 1881 0.93 136 13867 78.3023 78.3031 0.000840962 4 1881 ------------------------------------------------------------------------------- SARSOP finishing ... target precision reached target precision : 0.001000 precision reached : 0.000841 ------------------------------------------------------------------------------- Time |#Trial |#Backup |LBound |UBound |Precision |#Alphas |#Beliefs ------------------------------------------------------------------------------- 0.93 136 13867 78.3023 78.3031 0.000840962 4 1881 ------------------------------------------------------------------------------- Writing out policy ... output file : policy.out results_c["SARSOP"] = 78.01856622427789 Test Summary: | Pass Total Time Issue #40 | 1 1 11.2s Testing SARSOP tests passed Testing completed after 88.37s PkgEval succeeded after 135.19s