Package evaluation to test InferOpt on Julia 1.10.10 (c8be17dcfd*) started at 2026-02-02T22:38:22.145 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.10` Set-up completed after 5.05s ################################################################################ # Installation # Installing InferOpt... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [4846b161] + InferOpt v0.7.1 Updating `~/.julia/environments/v1.10/Manifest.toml` [7d9f7c33] + Accessors v0.1.43 [66dad0bd] + AliasTables v1.1.3 [198e06fe] + BangBang v0.4.7 [d360d2e6] + ChainRulesCore v1.26.0 ⌅ [ae650224] + ChunkSplitters v2.6.0 [34da2185] + Compat v4.18.1 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.3 [b429d917] + DensityInterface v0.4.0 [fc55d66b] + DifferentiableExpectations v0.2.0 [31c24e10] + Distributions v0.25.123 [ffbed154] + DocStringExtensions v0.9.5 [1a297f60] + FillArrays v1.16.0 [34004b35] + HypergeometricFunctions v0.3.28 [4846b161] + InferOpt v0.7.1 [22cec73e] + InitialValues v0.3.1 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.6 [692b3bcd] + JLLWrappers v1.7.1 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 ⌅ [67456a42] + OhMyThreads v0.5.3 [bac558e1] + OrderedCollections v1.8.1 [90014a1f] + PDMats v0.11.37 [21216c6a] + Preferences v1.5.1 [43287f4e] + PtrArrays v1.3.0 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [97f35ef4] + RequiredInterfaces v0.1.7 [79098fc4] + Rmath v0.9.0 [a2af1166] + SortingAlgorithms v1.2.2 [276daf66] + SpecialFunctions v2.6.1 [91464d47] + StableTasks v0.1.7 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.10 [4c63d2b9] + StatsFuns v1.5.2 [ed4db957] + TaskLocalValues v0.1.3 [1c621080] + TestItems v1.0.0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [b77e0a4c] + InteractiveUtils [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [de0858da] + Printf [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [4536629a] + OpenBLAS_jll v0.3.23+5 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 9.2s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 26183.9 ms ✓ FrankWolfe 12353.8 ms ✓ ImplicitDifferentiation → ImplicitDifferentiationZygoteExt 9176.1 ms ✓ Flux → FluxFiniteDifferencesExt 17200.3 ms ✓ InferOpt 38520.7 ms ✓ DifferentiableFrankWolfe 104362.0 ms ✓ InferOpt → InferOptFrankWolfeExt 6 dependencies successfully precompiled in 218 seconds. 256 already precompiled. Precompilation completed after 222.71s ################################################################################ # Testing # Testing InferOpt Status `/tmp/jl_Sa3ao9/Project.toml` [4c88cf16] Aqua v0.8.14 [d360d2e6] ChainRulesCore v1.26.0 [b429d917] DensityInterface v0.4.0 [fc55d66b] DifferentiableExpectations v0.2.0 ⌅ [b383313e] DifferentiableFrankWolfe v0.4.1 [31c24e10] Distributions v0.25.123 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.16.1 [26cc04aa] FiniteDifferences v0.12.33 [587475ba] Flux v0.16.9 ⌅ [f55ce6ea] FrankWolfe v0.4.13 [86223c79] Graphs v1.13.4 [dd2b58c7] GridGraphs v0.11.0 [87dc4568] HiGHS v1.20.1 ⌅ [57b37032] ImplicitDifferentiation v0.7.2 [4846b161] InferOpt v0.7.1 ⌅ [c3a54625] JET v0.9.18 [4076af6c] JuMP v1.29.4 [98e50ef6] JuliaFormatter v2.2.1 [98b081ad] Literate v2.21.0 [92933f4c] ProgressMeter v1.11.0 [97f35ef4] RequiredInterfaces v0.1.7 ⌃ [295af30f] Revise v3.7.5 [2913bbd2] StatsBase v0.34.10 [4c63d2b9] StatsFuns v1.5.2 [f8b46487] TestItemRunner v1.1.4 [b8865327] UnicodePlots v3.8.1 [e88e6eb3] Zygote v0.7.10 [37e2e46d] LinearAlgebra [44cfe95a] Pkg v1.10.0 [9a3f8284] Random [10745b16] Statistics v1.10.0 [8dfed614] Test Status `/tmp/jl_Sa3ao9/Manifest.toml` [47edcb42] ADTypes v1.21.0 [a4c015fc] ANSIColoredPrinters v0.0.1 [621f4979] AbstractFFTs v1.5.0 [1520ce14] AbstractTrees v0.4.5 [7d9f7c33] Accessors v0.1.43 [79e6a3ab] Adapt v4.4.0 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 [dce04be8] ArgCheck v2.5.0 [ec485272] ArnoldiMethod v0.4.0 [7d9fca2a] Arpack v0.5.4 [a9b6321e] Atomix v1.1.2 [198e06fe] BangBang v0.4.7 [9718e550] Baselet v0.1.1 [6e4b80f9] BenchmarkTools v1.6.3 [082447d4] ChainRules v1.72.6 [d360d2e6] ChainRulesCore v1.26.0 ⌅ [ae650224] ChunkSplitters v2.6.0 ⌅ [da1fd8a2] CodeTracking v1.3.9 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [35d6a980] ColorSchemes v3.31.0 [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.1 ⌅ [a80b9123] CommonMark v0.9.1 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.18.1 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [6add18c4] ContextVariablesX v0.1.3 [d38c429a] Contour v0.6.3 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.3 [e2d170a0] DataValueInterfaces v1.0.0 [244e2a9f] DefineSingletons v0.1.2 [8bb1440f] DelimitedFiles v1.9.1 [b429d917] DensityInterface v0.4.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [fc55d66b] DifferentiableExpectations v0.2.0 ⌅ [b383313e] DifferentiableFrankWolfe v0.4.1 ⌅ [a0c0ee7d] DifferentiationInterface v0.6.54 [31c24e10] Distributions v0.25.123 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.16.1 [f151be2c] EnzymeCore v0.8.18 [e2ba6199] ExprTools v0.1.10 [cc61a311] FLoops v0.2.2 [b9860ae5] FLoopsBase v0.1.1 [9aa1b823] FastClosures v0.3.2 [1a297f60] FillArrays v1.16.0 [26cc04aa] FiniteDifferences v0.12.33 [53c48c17] FixedPointNumbers v0.8.5 [587475ba] Flux v0.16.9 [f6369f11] ForwardDiff v1.3.2 ⌅ [f55ce6ea] FrankWolfe v0.4.13 [d9f16b24] Functors v0.5.2 [46192b85] GPUArraysCore v0.2.0 [c145ed77] GenericSchur v0.5.6 [d7ba0133] Git v1.5.0 [c27321d9] Glob v1.4.0 [86223c79] Graphs v1.13.4 [dd2b58c7] GridGraphs v0.11.0 [076d061b] HashArrayMappedTries v0.2.0 [87dc4568] HiGHS v1.20.1 [e91730f6] Hungarian v0.7.0 [34004b35] HypergeometricFunctions v0.3.28 [b5f81e59] IOCapture v1.0.0 [7869d1d1] IRTools v0.4.15 ⌅ [57b37032] ImplicitDifferentiation v0.7.2 [4846b161] InferOpt v0.7.1 [d25df0c9] Inflate v0.1.5 [22cec73e] InitialValues v0.3.1 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.6 [82899510] IteratorInterfaceExtensions v1.0.0 ⌅ [c3a54625] JET v0.9.18 [692b3bcd] JLLWrappers v1.7.1 [682c06a0] JSON v1.4.0 [4076af6c] JuMP v1.29.4 [98e50ef6] JuliaFormatter v2.2.1 ⌅ [aa1ae85d] JuliaInterpreter v0.9.46 ⌅ [70703baa] JuliaSyntax v0.4.10 [b14d175d] JuliaVariables v0.2.4 [63c18a36] KernelAbstractions v0.9.39 ⌅ [ba0b0d4f] Krylov v0.9.10 [0e77f7df] LazilyInitializedFields v1.3.0 [5c8ed15e] LinearOperators v2.11.0 [98b081ad] Literate v2.21.0 [2ab3a3ac] LogExpFunctions v0.3.29 ⌃ [6f1432cf] LoweredCodeUtils v3.2.2 [c2834f40] MLCore v1.0.0 [7e8f7934] MLDataDevices v1.17.4 [d8e11817] MLStyle v0.4.17 [f1d291b0] MLUtils v0.4.8 [1914dd2f] MacroTools v0.5.16 [299715c1] MarchingCubes v0.1.11 [d0879d2d] MarkdownAST v0.1.2 [8c4f8055] MathOptIIS v0.1.1 [b8f27783] MathOptInterface v1.49.0 [128add7d] MicroCollections v0.2.0 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.7 [872c559c] NNlib v0.9.33 [77ba4419] NaNMath v1.1.3 [71a1bf82] NameResolution v0.1.5 ⌅ [67456a42] OhMyThreads v0.5.3 [0b1bfda6] OneHotArrays v0.2.10 [3bd65402] Optimisers v0.4.7 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.37 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.5.1 [8162dcfd] PrettyPrint v0.2.0 [33c8b6b6] ProgressLogging v0.1.6 [92933f4c] ProgressMeter v1.11.0 ⌅ [dc4f5ac2] ProximalCore v0.1.2 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [2792f1a3] RegistryInstances v0.1.0 [97f35ef4] RequiredInterfaces v0.1.7 [ae029012] Requires v1.3.1 ⌃ [295af30f] Revise v3.7.5 [708f8203] Richardson v1.4.2 [79098fc4] Rmath v0.9.0 [431bcebd] SciMLPublic v1.0.1 [7e506255] ScopedValues v1.5.0 [efcf1570] Setfield v1.1.2 [605ecd9f] ShowCases v0.1.0 [699a6c99] SimpleTraits v0.9.5 [a2af1166] SortingAlgorithms v1.2.2 [dc90abb0] SparseInverseSubset v0.1.2 [276daf66] SpecialFunctions v2.6.1 [171d559e] SplittablesBase v0.1.15 [91464d47] StableTasks v0.1.7 [90137ffa] StaticArrays v1.9.16 [1e83bf80] StaticArraysCore v1.4.4 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.10 [4c63d2b9] StatsFuns v1.5.2 [09ab397b] StructArrays v0.7.2 [ec057cc2] StructUtils v2.6.2 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [ed4db957] TaskLocalValues v0.1.3 [62fd8b95] TensorCore v0.1.1 [f8b46487] TestItemRunner v1.1.4 [1c621080] TestItems v1.0.0 [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [28d57a85] Transducers v0.4.85 [b8865327] UnicodePlots v3.8.1 [013be700] UnsafeAtomics v0.3.0 [e88e6eb3] Zygote v0.7.10 [700de1a5] ZygoteRules v0.2.7 ⌅ [68821587] Arpack_jll v3.5.2+0 [6e34b625] Bzip2_jll v1.0.9+0 [2e619515] Expat_jll v2.7.3+0 [020c3dae] Git_LFS_jll v3.7.0+0 [f8c6e375] Git_jll v2.52.0+0 [8fd58aa0] HiGHS_jll v1.12.0+0 [94ce4f54] Libiconv_jll v1.18.0+0 [d00139f3] METIS_jll v5.1.3+0 ⌅ [656ef2d0] OpenBLAS32_jll v0.3.24+0 [9bd350c2] OpenSSH_jll v10.2.1+0 [458c3c95] OpenSSL_jll v3.5.5+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [8ba89e20] Distributed [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [9fa8497b] Future [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [37e2e46d] LinearAlgebra [56ddb016] Logging [d6f4376e] Markdown [a63ad114] Mmap [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [9abbd945] Profile [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [2f01184e] SparseArrays v1.10.0 [10745b16] Statistics v1.10.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [14a3606d] MozillaCACerts_jll v2025.12.2 [4536629a] OpenBLAS_jll v0.3.23+5 [05823500] OpenLibm_jll v0.8.5+0 [efcefdf7] PCRE2_jll v10.42.0+1 [bea87d4a] SuiteSparse_jll v7.2.1+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Tutorial: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/tutorial.jl:2 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base.jl:31 [2] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/examples/tutorial.jl:42 [3] include(mod::Module, _path::String) @ Base ./Base.jl:495 [4] include(x::String) @ Main.var"##226" ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:89 [5] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/tutorial.jl:2 [6] eval @ ./boot.jl:385 [inlined] [7] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [8] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [9] #invokelatest#2 @ ./essentials.jl:892 [inlined] [10] invokelatest @ ./essentials.jl:889 [inlined] [11] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [12] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [13] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [14] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [15] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [16] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [17] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [18] include(fname::String) @ Base.MainInclude ./client.jl:487 [19] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/examples/tutorial.jl:42 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/tutorial.jl:2 ┌ Info: LinearMaximizer(max_pricing, g, h) │ g = g (generic function with 1 method) └ h = h (generic function with 1 method) [ Info: InferOpt.PerturbedOracle{InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}, InferOpt.LinearMaximizer{typeof(Main.var"##296".InferOptTestUtils.max_pricing), typeof(Main.var"##296".InferOptTestUtils.g), typeof(Main.var"##296".InferOptTestUtils.h)}, false, true, InferOpt.NormalAdditiveGradLogdensity, Random.TaskLocalRNG, Nothing}(DifferentiableExpectations.Reinforce{false, true, InferOpt.LinearMaximizer{typeof(Main.var"##296".InferOptTestUtils.max_pricing), typeof(Main.var"##296".InferOptTestUtils.g), typeof(Main.var"##296".InferOptTestUtils.h)}, InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}, InferOpt.NormalAdditiveGradLogdensity, Random.TaskLocalRNG, Nothing}(LinearMaximizer(max_pricing, g, h), InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}(Distributions.Normal{Float64}(μ=0.0, σ=1.0), 1.0), InferOpt.NormalAdditiveGradLogdensity(1.0), Random.TaskLocalRNG(), 10, nothing)) Paths - imit - SPO+ (θ): Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:2 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##913".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##913".InferOptTestUtils.var"#12#16"{typeof(Main.var"##913".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##913".InferOptTestUtils.dropfirstdim), typeof(Main.var"##913".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##913".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##913".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##913".InferOptTestUtils.PipelineLossImitationθ; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##913".InferOptTestUtils.identity_kw), loss::InferOpt.SPOPlusLoss{typeof(Main.var"##913".InferOptTestUtils.shortest_path_maximizer)}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##913".InferOptTestUtils.dropfirstdim), typeof(Main.var"##913".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##913".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:6 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:6 Paths - imit - SPO+ (θ & y): Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:17 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##920".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##920".InferOptTestUtils.var"#12#16"{typeof(Main.var"##920".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##920".InferOptTestUtils.dropfirstdim), typeof(Main.var"##920".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##920".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##920".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##920".InferOptTestUtils.PipelineLossImitationθy; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##920".InferOptTestUtils.identity_kw), loss::InferOpt.SPOPlusLoss{typeof(Main.var"##920".InferOptTestUtils.shortest_path_maximizer)}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##920".InferOptTestUtils.dropfirstdim), typeof(Main.var"##920".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##920".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:21 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:21 Paths - imit - MSE IdentityRelaxation: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:32 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##927".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##927".InferOptTestUtils.var"#12#16"{typeof(Main.var"##927".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##927".InferOptTestUtils.dropfirstdim), typeof(Main.var"##927".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##927".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##927".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##927".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::ComposedFunction{typeof(LinearAlgebra.normalize), InferOpt.IdentityRelaxation{typeof(Main.var"##927".InferOptTestUtils.shortest_path_maximizer)}}, loss::Function, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##927".InferOptTestUtils.dropfirstdim), typeof(Main.var"##927".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##927".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:36 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:36 Paths - imit - MSE PerturbedAdditive: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:62 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##934".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##934".InferOptTestUtils.var"#12#16"{typeof(Main.var"##934".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##934".InferOptTestUtils.dropfirstdim), typeof(Main.var"##934".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##934".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##934".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##934".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::InferOpt.PerturbedOracle{InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##934".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalAdditiveGradLogdensity, Random.TaskLocalRNG, Nothing}, loss::Function, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##934".InferOptTestUtils.dropfirstdim), typeof(Main.var"##934".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##934".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:66 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:66 Paths - imit - MSE PerturbedMultiplicative: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:77 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##941".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##941".InferOptTestUtils.var"#12#16"{typeof(Main.var"##941".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##941".InferOptTestUtils.dropfirstdim), typeof(Main.var"##941".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##941".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##941".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##941".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::InferOpt.PerturbedOracle{InferOpt.MultiplicativePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##941".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalMultiplicativeGradLogdensity, Random.TaskLocalRNG, Nothing}, loss::Function, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##941".InferOptTestUtils.dropfirstdim), typeof(Main.var"##941".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##941".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:81 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:81 Paths - imit - MSE RegularizedFrankWolfe: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:92 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##948".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##948".InferOptTestUtils.var"#12#16"{typeof(Main.var"##948".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##948".InferOptTestUtils.dropfirstdim), typeof(Main.var"##948".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##948".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##948".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##948".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::InferOpt.RegularizedFrankWolfe{typeof(Main.var"##948".InferOptTestUtils.shortest_path_maximizer), typeof(InferOpt.half_square_norm), typeof(Main.var"##948".InferOptTestUtils.identity_kw), @NamedTuple{max_iteration::Int64, line_search::FrankWolfe.Adaptive{Float64, Int64, FrankWolfe.var"#50#52"}}, @NamedTuple{linear_solver::ImplicitDifferentiation.KrylovLinearSolver}}, loss::Function, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##948".InferOptTestUtils.dropfirstdim), typeof(Main.var"##948".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##948".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:97 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:97 Paths - imit - FYL PerturbedAdditive: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:113 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##955".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##955".InferOptTestUtils.var"#12#16"{typeof(Main.var"##955".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##955".InferOptTestUtils.dropfirstdim), typeof(Main.var"##955".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##955".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##955".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##955".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##955".InferOptTestUtils.identity_kw), loss::InferOpt.FenchelYoungLoss{InferOpt.PerturbedOracle{InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##955".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalAdditiveGradLogdensity, Random.TaskLocalRNG, Nothing}}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##955".InferOptTestUtils.dropfirstdim), typeof(Main.var"##955".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##955".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:117 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:117 Paths - imit - FYL PerturbedMultiplicative: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:130 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##962".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##962".InferOptTestUtils.var"#12#16"{typeof(Main.var"##962".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##962".InferOptTestUtils.dropfirstdim), typeof(Main.var"##962".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##962".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##962".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##962".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##962".InferOptTestUtils.identity_kw), loss::InferOpt.FenchelYoungLoss{InferOpt.PerturbedOracle{InferOpt.MultiplicativePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##962".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalMultiplicativeGradLogdensity, Random.TaskLocalRNG, Nothing}}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##962".InferOptTestUtils.dropfirstdim), typeof(Main.var"##962".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##962".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:134 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:134 Paths - imit - FYL PerturbedAdditive{LogNormal}: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:148 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##969".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##969".InferOptTestUtils.var"#12#16"{typeof(Main.var"##969".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##969".InferOptTestUtils.dropfirstdim), typeof(Main.var"##969".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##969".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##969".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##969".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##969".InferOptTestUtils.identity_kw), loss::InferOpt.FenchelYoungLoss{InferOpt.PerturbedOracle{InferOpt.AdditivePerturbation{Distributions.LogNormal{Float64}}, typeof(Main.var"##969".InferOptTestUtils.shortest_path_maximizer), false, true, Nothing, Random.TaskLocalRNG, Nothing}}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##969".InferOptTestUtils.dropfirstdim), typeof(Main.var"##969".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##969".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:152 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:152 Paths - imit - FYL RegularizedFrankWolfe: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:170 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##976".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##976".InferOptTestUtils.var"#12#16"{typeof(Main.var"##976".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##976".InferOptTestUtils.dropfirstdim), typeof(Main.var"##976".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##976".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##976".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##976".InferOptTestUtils.PipelineLossImitation; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##976".InferOptTestUtils.identity_kw), loss::InferOpt.FenchelYoungLoss{InferOpt.RegularizedFrankWolfe{typeof(Main.var"##976".InferOptTestUtils.shortest_path_maximizer), typeof(InferOpt.half_square_norm), typeof(Main.var"##976".InferOptTestUtils.identity_kw), @NamedTuple{max_iteration::Int64, line_search::FrankWolfe.Adaptive{Float64, Int64, FrankWolfe.var"#50#52"}}, @NamedTuple{linear_solver::ImplicitDifferentiation.KrylovLinearSolver}}}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##976".InferOptTestUtils.dropfirstdim), typeof(Main.var"##976".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##976".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:175 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:175 Paths - exp - Pushforward PerturbedAdditive: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:194 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##983".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##983".InferOptTestUtils.var"#12#16"{typeof(Main.var"##983".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##983".InferOptTestUtils.dropfirstdim), typeof(Main.var"##983".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##983".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##983".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##983".InferOptTestUtils.PipelineLossExperience; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##983".InferOptTestUtils.identity_kw), loss::InferOpt.Pushforward{InferOpt.PerturbedOracle{InferOpt.AdditivePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##983".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalAdditiveGradLogdensity, Random.TaskLocalRNG, Nothing}, typeof(Main.var"##983".cost)}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##983".InferOptTestUtils.dropfirstdim), typeof(Main.var"##983".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##983".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:200 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:200 Paths - exp - Pushforward PerturbedMultiplicative: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:216 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##990".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##990".InferOptTestUtils.var"#12#16"{typeof(Main.var"##990".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##990".InferOptTestUtils.dropfirstdim), typeof(Main.var"##990".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##990".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##990".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##990".InferOptTestUtils.PipelineLossExperience; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##990".InferOptTestUtils.identity_kw), loss::InferOpt.Pushforward{InferOpt.PerturbedOracle{InferOpt.MultiplicativePerturbation{Distributions.Normal{Float64}}, typeof(Main.var"##990".InferOptTestUtils.shortest_path_maximizer), false, true, InferOpt.NormalMultiplicativeGradLogdensity, Random.TaskLocalRNG, Nothing}, typeof(Main.var"##990".cost)}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##990".InferOptTestUtils.dropfirstdim), typeof(Main.var"##990".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##990".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:222 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:222 Paths - exp - Pushforward RegularizedFrankWolfe: Error During Test at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:238 Got exception outside of a @test LoadError: UndefVarError: `QUEEN_DIRECTIONS_ACYCLIC` not defined Stacktrace: [1] getproperty @ ./Base.jl:31 [inlined] [2] shortest_path_maximizer(θ::Matrix{Float32}; kwargs::@Kwargs{instance::Array{Float32, 3}}) @ Main.var"##997".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:2 [3] shortest_path_maximizer @ ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/maximizers.jl:1 [inlined] [4] #12 @ ./none:0 [inlined] [5] iterate @ ./generator.jl:47 [inlined] [6] collect(itr::Base.Generator{Base.Iterators.Zip{Tuple{Vector{Array{Float32, 3}}, Vector{Matrix{Float32}}}}, Main.var"##997".InferOptTestUtils.var"#12#16"{typeof(Main.var"##997".InferOptTestUtils.shortest_path_maximizer)}}) @ Base ./array.jl:834 [7] generate_dataset(true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##997".InferOptTestUtils.dropfirstdim), typeof(Main.var"##997".InferOptTestUtils.make_positive)}}, true_maximizer::typeof(Main.var"##997".InferOptTestUtils.shortest_path_maximizer); instance_dim::Tuple{Int64, Int64}, nb_features::Int64, nb_instances::Int64, noise_std::Float64) @ Main.var"##997".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/dataset.jl:15 [8] test_pipeline!(pl::Main.var"##997".InferOptTestUtils.PipelineLossExperience; instance_dim::Tuple{Int64, Int64}, true_maximizer::Function, maximizer::typeof(Main.var"##997".InferOptTestUtils.identity_kw), loss::InferOpt.Pushforward{InferOpt.RegularizedFrankWolfe{typeof(Main.var"##997".InferOptTestUtils.shortest_path_maximizer), typeof(InferOpt.half_square_norm), typeof(Main.var"##997".InferOptTestUtils.identity_kw), @NamedTuple{max_iteration::Int64, line_search::FrankWolfe.Adaptive{Float64, Int64, FrankWolfe.var"#50#52"}}, @NamedTuple{linear_solver::ImplicitDifferentiation.KrylovLinearSolver}}, typeof(Main.var"##997".cost)}, error_function::Function, true_encoder::Flux.Chain{Tuple{Flux.Dense{typeof(identity), Matrix{Float32}, Vector{Float32}}, typeof(Main.var"##997".InferOptTestUtils.dropfirstdim), typeof(Main.var"##997".InferOptTestUtils.make_positive)}}, cost::Function, epochs::Int64, decrease::Float64, verbose::Bool) @ Main.var"##997".InferOptTestUtils ~/.julia/packages/InferOpt/qEzQ7/test/InferOptTestUtils/src/pipeline.jl:17 [9] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/paths.jl:250 [10] eval @ ./boot.jl:385 [inlined] [11] include_string(mapexpr::typeof(identity), mod::Module, code::String, filename::String) @ Base ./loading.jl:2149 [12] include_string(m::Module, txt::String, fname::String) @ Base ./loading.jl:2159 [13] #invokelatest#2 @ ./essentials.jl:892 [inlined] [14] invokelatest @ ./essentials.jl:889 [inlined] [15] #8 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:119 [inlined] [16] withpath(f::TestItemRunner.var"#8#12"{String, String, Module}, path::String) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/vendored_code.jl:7 [17] #7 @ ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:118 [inlined] [18] cd(f::TestItemRunner.var"#7#11"{String, String, Module}, dir::String) @ Base.Filesystem ./file.jl:112 [19] run_testitem(filepath::String, use_default_usings::Bool, setups::Vector{Symbol}, package_name::String, original_code::String, line::Int64, column::Int64, test_setup_module_set::TestItemRunner.TestSetupModuleSet, testsetups::Dict{Symbol, Any}) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:117 [20] run_tests(path::String; filter::Nothing, verbose::Bool) @ TestItemRunner ~/.julia/packages/TestItemRunner/ax5HJ/src/TestItemRunner.jl:230 [21] top-level scope @ ~/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 [22] include(fname::String) @ Base.MainInclude ./client.jl:487 [23] top-level scope @ none:6 in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/paths.jl:250 Test Summary: | Pass Error Broken Total Time Package | 951 14 1 966 27m48.3s test/tutorial.jl | 1 1 3m39.5s Tutorial | 1 1 3m39.5s test/abstract_regularized_interface.jl | 4 4 2.7s Test interfaces are correctly implemented | 4 4 2.7s test/soft_rank.jl | 504 504 4m43.0s Basic tests | 4 4 2m07.7s Isotonic l2 compare to HiGHS | 100 100 56.4s Test jacobian against finite differences | 400 400 1m38.9s test/code.jl | 12 12 3m55.8s Quality (Aqua.jl) | 10 10 39.8s Unbound type parameters | 1 1 0.3s Undefined exports | 1 1 0.0s Compare Project.toml and test/Project.toml | 1 1 0.0s Stale dependencies | 1 1 5.5s Compat bounds | 3 3 0.4s Piracy | 1 1 0.2s Persistent tasks | 1 1 17.9s Correctness (JET.jl) | 1 1 2m50.7s Formatting (JuliaFormatter.jl) | 1 1 25.2s test/learning_generalized_maximizer.jl | 67 67 2m33.8s Generalized maximizer basics | 3 3 2.5s Generalized maximizer - imit - MSE PerturbedAdditive | 7 7 45.9s Generalized maximizer - imit - MSE PerturbedMultiplicative | 7 7 13.9s Generalized maximizer - imit - FYL PerturbedAdditive | 7 7 16.6s Generalized maximizer - imit - FYL PerturbedMultiplicative | 7 7 14.1s Generalized maximizer - imit - SPO+ (θ) | 7 7 9.7s Generalized maximizer - imit - SPO+ (θ & y) | 7 7 8.6s Generalized maximizer - exp - Pushforward PerturbedAdditive | 7 7 15.4s Generalized maximizer - exp - Pushforward PerturbedMultiplicative | 7 7 13.8s Regularized with a GeneralizedMaximizer | 8 8 13.2s test/learning_ranking.jl | 156 156 6m35.8s imit - SPO+ (θ) | 7 7 9.0s imit - SPO+ (θ & y) | 7 7 6.6s imit - MSE IdentityRelaxation | 7 7 11.4s imit - MSE Interpolation | 7 7 9.3s imit - MSE PerturbedAdditive | 7 7 10.5s imit - MSE PerturbedMultiplicative | 7 7 8.9s imit - MSE RegularizedFrankWolfe | 7 7 1m07.5s imit - FYL PerturbedAdditive | 7 7 8.4s imit - FYL PerturbedMultiplicative | 7 7 8.5s imit - FYL PerturbedAdditive{LogNormal} | 7 7 7.9s imit - FYL RegularizedFrankWolfe | 7 7 8.7s exp - Pushforward PerturbedAdditive | 7 7 9.3s exp - Pushforward PerturbedMultiplicative | 7 7 9.0s exp - Pushforward PerturbedAdditive{LogNormal} | 7 7 1m01.5s exp - Pushforward PerturbedMultiplicative{LogNormal} | 7 7 1m06.4s exp - Pushforward PerturbedOracle{LogNormal} | 7 7 34.7s exp - Pushforward RegularizedFrankWolfe | 7 7 25.7s exp - soft rank | 23 23 23.3s imit - FYL - soft rank | 14 14 9.2s test/paths.jl | 13 13 43.8s Paths - imit - SPO+ (θ) | 1 1 5.9s Paths - imit - SPO+ (θ & y) | 1 1 3.1s Paths - imit - MSE IdentityRelaxation | 1 1 3.2s Paths - imit - MSE PerturbedAdditive | 1 1 3.2s Paths - imit - MSE PerturbedMultiplicative | 1 1 3.2s Paths - imit - MSE RegularizedFrankWolfe | 1 1 3.3s Paths - imit - FYL PerturbedAdditive | 1 1 3.2s Paths - imit - FYL PerturbedMultiplicative | 1 1 3.2s Paths - imit - FYL PerturbedAdditive{LogNormal} | 1 1 3.2s Paths - imit - FYL RegularizedFrankWolfe | 1 1 3.2s Paths - exp - Pushforward PerturbedAdditive | 1 1 3.0s Paths - exp - Pushforward PerturbedMultiplicative | 1 1 3.0s Paths - exp - Pushforward RegularizedFrankWolfe | 1 1 3.0s test/perturbed.jl | 16 1 17 1m10.5s Jacobian approx | 7 1 8 20.8s PerturbedAdditive | 4 4 12.1s PerturbedMultiplicative | 3 1 4 8.0s PerturbedOracle vs PerturbedAdditive | 2 2 14.9s Variance reduction | 2 2 11.2s Perturbed - small ε convergence | 4 4 23.1s Perturbed - Misc | 1 1 0.4s test/imitation_loss.jl | 80 80 50.7s ImitationLoss vs SSVM | 16 16 11.1s ImitationLoss vs FYL SparseMax | 16 16 9.7s ImitationLoss vs FYL SoftMax | 16 16 10.1s ImitationLoss vs SPO+ (α = 1) | 16 16 9.9s ImitationLoss vs SPO+ (α = 2) | 16 16 9.9s test/argmax.jl | 112 112 3m32.6s Argmax - imit - SPO+ (θ) | 7 7 8.5s Argmax - imit - SPO+ (θ & y) | 7 7 8.7s Argmax - imit - SSVM | 7 7 8.5s Argmax - imit - MSE SparseArgmax | 7 7 11.1s Argmax - imit - MSE SoftArgmax | 7 7 10.8s Argmax - imit - MSE PerturbedAdditive | 7 7 12.4s Argmax - imit - MSE PerturbedMultiplicative | 7 7 11.3s Argmax - imit - MSE RegularizedFrankWolfe | 7 7 38.2s Argmax - imit - FYL SparseArgmax | 7 7 8.9s Argmax - imit - FYL SoftArgmax | 7 7 9.2s Argmax - imit - FYL PerturbedAdditive | 7 7 11.1s Argmax - imit - FYL PerturbedMultiplicative | 7 7 10.8s Argmax - imit - FYL RegularizedFrankWolfe | 7 7 10.7s Argmax - exp - Pushforward PerturbedAdditive | 7 7 12.2s Argmax - exp - Pushforward PerturbedMultiplicative | 7 7 11.6s Argmax - exp - Pushforward RegularizedFrankWolfe | 7 7 28.5s ERROR: LoadError: Some tests did not pass: 951 passed, 0 failed, 14 errored, 1 broken. in expression starting at /home/pkgeval/.julia/packages/InferOpt/qEzQ7/test/runtests.jl:3 Testing failed after 1674.57s ERROR: LoadError: Package InferOpt errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 1955.16s: package tests unexpectedly errored