Package evaluation of Setfield on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T07:48:22.007 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.66s ################################################################################ # Installation # Installing Setfield... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [efcf1570] + Setfield v1.1.2 Updating `~/.julia/environments/v1.11/Manifest.toml` [187b0558] + ConstructionBase v1.5.8 [1914dd2f] + MacroTools v0.5.15 [efcf1570] + Setfield v1.1.2 [1e83bf80] + StaticArraysCore v1.4.3 [9fa8497b] + Future v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 Installation completed after 2.11s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 14.98s ################################################################################ # Testing # Testing Setfield Status `/tmp/jl_bDb21d/Project.toml` [6e4b80f9] BenchmarkTools v1.6.0 [187b0558] ConstructionBase v1.5.8 [e30172f5] Documenter v1.10.1 [1914dd2f] MacroTools v0.5.15 [dc46b164] PerformanceTestTools v0.1.3 [ae2dfa86] QuickTypes v1.9.1 [efcf1570] Setfield v1.1.2 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [c5e4b96a] StaticNumbers v0.4.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_bDb21d/Manifest.toml` [a4c015fc] ANSIColoredPrinters v0.0.1 [1520ce14] AbstractTrees v0.4.5 [6e4b80f9] BenchmarkTools v1.6.0 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [187b0558] ConstructionBase v1.5.8 [ffbed154] DocStringExtensions v0.9.4 [e30172f5] Documenter v1.10.1 [d7ba0133] Git v1.3.1 [b5f81e59] IOCapture v0.2.5 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0e77f7df] LazilyInitializedFields v1.3.0 [1914dd2f] MacroTools v0.5.15 [d0879d2d] MarkdownAST v0.1.2 [69de0a69] Parsers v2.8.1 [dc46b164] PerformanceTestTools v0.1.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [ae2dfa86] QuickTypes v1.9.1 [2792f1a3] RegistryInstances v0.1.0 [efcf1570] Setfield v1.1.2 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [c5e4b96a] StaticNumbers v0.4.0 [10745b16] Statistics v1.11.1 [3bb67fe8] TranscodingStreams v0.11.3 [2e619515] Expat_jll v2.6.5+0 [f8c6e375] Git_jll v2.49.0+0 [94ce4f54] Libiconv_jll v1.18.0+0 [458c3c95] OpenSSL_jll v3.0.16+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [efcefdf7] PCRE2_jll v10.42.0+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time ==ₜ | 2 2 0.7s Test Summary: | Pass Total Time setindex | 16 16 6.0s WARNING: method definition for set at /home/pkgeval/.julia/packages/Setfield/ZezIj/examples/custom_macros.jl:23 declares type variable prop but does not use it. Test Summary: | Pass Total Time example custom_macros.jl | 6 6 0.7s Precompiling StaticArrays... 13664.3 ms ✓ StaticArrays 1 dependency successfully precompiled in 14 seconds. 7 already precompiled. Precompiling ConstructionBaseStaticArraysExt... 1313.8 ms ✓ ConstructionBase → ConstructionBaseStaticArraysExt 1 dependency successfully precompiled in 1 seconds. 10 already precompiled. Test Summary: | Pass Total Time setmacro, lensmacro isolation | 14 14 0.9s Test Summary: | Pass Total Time setmacro multiple usage | 1 1 0.5s Test Summary: | Pass Total Time get_update_op | 6 6 0.0s Test Summary: | Pass Total Time @set! | 6 6 0.2s Test Summary: | Pass Total Time @set | 24 24 1.1s Test Summary: | Pass Total Time show it like you build it | 16 16 13.5s Test Summary: | Pass Total Time lens laws | 40 40 4.2s Test Summary: | Pass Total Time equality & hashing | 37 37 2.3s Test Summary: | Total Time type stability | 0 1.2s Test Summary: | Pass Total Time IndexLens | 10 10 0.1s Test Summary: | Pass Total Time DynamicIndexLens | 16 16 0.7s Test Summary: | Pass Broken Total Time StaticNumbers | 8 1 9 0.5s Test Summary: | Pass Total Time IdentityLens | 4 4 0.0s Test Summary: | Pass Total Time type change during @set (default constructorof) | 1 1 0.0s Test Summary: | Pass Total Time type change during @set (custom constructorof) | 1 1 0.0s Test Summary: | Pass Total Time text/plain show | 8 8 0.7s Test Summary: | Pass Total Time Named Tuples | 5 5 0.1s Test Summary: | Pass Total Time setproperties overloading | 2 2 0.1s Test Summary: | Pass Total Time issue #83 | 1 1 0.1s Test Summary: | Pass Total Time @lens and ∘ | 8 8 0.1s Test Summary: | Pass Total Time @lens ∘ and $ | 6 6 0.2s Test Summary: | Pass Total Time first | 4 4 0.1s Test Summary: | Pass Total Time last | 4 4 0.1s Test Summary: | Pass Total Time eltype on Number | 2 2 0.0s Test Summary: | Pass Total Time eltype(::Type{<:Array}) | 1 1 0.0s Test Summary: | Pass Total Time eltype(::Array) | 2 2 0.3s Test Summary: | Pass Total Time (key|val|el)type(::Type{<:Dict}) | 5 5 0.1s Test Summary: | Pass Total Time (key|val|el)type(::Dict) | 3 3 1.5s Test Summary: | Pass Broken Total Time StaticArrays | 6 1 7 0.9s Precompiling QuickTypes... 3099.3 ms ✓ QuickTypes 1 dependency successfully precompiled in 3 seconds. 3 already precompiled. Test Summary: | Pass Total Time Wall | 1 1 0.0s Test Summary: | Pass Total Time Car | 4 4 0.1s Test Summary: | Pass Total Time Cat | 2 2 0.1s Test Summary: | Pass Total Time Pack | 1 1 0.1s Test Summary: | Pass Total Time Maple | 1 1 0.0s Test Summary: | Pass Total Time Window | 4 4 0.1s Test Summary: | Pass Total Time Human | 2 2 0.1s Test Summary: | Pass Total Time Group | 1 1 0.1s Test Summary: | Pass Total Time Plane1 | 2 2 0.1s WARNING: Method definition constructorof(Type{var"#s416"} where var"#s416"<:(TestSetfield.TestQuicktypes.Plane2{T1, T2, T3} where T3 where T2<:Number where T1)) in module TestQuicktypes at /home/pkgeval/.julia/packages/QuickTypes/98WSA/src/QuickTypes.jl:257 overwritten at /home/pkgeval/.julia/packages/Setfield/ZezIj/test/test_quicktypes.jl:132. Test Summary: | Pass Total Time Plane2 | 2 2 0.1s ┌ Info: Running IR test in a subprocess... │ cmd = `/opt/julia/bin/julia -C native -J/opt/julia/lib/julia/sys.so --depwarn=yes --check-bounds=yes --pkgimages=existing -g1 --startup-file=no --startup-file=no --check-bounds=no --code-coverage=none --inline=yes` └ script = "/home/pkgeval/.julia/packages/Setfield/ZezIj/test/perf.jl" Precompiling BenchmarkTools... 3298.7 ms ✓ Profile 672.8 ms ✓ UUIDs 881.0 ms ✓ Printf 714.9 ms ✓ Mmap 3905.3 ms ✓ Dates 1041.9 ms ✓ TOML 1466.8 ms ✓ Compat 1678.2 ms ✓ Preferences 992.5 ms ✓ Compat → CompatLinearAlgebraExt 1036.4 ms ✓ PrecompileTools 25823.2 ms ✓ Parsers 3901.6 ms ✓ JSON 2845.3 ms ✓ BenchmarkTools 13 dependencies successfully precompiled in 49 seconds. 3 already precompiled. Precompiling StaticArrays... 13095.8 ms ✓ StaticArrays 1 dependency successfully precompiled in 13 seconds. 7 already precompiled. Precompiling ConstructionBaseStaticArraysExt... 1285.5 ms ✓ ConstructionBase → ConstructionBaseStaticArraysExt 1 dependency successfully precompiled in 1 seconds. 10 already precompiled. Precompiling StaticArraysStatisticsExt... 1243.8 ms ✓ StaticArrays → StaticArraysStatisticsExt 1 dependency successfully precompiled in 1 seconds. 9 already precompiled. te_lens = TrialEstimate(40.000 ns) te_hand = TrialEstimate(39.000 ns) Test Summary: | Pass Total Time lens_set_a | 6 6 5.9s te_lens = TrialEstimate(40.000 ns) te_hand = TrialEstimate(40.000 ns) Test Summary: | Pass Total Time lens_set_a | 6 6 0.7s te_lens = TrialEstimate(40.000 ns) te_hand = TrialEstimate(40.000 ns) Test Summary: | Pass Total Time lens_set_ab | 6 6 0.9s te_lens = TrialEstimate(40.000 ns) te_hand = TrialEstimate(40.000 ns) Test Summary: | Pass Total Time lens_set_a_and_b | 6 6 0.9s te_lens = TrialEstimate(40.000 ns) te_hand = TrialEstimate(40.000 ns) Test Summary: | Pass Total Time lens_set_i | 6 6 1.1s Default associative composition: TrialEstimate(2.379 μs) Left associative composition: TrialEstimate(2.370 μs) Right associative composition: TrialEstimate(2.374 μs) Lens composition compiler prefered associativity: Test Failed at /home/pkgeval/.julia/packages/Setfield/ZezIj/test/perf.jl:146 Expression: b_left.time > 2 * b_default.time Evaluated: 2370.0 > 4757.555555555556 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/Setfield/ZezIj/test/perf.jl:146 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/Setfield/ZezIj/test/perf.jl:130 Test Summary: | Pass Fail Broken Total Time Lens composition compiler prefered associativity | 5 1 1 7 12.5s ERROR: LoadError: Some tests did not pass: 5 passed, 1 failed, 0 errored, 1 broken. in expression starting at /home/pkgeval/.julia/packages/Setfield/ZezIj/test/perf.jl:1 Test Failed at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/src/PerformanceTestTools.jl:34 Expression: success(pipeline(`$cmd -e $code`; stdout = stdout, stderr = stderr)) ERROR: LoadError: There was an error during testing in expression starting at /home/pkgeval/.julia/packages/Setfield/ZezIj/test/runtests.jl:1 Testing failed after 184.67s ERROR: LoadError: Package Setfield errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2124 [3] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2007 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 224.99s: package has test failures