Package evaluation to test ClimaReproducibilityTests on Julia 1.14.0-DEV.1352 (749bc618c5*) started at 2025-12-09T20:05:06.214


################################################################################
# Set-up
#

Installing PkgEval dependencies (TestEnv)...
  Activating project at `~/.julia/environments/v1.14`

Set-up completed after 9.77s


################################################################################
# Installation
#

Installing ClimaReproducibilityTests...
   Resolving package versions...
    Updating `~/.julia/environments/v1.14/Project.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
    Updating `~/.julia/environments/v1.14/Manifest.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] + Crayons v4.1.1
  [9a962f9c] + DataAPI v1.16.0
  [e2d170a0] + DataValueInterfaces v1.0.0
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [b964fa9f] + LaTeXStrings v1.4.0
  [bac558e1] + OrderedCollections v1.8.1
  [aea7be01] + PrecompileTools v1.3.3
  [21216c6a] + Preferences v1.5.0
⌅ [08abe8d2] + PrettyTables v2.4.0
  [189a3867] + Reexport v1.2.2
  [892a3eda] + StringManipulation v0.4.2
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.1
  [2a0f44e3] + Base64 v1.11.0
  [ade2ca70] + Dates v1.11.0
  [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0
  [d6f4376e] + Markdown v1.11.0
  [de0858da] + Printf v1.11.0
  [f489334b] + StyledStrings v1.13.0
  [fa267f1f] + TOML v1.0.3
  [4ec0a83e] + Unicode v1.11.0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`

Installation completed after 1.19s


################################################################################
# Precompilation
#

ERROR: LoadError: MethodError: no method matching setindex!(::Base.ScopedValues.ScopedValue{IO}, ::Nothing)
The function `setindex!` exists, but no method is defined for this combination of argument types.
Stacktrace:
 [1] top-level scope
   @ /PkgEval.jl/scripts/precompile.jl:10
 [2] include(mod::Module, _path::String)
   @ Base ./Base.jl:309
 [3] exec_options(opts::Base.JLOptions)
   @ Base ./client.jl:344
 [4] _start()
   @ Base ./client.jl:577
in expression starting at /PkgEval.jl/scripts/precompile.jl:6

caused by: MethodError: no method matching setindex!(::Base.ScopedValues.ScopedValue{IO}, ::Base.DevNull)
The function `setindex!` exists, but no method is defined for this combination of argument types.
Stacktrace:
 [1] top-level scope
   @ /PkgEval.jl/scripts/precompile.jl:7
 [2] include(mod::Module, _path::String)
   @ Base ./Base.jl:309
 [3] exec_options(opts::Base.JLOptions)
   @ Base ./client.jl:344
 [4] _start()
   @ Base ./client.jl:577

Precompilation failed after 13.49s



################################################################################
# Testing
#

     Testing ClimaReproducibilityTests
      Status `/tmp/jl_e3r3Cw/Project.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [bac558e1] OrderedCollections v1.8.1
⌅ [08abe8d2] PrettyTables v2.4.0
  [8dfed614] Test v1.11.0
      Status `/tmp/jl_e3r3Cw/Manifest.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] Crayons v4.1.1
  [9a962f9c] DataAPI v1.16.0
  [e2d170a0] DataValueInterfaces v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [b964fa9f] LaTeXStrings v1.4.0
  [bac558e1] OrderedCollections v1.8.1
  [aea7be01] PrecompileTools v1.3.3
  [21216c6a] Preferences v1.5.0
⌅ [08abe8d2] PrettyTables v2.4.0
  [189a3867] Reexport v1.2.2
  [892a3eda] StringManipulation v0.4.2
  [3783bdb8] TableTraits v1.0.1
  [bd369af6] Tables v1.12.1
  [2a0f44e3] Base64 v1.11.0
  [ade2ca70] Dates v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0
  [56ddb016] Logging v1.11.0
  [d6f4376e] Markdown v1.11.0
  [de0858da] Printf v1.11.0
  [9a3f8284] Random v1.11.0
  [ea8e919c] SHA v1.0.0
  [9e88b42a] Serialization v1.11.0
  [f489334b] StyledStrings v1.13.0
  [fa267f1f] TOML v1.0.3
  [8dfed614] Test v1.11.0
  [4ec0a83e] Unicode v1.11.0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading.
     Testing Running tests...
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │    0.66123 │   0.437179 │ 9.6955843313324896e-01 │
│        B │   0.444358 │    0.53313 │ 1.0758875993508712e+00 │
└──────────┴────────────┴────────────┴────────────────────────┘
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │        1.0 │        1.0 │ 0.0000000000000000e+00 │
│        B │        1.0 │        1.0 │ 0.0000000000000000e+00 │
└──────────┴────────────┴────────────┴────────────────────────┘
Test Summary: | Pass  Total  Time
compute_mse   |    4      4  9.2s
     Testing ClimaReproducibilityTests tests passed 

Testing completed after 47.5s

PkgEval succeeded after 81.95s