Package evaluation of ClimaReproducibilityTests on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T09:12:13.183


################################################################################
# Set-up
#

Installing PkgEval dependencies (TestEnv)...

Set-up completed after 8.88s


################################################################################
# Installation
#

Installing ClimaReproducibilityTests...
   Resolving package versions...
    Updating `~/.julia/environments/v1.11/Project.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
    Updating `~/.julia/environments/v1.11/Manifest.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] + Crayons v4.1.1
  [9a962f9c] + DataAPI v1.16.0
  [e2d170a0] + DataValueInterfaces v1.0.0
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [b964fa9f] + LaTeXStrings v1.4.0
  [bac558e1] + OrderedCollections v1.8.0
⌅ [aea7be01] + PrecompileTools v1.2.1
  [21216c6a] + Preferences v1.4.3
  [08abe8d2] + PrettyTables v2.4.0
  [189a3867] + Reexport v1.2.2
  [892a3eda] + StringManipulation v0.4.1
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.0
  [2a0f44e3] + Base64 v1.11.0
  [ade2ca70] + Dates v1.11.0
  [d6f4376e] + Markdown v1.11.0
  [de0858da] + Printf v1.11.0
  [fa267f1f] + TOML v1.0.3
  [4ec0a83e] + Unicode v1.11.0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`

Installation completed after 1.78s


################################################################################
# Precompilation
#

Precompiling PkgEval dependencies...

Precompiling package dependencies...

Precompilation completed after 13.49s


################################################################################
# Testing
#

     Testing ClimaReproducibilityTests
      Status `/tmp/jl_YZByOX/Project.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [bac558e1] OrderedCollections v1.8.0
  [08abe8d2] PrettyTables v2.4.0
  [8dfed614] Test v1.11.0
      Status `/tmp/jl_YZByOX/Manifest.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] Crayons v4.1.1
  [9a962f9c] DataAPI v1.16.0
  [e2d170a0] DataValueInterfaces v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [b964fa9f] LaTeXStrings v1.4.0
  [bac558e1] OrderedCollections v1.8.0
⌅ [aea7be01] PrecompileTools v1.2.1
  [21216c6a] Preferences v1.4.3
  [08abe8d2] PrettyTables v2.4.0
  [189a3867] Reexport v1.2.2
  [892a3eda] StringManipulation v0.4.1
  [3783bdb8] TableTraits v1.0.1
  [bd369af6] Tables v1.12.0
  [2a0f44e3] Base64 v1.11.0
  [ade2ca70] Dates v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [56ddb016] Logging v1.11.0
  [d6f4376e] Markdown v1.11.0
  [de0858da] Printf v1.11.0
  [9a3f8284] Random v1.11.0
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization v1.11.0
  [fa267f1f] TOML v1.0.3
  [8dfed614] Test v1.11.0
  [4ec0a83e] Unicode v1.11.0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading.
     Testing Running tests...
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │   0.422519 │   0.187021 │ 1.0927987932158564e+01 │
│        B │   0.609867 │   0.314095 │ 1.2092641958154932e+01 │
└──────────┴────────────┴────────────┴────────────────────────┘
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │        1.0 │        1.0 │ 0.0000000000000000e+00 │
│        B │        1.0 │        1.0 │ 0.0000000000000000e+00 │
└──────────┴────────────┴────────────┴────────────────────────┘
Test Summary: | Pass  Total  Time
compute_mse   |    4      4  9.9s
     Testing ClimaReproducibilityTests tests passed 

Testing completed after 20.09s

PkgEval succeeded after 50.42s