Package evaluation of Recommendation on Julia 1.13.0-DEV.449 (8d6b63c3a6*) started at 2025-04-29T00:26:47.247 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.31s ################################################################################ # Installation # Installing Recommendation... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [d27d45ae] + Recommendation v1.0.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [d27d45ae] + Recommendation v1.0.0 [10745b16] + Statistics v1.11.1 ⌅ [a5390f91] + ZipFile v0.9.4 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b27032c2] + LibCURL v0.6.4 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.12.1+1 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2024.12.31 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.0.16+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.12.0+0 [8e850ede] + nghttp2_jll v1.65.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.01s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 15.51s ################################################################################ # Testing # Testing Recommendation Status `/tmp/jl_ikJTov/Project.toml` [d27d45ae] Recommendation v1.0.0 [10745b16] Statistics v1.11.1 ⌅ [a5390f91] ZipFile v0.9.4 [f43a241f] Downloads v1.7.0 [37e2e46d] LinearAlgebra v1.12.0 [9a3f8284] Random v1.11.0 [2f01184e] SparseArrays v1.12.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_ikJTov/Manifest.toml` [d27d45ae] Recommendation v1.0.0 [10745b16] Statistics v1.11.1 ⌅ [a5390f91] ZipFile v0.9.4 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.12.1+1 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2024.12.31 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.0.16+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.12.0+0 [8e850ede] nghttp2_jll v1.65.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... -- Testing onehot encoding of a single value -- Testing onehot encoding of a categorical vector -- Testing onehot encoding of a matrix -- Testing multi-label binarization -- Testing user-item-item triples generator -- Testing recommender not built case -- Testing recommender not implemented case -- Testing recommender execution -- Testing validation that compares recommnder's bundled data with another -- Testing a deprecated `build!` function to check compatibility -- Testing UserMean recommender -- Testing ItemMean recommender -- Testing MostPopular recommender -- Testing ThresholdPercentage recommender -- Testing CoOccurrence recommender -- Testing TF-IDF content-based recommender -- Testing UserKNN rating prediction -- Testing ItemKNN rating prediction -- Testing SVD-based recommender -- Testing MF-based (aliased) recommender -- Testing Matrix Factorization-based recommender -- Testing MF-based recommender with randomly initialized params WARNING: Method definition run(Type{T}, Any) where {T<:Recommendation.Recommender} in module Main at /home/pkgeval/.julia/packages/Recommendation/0M0Lw/test/model/test_matrix_factorization.jl:1 overwritten at /home/pkgeval/.julia/packages/Recommendation/0M0Lw/test/model/test_bpr_matrix_factorization.jl:1. -- Testing BPRMF-based (aliased) recommender -- Testing BPR Matrix Factorization-based recommender -- Testing BPR MF-based recommender with randomly initialized params -- Testing Factorization Machines-based recommender -- Testing Factorization Machines-based recommender with contextual user/item attributes Test Summary: | Pass Total Time recommender | 136 136 1m29.3s -- Testing accuracy metrics -- Testing ranking metrics -- Testing intra-list evaluation metrics -- Testing inter-list aggregated evaluation metrics -- Testing metrics type validation function -- Testing evaluate function for explicit feedback -- Testing evaluate function for implicit feedback -- Testing cross validation with accuracy metrics [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation -- Testing cross validation with ranking metrics [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation Test Summary: | Pass Total Time evaluation | 70 70 29.1s -- Testing data accessor [ Info: Splitting 3 samples for 2-fold cross validation [ Info: Splitting 3 samples for leave-one-out cross validation -- Testing to get a data home with a temp directory: /tmp/jl_epBq3F -- Testing unzip function with a dummy zip file: /tmp/jl_2golZJ/example.zip -- Testing libsvm file loader -- Testing synthetic implicit feedback generator Test Summary: | Pass Total Time data | 26 26 9.0s Testing Recommendation tests passed Testing completed after 148.84s PkgEval succeeded after 186.66s