Package evaluation of ConcurrentSim on Julia 1.13.0-DEV.1055 (100ef9d641*) started at 2025-08-28T12:00:16.511 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.95s ################################################################################ # Installation # Installing ConcurrentSim... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [6ed1e86c] + ConcurrentSim v1.5.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [34da2185] + Compat v4.18.0 [6ed1e86c] + ConcurrentSim v1.5.0 ⌅ [864edb3b] + DataStructures v0.18.22 [1914dd2f] + MacroTools v0.5.16 [bac558e1] + OrderedCollections v1.8.1 [c5292f4c] + ResumableFunctions v1.0.4 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.11s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 29.37s ################################################################################ # Testing # Testing ConcurrentSim Status `/tmp/jl_5519r0/Project.toml` [4c88cf16] Aqua v0.8.14 [6ed1e86c] ConcurrentSim v1.5.0 [31c24e10] Distributions v0.25.120 [e30172f5] Documenter v1.14.1 [c3a54625] JET v0.10.6 [c5292f4c] ResumableFunctions v1.0.4 [1bc83da4] SafeTestsets v0.1.0 [860ef19b] StableRNGs v1.0.3 [ade2ca70] Dates v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_5519r0/Manifest.toml` [a4c015fc] ANSIColoredPrinters v0.0.1 [1520ce14] AbstractTrees v0.4.5 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 ⌅ [da1fd8a2] CodeTracking v1.3.9 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.0 [807dbc54] Compiler v0.1.1 [6ed1e86c] ConcurrentSim v1.5.0 [9a962f9c] DataAPI v1.16.0 ⌅ [864edb3b] DataStructures v0.18.22 [31c24e10] Distributions v0.25.120 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.14.1 [1a297f60] FillArrays v1.13.0 [d7ba0133] Git v1.5.0 [34004b35] HypergeometricFunctions v0.3.28 [b5f81e59] IOCapture v0.2.5 [92d709cd] IrrationalConstants v0.2.4 [c3a54625] JET v0.10.6 [692b3bcd] JLLWrappers v1.7.1 [682c06a0] JSON v0.21.4 ⌃ [aa1ae85d] JuliaInterpreter v0.10.3 [70703baa] JuliaSyntax v1.0.2 [0e77f7df] LazilyInitializedFields v1.3.0 [2ab3a3ac] LogExpFunctions v0.3.29 ⌃ [6f1432cf] LoweredCodeUtils v3.4.2 [1914dd2f] MacroTools v0.5.16 [d0879d2d] MarkdownAST v0.1.2 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.35 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.5.0 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [2792f1a3] RegistryInstances v0.1.0 [c5292f4c] ResumableFunctions v1.0.4 [79098fc4] Rmath v0.8.0 [1bc83da4] SafeTestsets v0.1.0 [a2af1166] SortingAlgorithms v1.2.2 [276daf66] SpecialFunctions v2.5.1 [860ef19b] StableRNGs v1.0.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.6 [4c63d2b9] StatsFuns v1.5.0 [3bb67fe8] TranscodingStreams v0.11.3 [2e619515] Expat_jll v2.7.1+0 [020c3dae] Git_LFS_jll v3.7.0+0 [f8c6e375] Git_jll v2.51.0+0 [94ce4f54] Libiconv_jll v1.18.0+0 [9bd350c2] OpenSSH_jll v10.0.1+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.8.12 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.2+0 [efcefdf7] PCRE2_jll v10.46.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.66.0+0 [3f19e933] p7zip_jll v17.6.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Starting tests with 1 threads out of `Sys.CPU_THREADS = 1`... ConcurrentSim.Event idle nothing scheduled Hi I am a callback function running in ConcurrentSim.Simulation ConcurrentSim.EventProcessed(ConcurrentSim.Event 1) has been thrown! processed Hi Test Summary: | Total Time base | 0 4.2s ConcurrentSim.EventNotIdle(ConcurrentSim.Event 2) has been thrown! Hi ConcurrentSim.Event 1 has value Success Hi ConcurrentSim.Event 2 has value Main.var"##events#140".TestException() Hi ConcurrentSim.Timeout 3 timed out at 1.0 Test Summary: | Total Time events | 0 0.5s One of both events is triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Event 2 => ConcurrentSim.StateValue(ConcurrentSim.idle, nothing)) Both events are triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Event 2 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing)) One of both events is triggered: Main.var"##operators#141".TestException() Both events are triggered: Main.var"##operators#141".TestException() One of both events is triggered: Main.var"##operators#141".TestException() One of both events is triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Timeout 2 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing)) One of both events is triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Event 2 => ConcurrentSim.StateValue(ConcurrentSim.idle, nothing), ConcurrentSim.Timeout 3 => ConcurrentSim.StateValue(ConcurrentSim.scheduled, nothing)) Both events are triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Event 2 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Timeout 3 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing)) One of both events is triggered: Main.var"##operators#141".TestException() Both events are triggered: Main.var"##operators#141".TestException() One of both events is triggered: Main.var"##operators#141".TestException() One of both events is triggered: Dict{ConcurrentSim.AbstractEvent, ConcurrentSim.StateValue}(ConcurrentSim.Timeout 1 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Timeout 3 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing), ConcurrentSim.Timeout 2 => ConcurrentSim.StateValue(ConcurrentSim.processed, nothing)) Test Summary: | Total Time operators | 0 2.4s Hi I timed out at 1.0 ConcurrentSim.EmptySchedule() has been thrown! Hi I timed out at 4.0 2.0 Main.var"##simulations#142".TestException() has been thrown after 0.0! Test Summary: | Total Time simulations | 0 0.5s ConcurrentSim.Simulation time: 0.0 active_process: nothing 0 1 1 2 3 5 8 13 21 34 Main.var"##processes#143".TestException() has been thrown Main.var"##processes#143".TestException() has been thrown ConcurrentSim.Process 1 interrupted Main.var"##processes#143".TestException() has been thrown Test Summary: | Total Time processes | 0 28.7s ConcurrentSim.Resource 0.0, client 1 is waiting 0.0, client 1 is being served 0.22505379983418844, client 2 is waiting 0.5079842826073115, client 3 is waiting 0.7426617383989047, client 4 is waiting 0.7455788527668805, client 1 has been served 0.7455788527668805, client 4 is being served 0.7526057878698558, client 5 is waiting 0.9549382106018027, client 4 has been served 0.9549382106018027, client 5 is being served 1.1455937277650463, client 6 is waiting 1.1518527810126034, client 5 has been served 1.1518527810126034, client 6 is being served 1.2447154244679743, client 7 is waiting 1.5550497111512018, client 8 is waiting 1.8610793908560423, client 6 has been served 1.8610793908560423, client 8 is being served 1.878348465182457, client 9 is waiting 1.8895743588570528, client 10 is waiting 2.5585848758503213, client 8 has been served 2.5585848758503213, client 10 is being served 3.120594570820119, client 10 has been served 3.120594570820119, client 9 is being served 3.3422877862960885, client 9 has been served 3.3422877862960885, client 7 is being served 4.071618271830284, client 7 has been served 4.071618271830284, client 3 is being served 4.59805950299995, client 3 has been served 4.59805950299995, client 2 is being served 5.5327108547519455, client 2 has been served WARNING: Method definition generate(ConcurrentSim.Simulation, ConcurrentSim.Container{Int64, Int64}) in module ##resources_containers#173 at /home/pkgeval/.julia/packages/ResumableFunctions/cprlE/src/macro.jl:172 overwritten on the same line (check for duplicate calls to `include`). ConcurrentSim.Resource 0.0, client 1 attempting to lock 0.0, client 1 is being served 0.3037494656894633, client 2 attempting to lock 0.3037494656894633, client 2 is being served 0.4908592387274455, client 1 has been served 0.5779049533573817, client 3 attempting to lock 0.5779049533573817, client 3 is being served 0.8212896574968767, client 2 has been served 1.0095218948352678, client 4 attempting to lock 1.0095218948352678, client 4 is being served 1.0899835513093392, client 3 has been served 1.4310230126485286, client 5 attempting to lock 1.4310230126485286, client 5 is being served 1.7789155106989665, client 4 has been served 1.8474180263336764, client 6 attempting to lock 1.8474180263336764, client 6 is being served 2.213036519754676, client 5 has been served 2.247407074292063, client 7 attempting to lock 2.247407074292063, client 7 is being served 2.504733103099457, client 7 has been served 2.696256139341369, client 8 attempting to lock 2.696256139341369, client 8 is being served 2.7766991247014943, client 6 has been served 2.8595884881487907, client 9 attempting to lock 2.8595884881487907, client 9 is being served 2.8937501833365964, client 10 attempting to lock 2.8937501833365964, client 10 is going elsewhere for a bit instead of waiting 2.9937501833365965, client 10 attempting to lock 2.9937501833365965, client 10 is going elsewhere for a bit instead of waiting 3.0937501833365966, client 10 attempting to lock 3.0937501833365966, client 10 is going elsewhere for a bit instead of waiting 3.1937501833365967, client 10 attempting to lock 3.1937501833365967, client 10 is going elsewhere for a bit instead of waiting 3.2386136133180212, client 8 has been served 3.2937501833365967, client 10 attempting to lock 3.2937501833365967, client 10 is being served 3.3212893034338102, client 9 has been served 3.586045634415221, client 10 has been served 0.0, consumer is demanding 0.9412820601596513 0.0, producer is offering 0.2928388467348024 0.27240206067494377, producer is being served, level is 5.292838846734803 0.3364037127999052, producer is offering 1.5536827913305535 0.8700210956865339, producer is being served, level is 6.846521638065356 0.8877566575806793, consumer is being served, level is 5.9052395779057045 2.737134193060681, producer is offering 1.3444867159289517 3.5878217563884642, producer is being served, level is 7.249726293834656 5.2086616051633055, consumer is demanding 2.1212513932778494 5.792904819680793, consumer is being served, level is 5.128474900556807 5.892561955024231, consumer is demanding 0.4651745588634729 6.675011930068184, consumer is being served, level is 4.663300341693334 7.226418836129634, producer is offering 0.3514365816152767 7.686469138423973, producer is being served, level is 5.01473692330861 7.7203674253206716, consumer is demanding 0.13737440843191584 8.565430646826227, consumer is being served, level is 4.877362514876694 11.864752050639243, producer is offering 0.3234421405187349 11.929364802184892, producer is being served, level is 5.200804655395428 12.647914777360214, consumer is demanding 1.4386523656207884 13.519887235474567, consumer is being served, level is 3.7621522897746402 15.771936775846553, producer is offering 1.096005433267911 16.245830464813363, producer is being served, level is 4.8581577230425514 16.372429292442387, consumer is demanding 0.6738839760726577 16.564707162939996, consumer is being served, level is 4.184273746969894 18.54860234665236, consumer is demanding 0.7391652920949169 18.67714879214283, consumer is being served, level is 3.445108454874977 19.25697342222675, producer is offering 1.7130297628193996 19.338616712790706, producer is being served, level is 5.158138217694376 22.562241153223695, producer is offering 0.5805860745037201 23.179296931608086, producer is being served, level is 5.738724292198096 23.445867388790866, consumer is demanding 0.6288740331932748 24.445449143546416, consumer is being served, level is 5.109850259004822 25.940155765246416, producer is offering 1.5518398916983143 25.967848798617688, consumer is demanding 1.5097667106559594 26.552906344562917, consumer is being served, level is 3.6000835483488625 26.721329572455257, producer is being served, level is 5.1519234400471765 28.878741235490267, producer is offering 0.6093490207466772 29.730756637843303, producer is being served, level is 5.761272460793854 30.090737784102767, consumer is demanding 0.6948519397179227 30.156009060759104, consumer is being served, level is 5.066420521075931 Test Summary: | Pass Total Time resources_containers | 2 2 9.6s ConcurrentSim.Resource 0.0, client 1 is waiting 0.0, client 1 is being served 0.22505379983418844, client 2 is waiting 0.5079842826073115, client 3 is waiting 0.7426617383989047, client 4 is waiting 0.7455788527668805, client 1 has been served 0.7455788527668805, client 4 is being served 0.7526057878698558, client 5 is waiting 0.9549382106018027, client 4 has been served 0.9549382106018027, client 5 is being served 1.1455937277650463, client 6 is waiting 1.1518527810126034, client 5 has been served 1.1518527810126034, client 6 is being served 1.2447154244679743, client 7 is waiting 1.5550497111512018, client 8 is waiting 1.8610793908560423, client 6 has been served 1.8610793908560423, client 8 is being served 1.878348465182457, client 9 is waiting 1.8895743588570528, client 10 is waiting 2.5585848758503213, client 8 has been served 2.5585848758503213, client 10 is being served 3.120594570820119, client 10 has been served 3.120594570820119, client 9 is being served 3.3422877862960885, client 9 has been served 3.3422877862960885, client 7 is being served 4.071618271830284, client 7 has been served 4.071618271830284, client 3 is being served 4.59805950299995, client 3 has been served 4.59805950299995, client 2 is being served 5.5327108547519455, client 2 has been served 0.0, consumer is demanding 1.82249679413678 0.0, producer is offering 1.0966219506716732 0.4908592387274455, consumer is being served, level is 3.17750320586322 ┌ Warning: `put(args...; kwargs...)` is deprecated, use `put!(args...; kwargs...)` instead. │ caller = macro expansion at transforms.jl:250 [inlined] └ @ Core ~/.julia/packages/ResumableFunctions/cprlE/src/transforms.jl:250 0.5175401918074133, producer is being served, level is 4.274125156534893 3.0512522284872334, consumer is demanding 2.308180847591096 3.884042255857529, consumer is being served, level is 1.9659443089437971 4.732551369940021, producer is offering 1.8585621967356354 5.630249500038633, producer is being served, level is 3.8245065056794325 6.9168796440756015, producer is offering 0.6533293952296868 7.459237118052254, producer is being served, level is 4.4778359009091195 7.80085406993031, producer is offering 0.923401630570039 7.883932735441396, consumer is demanding 0.8768863532358733 8.19769342216128, consumer is being served, level is 3.6009495476732463 8.34872227577245, producer is being served, level is 4.524351178243285 8.929790538998285, consumer is demanding 0.03840099127497687 9.706631934663562, consumer is being served, level is 4.485950186968308 9.71073257914717, producer is offering 1.9374204857453887 10.574913568663694, producer is being served, level is 6.4233706727136965 11.57374503203771, consumer is demanding 2.5520626899833503 12.301464447985945, consumer is being served, level is 3.8713079827303463 13.936130358486073, producer is offering 0.33031116136744876 13.95606178555476, producer is being served, level is 4.201619144097795 14.731352716993882, producer is offering 1.5648999500879055 15.098578493486624, producer is being served, level is 5.766519094185701 15.22268052057338, consumer is demanding 0.527154872422915 15.68273082286772, consumer is being served, level is 5.239364221762786 15.911688170254246, consumer is demanding 2.5351896645166674 15.945236250537349, consumer is being served, level is 2.7041745572461187 16.14393398873911, producer is offering 0.12922550309129788 16.753841601834186, consumer is demanding 1.4386523656207884 16.912448383471443, producer is being served, level is 2.8334000603374165 17.532576642150786, producer is offering 1.1410168227871282 17.62581405994854, consumer is being served, level is 1.3947476947166282 18.080579358784743, producer is being served, level is 2.5357645175037566 19.20371931890584, producer is offering 0.38455574099522116 20.018478811536742, producer is being served, level is 2.920320258498978 20.636957017361922, consumer is demanding 0.7391652920949169 20.765503462852394, consumer is being served, level is 2.181154966404061 25.53422205950043, consumer is demanding 2.5695446442290995 26.260590238150982, consumer has timed out Test Summary: | Total Time resources_containers_deprecated | 0 3.4s 0.0, producer is offering object 1 0.0, producer is being served 0.4501075996683769, consumer is demanding object 0.4501075996683769, consumer is being served with object 1 1.015968565214623, consumer is demanding object 1.491157705533761, producer is offering object 2 1.491157705533761, producer is being served 1.491157705533761, consumer is being served with object 2 1.5110458044756632, consumer is demanding object 2.429867528700134, producer is offering object 3 2.429867528700134, producer is being served 2.429867528700134, consumer is being served with object 3 2.8485862443699785, producer is offering object 4 2.8485862443699785, producer is being served 3.2158434084905156, consumer is demanding object 3.2158434084905156, consumer is being served with object 4 3.2424153851915802, producer is offering object 5 3.2424153851915802, producer is being served 3.4140868018963717, consumer is demanding object 3.4140868018963717, consumer is being served with object 5 4.034755375262827, consumer is demanding object 4.660868604878458, producer is offering object 6 4.660868604878458, producer is being served 4.660868604878458, consumer is being served with object 6 5.358374089872737, consumer is demanding object 5.9540636210034785, producer is offering object 7 5.9540636210034785, producer is being served 5.9540636210034785, consumer is being served with object 7 5.998967195701862, producer is offering object 8 5.998967195701862, producer is being served 6.030084101882955, consumer is demanding object 6.030084101882955, consumer is being served with object 8 6.251777317358925, consumer is demanding object 7.122986585641457, producer is offering object 9 7.122986585641457, producer is being served 7.122986585641457, consumer is being served with object 9 7.649427816811124, consumer is demanding object 8.581647556709846, producer is offering object 10 8.581647556709846, producer is being served 8.581647556709846, consumer is being served with object 10 Test Summary: | Pass Total Time resources_stores | 5 5 4.4s [ Info: putting 1 at time 0.0 [ Info: putting 2 at time 2.0 [ Info: putting 3 at time 4.0 [ Info: putting 4 at time 6.0 [ Info: taking 1.0 at time 10.0 [ Info: taking 2.0 at time 12.0 [ Info: taking 3.0 at time 14.0 [ Info: taking 4.0 at time 16.0 [ Info: putting 1 at time 0.0 [ Info: putting 2 at time 2.0 [ Info: putting 3 at time 4.0 [ Info: taking 1.0 at time 5.0 [ Info: taking 2.0 at time 5.0 [ Info: taking 3.0 at time 5.0 [ Info: putting 4 at time 6.0 [ Info: taking 4.0 at time 6.0 [ Info: putting 1 at time 0.0 [ Info: putting 2 at time 2.0 [ Info: putting 3 at time 4.0 [ Info: taking 3.0 at time 5.0 [ Info: taking 2.0 at time 5.0 [ Info: taking 1.0 at time 5.0 [ Info: putting 4 at time 6.0 [ Info: taking 4.0 at time 6.0 [ Info: putting 1 at time 0.0 Test Summary: | Pass Total Time resources_stores_cast | 13 13 10.3s 0.0, producer is offering object 1 0.0, producer is being served 0.4501075996683769, consumer is demanding object 0.4501075996683769, consumer is being served with object 1 1.015968565214623, consumer is demanding object 1.491157705533761, producer is offering object 2 1.491157705533761, producer is being served 1.491157705533761, consumer is being served with object 2 1.5110458044756632, consumer is demanding object 2.429867528700134, producer is offering object 3 2.429867528700134, producer is being served 2.429867528700134, consumer is being served with object 3 2.8485862443699785, producer is offering object 4 2.8485862443699785, producer is being served 3.2158434084905156, consumer is demanding object 3.2158434084905156, consumer is being served with object 4 3.2424153851915802, producer is offering object 5 3.2424153851915802, producer is being served 3.4140868018963717, consumer is demanding object 3.4140868018963717, consumer is being served with object 5 4.034755375262827, consumer is demanding object 4.660868604878458, producer is offering object 6 4.660868604878458, producer is being served 4.660868604878458, consumer is being served with object 6 5.358374089872737, consumer is demanding object 5.9540636210034785, producer is offering object 7 5.9540636210034785, producer is being served 5.9540636210034785, consumer is being served with object 7 5.998967195701862, producer is offering object 8 5.998967195701862, producer is being served 6.030084101882955, consumer is demanding object 6.030084101882955, consumer is being served with object 8 6.251777317358925, consumer is demanding object 7.122986585641457, producer is offering object 9 7.122986585641457, producer is being served 7.122986585641457, consumer is being served with object 9 7.649427816811124, consumer is demanding object 8.581647556709846, producer is offering object 10 8.581647556709846, producer is being served 8.581647556709846, consumer is being served with object 10 Test Summary: | Total Time resources_stores_deprecated | 0 2.9s [ Info: putting a at time 0.0 [ Info: putting b at time 2.0 [ Info: putting a at time 4.0 [ Info: putting c at time 6.0 [ Info: taking a at time 10.0 [ Info: taking b at time 12.0 [ Info: taking a at time 14.0 [ Info: taking c at time 16.0 [ Info: putting a at time 0.0 [ Info: putting b at time 2.0 [ Info: putting a at time 4.0 [ Info: taking a at time 5.0 [ Info: taking b at time 5.0 [ Info: taking a at time 5.0 [ Info: putting c at time 6.0 [ Info: taking c at time 6.0 [ Info: putting a at time 0.0 [ Info: putting b at time 2.0 [ Info: putting a at time 4.0 [ Info: taking a at time 5.0 [ Info: taking a at time 5.0 [ Info: taking b at time 5.0 [ Info: putting c at time 6.0 [ Info: taking c at time 6.0 Test Summary: | Total Time resources_fancy_stores | 0 4.5s keys(con.put_queue) = ConcurrentSim.Put[ConcurrentSim.Put 9, ConcurrentSim.Put 8, ConcurrentSim.Put 7, ConcurrentSim.Put 6, ConcurrentSim.Put 5, ConcurrentSim.Put 4, ConcurrentSim.Put 3, ConcurrentSim.Put 2, ConcurrentSim.Put 1] keys(con.put_queue) = ConcurrentSim.Put[ConcurrentSim.Put 9, ConcurrentSim.Put 8, ConcurrentSim.Put 7, ConcurrentSim.Put 5, ConcurrentSim.Put 6, ConcurrentSim.Put 4, ConcurrentSim.Put 2, ConcurrentSim.Put 3, ConcurrentSim.Put 1] sto.items = Dict{Symbol, UInt64}(:a => 0x0000000000000005) keys(sto.put_queue) = ConcurrentSim.Put[ConcurrentSim.Put 9, ConcurrentSim.Put 8, ConcurrentSim.Put 7, ConcurrentSim.Put 6] sto.items = Dict{Symbol, UInt64}(:a => 0x0000000000000005) keys(sto.put_queue) = ConcurrentSim.Put[ConcurrentSim.Put 9, ConcurrentSim.Put 8, ConcurrentSim.Put 7, ConcurrentSim.Put 6] Test Summary: | Broken Total Time resource_priorities | 1 1 10.0s 2025-08-28T12:02:32.286 2025-08-30T12:02:32.286 2025-11-28T12:02:32.286 Test Summary: | Total Time utils_time | 0 0.9s ┌ Warning: Unable to determine HTML(edit_link = ...) from remote HEAD branch, defaulting to "master". │ Calling `git remote` failed with an exception. Set JULIA_DEBUG=Documenter to see the error. │ Unless this is due to a configuration error, the relevant variable should be set explicitly. └ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/utilities/utilities.jl:665 [ Info: SetupBuildDirectory: setting up build directory. [ Info: Doctest: running doctests. ┌ Error: doctest failure in ../docs/src/examples/mmc.md:9-81 │ │ ```jldoctest │ using StableRNGs │ using Distributions │ using ConcurrentSim │ using ResumableFunctions │ │ #set simulation parameters │ rng = StableRNG(123) │ num_customers = 10 # total number of customers generated │ │ # set queue parameters │ num_servers = 2 # number of servers │ mu = 1.0 / 2 # service rate │ lam = 0.9 # arrival rate │ arrival_dist = Exponential(1 / lam) # interarrival time distribution │ service_dist = Exponential(1 / mu) # service time distribution │ │ # define customer behavior │ @resumable function customer(env::Environment, server::Resource, id::Integer, t_a::Float64, d_s::Distribution) │ @yield timeout(env, t_a) # customer arrives │ println("Customer $id arrived: ", now(env)) │ @yield request(server) # customer starts service │ println("Customer $id entered service: ", now(env)) │ @yield timeout(env, rand(rng,d_s)) # server is busy │ @yield unlock(server) # customer exits service │ println("Customer $id exited service: ", now(env)) │ end │ │ # setup and run simulation │ function setup_and_run() │ sim = Simulation() # initialize simulation environment │ server = Resource(sim, num_servers) # initialize servers │ arrival_time = 0.0 │ for i = 1:num_customers # initialize customers │ arrival_time += rand(rng,arrival_dist) │ @process customer(sim, server, i, arrival_time, service_dist) │ end │ run(sim) # run simulation │ end │ setup_and_run() │ │ # output │ Customer 1 arrived: 0.14518451436852475 │ Customer 1 entered service: 0.14518451436852475 │ Customer 2 arrived: 0.5941831542903504 │ Customer 2 entered service: 0.5941831542903504 │ Customer 3 arrived: 1.5490648267819074 │ Customer 4 arrived: 1.6242796925312217 │ Customer 5 arrived: 1.6911000709069648 │ Customer 1 exited service: 2.200985520126681 │ Customer 3 entered service: 2.200985520126681 │ Customer 6 arrived: 2.2989039524296317 │ Customer 3 exited service: 3.5822120399442174 │ Customer 4 entered service: 3.5822120399442174 │ Customer 7 arrived: 4.377930221620456 │ Customer 8 arrived: 5.16494279700802 │ Customer 2 exited service: 5.900722829377648 │ Customer 5 entered service: 5.900722829377648 │ Customer 9 arrived: 7.0099944106308705 │ Customer 10 arrived: 7.828990220943469 │ Customer 5 exited service: 9.634196437885254 │ Customer 6 entered service: 9.634196437885254 │ Customer 4 exited service: 9.670688398447817 │ Customer 7 entered service: 9.670688398447817 │ Customer 7 exited service: 15.066978111608014 │ Customer 8 entered service: 15.066978111608014 │ Customer 8 exited service: 16.655548432659554 │ Customer 9 entered service: 16.655548432659554 │ Customer 6 exited service: 17.401833154870328 │ Customer 10 entered service: 17.401833154870328 │ Customer 9 exited service: 17.586065352135993 │ Customer 10 exited service: 18.690264775280085 │ ``` │ │ Subexpression: │ │ using StableRNGs │ using Distributions │ using ConcurrentSim │ using ResumableFunctions │ │ #set simulation parameters │ rng = StableRNG(123) │ num_customers = 10 # total number of customers generated │ │ # set queue parameters │ num_servers = 2 # number of servers │ mu = 1.0 / 2 # service rate │ lam = 0.9 # arrival rate │ arrival_dist = Exponential(1 / lam) # interarrival time distribution │ service_dist = Exponential(1 / mu) # service time distribution │ │ # define customer behavior │ @resumable function customer(env::Environment, server::Resource, id::Integer, t_a::Float64, d_s::Distribution) │ @yield timeout(env, t_a) # customer arrives │ println("Customer $id arrived: ", now(env)) │ @yield request(server) # customer starts service │ println("Customer $id entered service: ", now(env)) │ @yield timeout(env, rand(rng,d_s)) # server is busy │ @yield unlock(server) # customer exits service │ println("Customer $id exited service: ", now(env)) │ end │ │ # setup and run simulation │ function setup_and_run() │ sim = Simulation() # initialize simulation environment │ server = Resource(sim, num_servers) # initialize servers │ arrival_time = 0.0 │ for i = 1:num_customers # initialize customers │ arrival_time += rand(rng,arrival_dist) │ @process customer(sim, server, i, arrival_time, service_dist) │ end │ run(sim) # run simulation │ end │ setup_and_run() │ │ Evaluated output: │ │ Precompiling packages... │ 17651.4 ms ✓ Distributions │ 1 dependency successfully precompiled in 18 seconds. 46 already precompiled. │ Precompiling packages... │ 3566.5 ms ✓ Distributions → DistributionsTestExt │ 1 dependency successfully precompiled in 4 seconds. 49 already precompiled. │ Customer 1 arrived: 0.14518451436852475 │ Customer 1 entered service: 0.14518451436852475 │ Customer 2 arrived: 0.5941831542903504 │ Customer 2 entered service: 0.5941831542903504 │ Customer 3 arrived: 1.5490648267819074 │ Customer 4 arrived: 1.6242796925312217 │ Customer 5 arrived: 1.6911000709069648 │ Customer 1 exited service: 2.200985520126681 │ Customer 3 entered service: 2.200985520126681 │ Customer 6 arrived: 2.2989039524296317 │ Customer 3 exited service: 3.5822120399442174 │ Customer 4 entered service: 3.5822120399442174 │ Customer 7 arrived: 4.377930221620456 │ Customer 8 arrived: 5.16494279700802 │ Customer 2 exited service: 5.900722829377648 │ Customer 5 entered service: 5.900722829377648 │ Customer 9 arrived: 7.0099944106308705 │ Customer 10 arrived: 7.828990220943469 │ Customer 5 exited service: 9.634196437885254 │ Customer 6 entered service: 9.634196437885254 │ Customer 4 exited service: 9.670688398447817 │ Customer 7 entered service: 9.670688398447817 │ Customer 7 exited service: 15.066978111608014 │ Customer 8 entered service: 15.066978111608014 │ Customer 8 exited service: 16.655548432659554 │ Customer 9 entered service: 16.655548432659554 │ Customer 6 exited service: 17.401833154870328 │ Customer 10 entered service: 17.401833154870328 │ Customer 9 exited service: 17.586065352135993 │ Customer 10 exited service: 18.690264775280085 │ │ Expected output: │ │ Customer 1 arrived: 0.14518451436852475 │ Customer 1 entered service: 0.14518451436852475 │ Customer 2 arrived: 0.5941831542903504 │ Customer 2 entered service: 0.5941831542903504 │ Customer 3 arrived: 1.5490648267819074 │ Customer 4 arrived: 1.6242796925312217 │ Customer 5 arrived: 1.6911000709069648 │ Customer 1 exited service: 2.200985520126681 │ Customer 3 entered service: 2.200985520126681 │ Customer 6 arrived: 2.2989039524296317 │ Customer 3 exited service: 3.5822120399442174 │ Customer 4 entered service: 3.5822120399442174 │ Customer 7 arrived: 4.377930221620456 │ Customer 8 arrived: 5.16494279700802 │ Customer 2 exited service: 5.900722829377648 │ Customer 5 entered service: 5.900722829377648 │ Customer 9 arrived: 7.0099944106308705 │ Customer 10 arrived: 7.828990220943469 │ Customer 5 exited service: 9.634196437885254 │ Customer 6 entered service: 9.634196437885254 │ Customer 4 exited service: 9.670688398447817 │ Customer 7 entered service: 9.670688398447817 │ Customer 7 exited service: 15.066978111608014 │ Customer 8 entered service: 15.066978111608014 │ Customer 8 exited service: 16.655548432659554 │ Customer 9 entered service: 16.655548432659554 │ Customer 6 exited service: 17.401833154870328 │ Customer 10 entered service: 17.401833154870328 │ Customer 9 exited service: 17.586065352135993 │ Customer 10 exited service: 18.690264775280085 │ │ diff = │ Warning: Diff output requires color. │ Precompiling packages... │ 17651.4 ms ✓ Distributions │ 1 dependency successfully precompiled in 18 seconds. 46 already precompiled. │ Precompiling packages... │ 3566.5 ms ✓ Distributions → DistributionsTestExt │ 1 dependency successfully precompiled in 4 seconds. 49 already precompiled. │ Customer 1 arrived: 0.14518451436852475 │ Customer 1 entered service: 0.14518451436852475 │ Customer 2 arrived: 0.5941831542903504 │ Customer 2 entered service: 0.5941831542903504 │ Customer 3 arrived: 1.5490648267819074 │ Customer 4 arrived: 1.6242796925312217 │ Customer 5 arrived: 1.6911000709069648 │ Customer 1 exited service: 2.200985520126681 │ Customer 3 entered service: 2.200985520126681 │ Customer 6 arrived: 2.2989039524296317 │ Customer 3 exited service: 3.5822120399442174 │ Customer 4 entered service: 3.5822120399442174 │ Customer 7 arrived: 4.377930221620456 │ Customer 8 arrived: 5.16494279700802 │ Customer 2 exited service: 5.900722829377648 │ Customer 5 entered service: 5.900722829377648 │ Customer 9 arrived: 7.0099944106308705 │ Customer 10 arrived: 7.828990220943469 │ Customer 5 exited service: 9.634196437885254 │ Customer 6 entered service: 9.634196437885254 │ Customer 4 exited service: 9.670688398447817 │ Customer 7 entered service: 9.670688398447817 │ Customer 7 exited service: 15.066978111608014 │ Customer 8 entered service: 15.066978111608014 │ Customer 8 exited service: 16.655548432659554 │ Customer 9 entered service: 16.655548432659554 │ Customer 6 exited service: 17.401833154870328 │ Customer 10 entered service: 17.401833154870328 │ Customer 9 exited service: 17.586065352135993 │ Customer 10 exited service: 18.690264775280085 └ @ Documenter ~/.julia/packages/ConcurrentSim/V71SQ/docs/src/examples/mmc.md:9 ┌ Error: doctest failure in ../docs/src/guides/events.md:39-61 │ │ ```jldoctest │ julia> using ConcurrentSim │ │ julia> function my_callback(ev::AbstractEvent) │ println("Called back from ", ev) │ end │ my_callback (generic function with 1 method) │ │ julia> sim = Simulation() │ ConcurrentSim.Simulation time: 0.0 active_process: nothing │ │ julia> ev = Event(sim) │ ConcurrentSim.Event 1 │ │ julia> @callback my_callback(ev) │ #1 (generic function with 1 method) │ │ julia> succeed(ev) │ ConcurrentSim.Event 1 │ │ julia> run(sim) │ Called back from ConcurrentSim.Event 1 │ ``` │ │ Subexpression: │ │ @callback my_callback(ev) │ │ Evaluated output: │ │ #append_callback##0 (generic function with 1 method) │ │ Expected output: │ │ #1 (generic function with 1 method) │ │ diff = │ Warning: Diff output requires color. │ #1 #append_callback##0 (generic function with 1 method) └ @ Documenter ~/.julia/packages/ConcurrentSim/V71SQ/docs/src/guides/events.md:39 ┌ Error: Doctesting failed │ exception = │ `makedocs` encountered a doctest error. Terminating build │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] runner(::Type{Documenter.Builder.Doctest}, doc::Documenter.Document) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/builder_pipeline.jl:213 │ [3] dispatch(::Type{Documenter.Builder.DocumentPipeline}, x::Documenter.Document) │ @ Documenter.Selectors ~/.julia/packages/Documenter/eoWm2/src/utilities/Selectors.jl:170 │ [4] #89 │ @ ~/.julia/packages/Documenter/eoWm2/src/makedocs.jl:280 [inlined] │ [5] withenv(::Documenter.var"#89#90"{Documenter.Document}, ::Pair{String, Nothing}, ::Vararg{Pair{String, Nothing}}) │ @ Base ./env.jl:265 │ [6] #87 │ @ ~/.julia/packages/Documenter/eoWm2/src/makedocs.jl:279 [inlined] │ [7] cd(f::Documenter.var"#87#88"{Documenter.Document}, dir::String) │ @ Base.Filesystem ./file.jl:112 │ [8] makedocs(; debug::Bool, format::Documenter.HTMLWriter.HTML, kwargs::@Kwargs{root::String, source::String, sitename::String, doctest::Symbol, modules::Vector{Module}, doctestfilters::Vector{Regex}, remotes::Nothing, plugins::Vector{Documenter.Plugin}}) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/makedocs.jl:278 │ [9] kwcall(::@NamedTuple{root::String, source::String, sitename::String, doctest::Symbol, modules::Vector{Module}, doctestfilters::Vector{Regex}, remotes::Nothing, plugins::Vector{Documenter.Plugin}}, ::typeof(Documenter.makedocs)) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/makedocs.jl:271 │ [10] (::Documenter.var"#all_doctests#141"{Bool, Vector{Regex}, Vector{Documenter.Plugin}, Vector{Module}})() │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:85 │ [11] macro expansion │ @ ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 [inlined] │ [12] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:745 [inlined] │ [13] macro expansion │ @ ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 [inlined] │ [14] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1948 [inlined] │ [15] doctest(source::String, modules::Vector{Module}; fix::Bool, testset::String, doctestfilters::Vector{Regex}, plugins::Vector{Documenter.Plugin}) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 │ [16] doctest │ @ ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:69 [inlined] │ [17] doctest(package::Module; manual::Bool, testset::Nothing, kwargs::@Kwargs{}) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:37 │ [18] doctest(package::Module) │ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:20 │ [19] top-level scope │ @ ~/.julia/packages/ConcurrentSim/V71SQ/test/test_doctests.jl:5 │ [20] include(mapexpr::Function, mod::Module, _path::String) │ @ Base ./Base.jl:309 │ [21] top-level scope │ @ ~/.julia/packages/SafeTestsets/raUNr/src/SafeTestsets.jl:21 │ [22] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1948 [inlined] │ [23] macro expansion │ @ ~/.julia/packages/ConcurrentSim/V71SQ/test/runtests.jl:21 [inlined] │ [24] eval(m::Module, e::Any) │ @ Core ./boot.jl:489 │ [25] top-level scope │ @ ~/.julia/packages/ConcurrentSim/V71SQ/test/runtests.jl:20 │ [26] macro expansion │ @ ~/.julia/packages/SafeTestsets/raUNr/src/SafeTestsets.jl:28 [inlined] │ [27] include(mapexpr::Function, mod::Module, _path::String) │ @ Base ./Base.jl:309 │ [28] top-level scope │ @ none:6 │ [29] eval(m::Module, e::Any) │ @ Core ./boot.jl:489 │ [30] exec_options(opts::Base.JLOptions) │ @ Base ./client.jl:296 │ [31] _start() │ @ Base ./client.jl:563 └ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:99 Doctests: ConcurrentSim: Test Failed at /home/pkgeval/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 Expression: all_doctests() Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:748 [inlined] [2] macro expansion @ ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1948 [inlined] [4] doctest(source::String, modules::Vector{Module}; fix::Bool, testset::String, doctestfilters::Vector{Regex}, plugins::Vector{Documenter.Plugin}) @ Documenter ~/.julia/packages/Documenter/eoWm2/src/doctest.jl:110 Test Summary: | Fail Total Time doctests | 1 1 1m51.6s Doctests: ConcurrentSim | 1 1 1m42.3s RNG of the outermost testset: Random.Xoshiro(0x07c1c0712ad3e520, 0xe1de1ae4a8f32822, 0x6bf91d0f27d5bf1f, 0xc3d0c865c62c110d, 0x23ef1d33580e907c) ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ConcurrentSim/V71SQ/test/runtests.jl:42 Testing failed after 205.63s ERROR: LoadError: Package ConcurrentSim errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2673 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2522 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:538 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:515 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:168 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:157 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [9] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:155 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [12] include(mod::Module, _path::String) @ Base ./Base.jl:308 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:330 [14] _start() @ Base ./client.jl:563 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 261.4s: package has test failures