Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

UtExecutionInstrumentation does not respect timeout in concrete execution #1726

Closed
Domonion opened this issue Jan 20, 2023 · 2 comments · Fixed by #1728
Closed

UtExecutionInstrumentation does not respect timeout in concrete execution #1726

Domonion opened this issue Jan 20, 2023 · 2 comments · Fixed by #1728
Assignees
@Domonion @sergeypospelov
Labels
comp-contest-estimator Issue is related to contest estimator comp-instrumented-process Issue is related to Instrumented process ctg-bug Issue is a bug

Comments

@Domonion
Copy link
Collaborator

Description

Currently UtExecutionInstrumentation measures only concrete execution, but not model construction for parameters and execution result.

Sometimes model construction might take too much time and will hang Instrumentation process indefenitely. This occurs too often in Contest Estimator, but problem relates to plugin too.

To Reproduce

Steps to reproduce the behavior:

  1. In ContestEstimator.kt set:
    • set javaHome to JDK8
    • timeLimit=120
    • projectFilter = listOf("guava-26.0")
    • set utbot-junit-contest/src/main/resources/classes/guava-26.0/list to
    com.google.common.primitives.Booleans
com.google.common.primitives.Shorts
  2. Start ContestEstimator
  3. Tests for class Shorts once in a 2-3 generations will not be generated at all

Expected behavior

Everything works

Actual behavior

Tests for Short does not generate, Instrumentation process hangs on some requrest.
@Domonion Domonion added the ctg-bug Issue is a bug label Jan 20, 2023
@Domonion Domonion self-assigned this Jan 20, 2023
@alisevych alisevych added comp-contest-estimator Issue is related to contest estimator comp-instrumented-process Issue is related to Instrumented process labels Jan 20, 2023
@alisevych
Copy link
Member

Connected issue:

@Domonion
Copy link
Collaborator Author

possible.patch.txt
Possible patch, verification required

Domonion added a commit that referenced this issue Jan 20, 2023
@Domonion
Possible fix for #1726, verification requored
3a852f6
@Domonion Domonion mentioned this issue Jan 20, 2023
Merged
Markoutte pushed a commit that referenced this issue Jan 20, 2023
@Domonion @Markoutte
Possible fix for #1726, verification requored
a5c350d
Domonion added a commit that referenced this issue Jan 25, 2023
@Domonion
[utbot-rider]
20870a2 
1. New timeouts system for contest estimator.
2. Concrete execution phases redesign
Fix #1726
Possible fix #1718
Domonion added a commit that referenced this issue Jan 26, 2023
@Domonion
[utbot-rider]
70d099a 
1. New timeouts system for contest estimator.
2. Concrete execution phases redesign
Fix #1726
Possible fix #1718
Domonion added a commit that referenced this issue Jan 26, 2023
@Domonion
[utbot-rider]
72d7dad 
1. New timeouts system for contest estimator.
2. Concrete execution phases redesign
Fix #1726
Possible fix #1718
Domonion added a commit that referenced this issue Jan 27, 2023
@Domonion
[utbot-java]
8be517b 
1. New timeouts system for contest estimator.
2. Concrete execution phases redesign
Fix #1726
Possible fix #1718
Domonion added a commit that referenced this issue Jan 27, 2023
@Domonion @sergeypospelov
Redesign for Concrete Executor timeout (#1728)
eaf4b55 
* Create ResultAndErrorHandlingApiOfTheInstrumentedProcess.md

* [utbot-java]
1. New timeouts system for contest estimator.
2. Concrete execution phases redesign
Fix #1726
Possible fix #1718

* [utbot-java]
If docker image for monitoring is not available - CI should continue
even without monitoring

* [utbot-java]
Mockito warmup as it takes too much time in tests to initialize it

* [utbot-java]
Providing additional auxiliary log information when running in docker

* Fix: document

* [utbot-java]
Review fix

Co-authored-by: Sergey Pospelov <[email protected]>
@github-project-automation github-project-automation bot moved this from Todo to Done in UTBot Java Jan 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Domonion Domonion

@sergeypospelov sergeypospelov

Labels
comp-contest-estimator Issue is related to contest estimator comp-instrumented-process Issue is related to Instrumented process ctg-bug Issue is a bug
Projects
UTBot Java
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Redesign for Concrete Executor timeout UnitTestBot/UTBotJava
3 participants
@Domonion @sergeypospelov @alisevych