Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LogOracle: initial implementation #302

Merged
merged 8 commits into from
Jan 9, 2024
Merged

LogOracle: initial implementation #302

merged 8 commits into from
Jan 9, 2024

Conversation

stsnel
Copy link
Collaborator

@stsnel stsnel commented Apr 29, 2022

An "almost for free" Oracle for detecting suspicious messages in log files and/or standard output of commands.

@pekkakaho pekkakaho mentioned this pull request May 24, 2022
Closed
@ferpasri
Merge branch 'master' into sietse-logoracle
49006a6
@ferpasri
Update LogOracle and add a SUT example
3c108e9 
- TESTAR internal flow executes two times getVerdict between actions.
We need to maintain a list of log errors in the LogOracle class because the first getVerdict execution reads and empties the log verdict information.
- Add an example of usage with PrintLogFile SUT + desktop_generic_log_oracle protocol
- Add settings structure
@ferpasri
Copy link
Member

ferpasri commented Dec 20, 2022 •
edited

To make this feature more generic, we need to prepare some small improvements:

  • Remove part of the console system output prints
  • Currently, the user can indicate all log files that TESTAR reads to apply log oracles. We want to improve the log reading feature to read if a new log exists in a system directory because the name of the log can be automatically generated in runtime.
  • Prepare a FileHandling classification “suspicious_log”

@ferpasri ferpasri requested review from ramondevries and removed request for pekkakaho December 20, 2022 09:25
@ferpasri ferpasri added this to TODO in New test oracles for TESTAR via automation Dec 20, 2022
@ferpasri
Merge branch 'master' into sietse-logoracle
f51e214
@ferpasri
LogOracles tests and copyright updates
1428ac7 
- Add Copyright to LogOracle classes
- Remove specific "desktop_generic_log_oracle" to avoid the increase of protocols
- Create "sequences_suspicious_log" folder when LogOracle detected
- Add TestLogOracles
@ramondevries ramondevries linked an issue Nov 7, 2023 that may be closed by this pull request
Generic oracle: crash dumps check with dynamic files #271
Open
@ferpasri
Merge branch 'master' into sietse-logoracle
0102233
@ferpasri
LogOracle: update settings package
6edfa77
@ferpasri
Update LogOracle
313fcc1 
- Move some trace prints to the log file
- Initialize the logOracle in preSequencePreparations
ferpasri
ferpasri approved these changes Jan 9, 2024
View reviewed changes
Copy link
Member

@ferpasri ferpasri left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Initial LogOracle implementation that allows detecting suspicious titles in log files and system command outputs

@ferpasri ferpasri merged commit a672965 into master Jan 9, 2024
5 checks passed
New test oracles for TESTAR automation moved this from TODO to Done Jan 9, 2024
@ferpasri ferpasri mentioned this pull request Jan 9, 2024
Open
@ferpasri ferpasri deleted the sietse-logoracle branch February 26, 2024 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ferpasri ferpasri ferpasri approved these changes

@ramondevries ramondevries Awaiting requested review from ramondevries

Assignees

@ferpasri ferpasri

Labels
priority: medium status: not assigned type: technical feature request
Projects
New test oracles for TESTAR
Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Generic oracle: crash dumps check with dynamic files
4 participants
@stsnel @ferpasri @ramondevries @pekkakaho