Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Automatic script generator #701

Open
wants to merge 113 commits into
base: master
Choose a base branch
from
Open

WIP: Automatic script generator #701

wants to merge 113 commits into from

Conversation

cetygamer
Copy link
Contributor

@cetygamer cetygamer commented Apr 1, 2019 •
edited by vasily-v-ryabov

Implements feature #332.

Everything implemented in folder pywinauto/recorder.

Recorder saves control hierarchy of application using class ControlTree. Using that class recorder can determine which element user has clicked on even if that element doesn't already exist.

Recorder uses UI Automation event handlers to monitor events generated by control of the application.

Based on all that data and some predefined event patterns recorder generates pywinauto-friednly python script that should repeat user's action upon execution.

EDIT (by @vasily-v-ryabov):
Example of usage:

C:\Python27\python.exe .\pywinauto\recorder\recorder_cli.py -b uia --cmd .\apps\WPF_samples\WpfApplication1.exe -v -o recorded_wpf.py

@cetygamer
some pep8 corrections
25251f8
@cetygamer
add Recorder class to monitor UIA events
e1efd6a
@cetygamer
add more info to the output
c13d944
@cetygamer
added keyboard and mouse hooks
ff8f17b
@cetygamer
added contains method to RECT structure
42d7ba7
@cetygamer
added ControlTree class to represent apps controls
59ce993
@cetygamer
trying to parse event log
f4e7ff2
@cetygamer
Added doc strings
52b32b0
@cetygamer
Merge branch 'master' of https://github.com/pywinauto/pywinauto into …
9e7191e 
…dev-script-generator
@cetygamer
parse event log one last time before app.kill()
3c08833
@cetygamer
added basic implementation of menu_select parsing
f6909ec
@cetygamer
improve speed of ControlTree
4be48fe
@cetygamer
fixed getting control names in ControlTree
a11287f
@cetygamer
pep8 edits
02e5669
@cetygamer
allow only uia Application object
ae3f605
@cetygamer
fixed recorder freezing
7d58f99
@cetygamer
Merge branch 'dev-script-generator' of https://github.com/cetygamer/p…
20e08aa 
…ywinauto into dev-script-generator

# Conflicts:
#	pywinauto/script_generator/control_tree.py
#	pywinauto/script_generator/uiarecorder.py
@cetygamer
fixed merging
b1ddaa7
@cetygamer
Merge branch 'master' of https://github.com/cetygamer/pywinauto into …
c2ac619 
…dev-script-generator
@cetygamer
fixed detecting closing the window
8326e12
@cetygamer
fixed python 2 compatibility
bc14718
@cetygamer
added wait function and removed sleep after hook event (mouse lag)
cbce4f1
@cetygamer
updated recorder test using wait function
e98ddd4
@cetygamer
refactor recodrer using event class hierarchy
19e647d
@cetygamer
use IUIA function to compare UIA elements
fa0deea
@cetygamer
fix KeyboardEvent creation in win32_hooks.py, create LogParser class
e4fa158
@cetygamer
parse log on any mouse click
fd3fa12
@cetygamer
added prototype for keyboard input parsing (combined)
ce112f8
@cetygamer
fix python exception in click_input
d5ac266
@cetygamer
create structure for different backend recorders
0f450db
@cetygamer cetygamer force-pushed the dev-script-generator branch 6 times, most recently from 62f3117 to ff8ce13 Compare June 9, 2019 11:29
@lgtm-com
Copy link

lgtm-com bot commented Jun 9, 2019

This pull request fixes 2 alerts when merging 19867af into 06b4945 - view on LGTM.com

fixed alerts:

  • 2 for Unused local variable

@pywinauto pywinauto deleted a comment from lgtm-com bot Jun 9, 2019
@pywinauto pywinauto deleted a comment from lgtm-com bot Jun 9, 2019
@pywinauto pywinauto deleted a comment from lgtm-com bot Jun 9, 2019
@pywinauto pywinauto deleted a comment from lgtm-com bot Jun 9, 2019
@vasily-v-ryabov vasily-v-ryabov mentioned this pull request Apr 2, 2020
Closed
@jjbright
Copy link

@vasily-v-ryabov I'm waiting on this.... how soon we can get this?

@vasily-v-ryabov
Copy link
Contributor

@jjbright Currently nobody is working on this. My first priority is major release with Linux and macOS support + some re-factoring to make pywinauto API easier. This 0.7.0 release should happen till end of 2020 (exact deadline can't be set because this is a hobby project for all of us).

Script recorder will get its chance in 2021 with current available resources.

@jjbright
Copy link

@vasily-v-ryabov Thank you for responding quickly. I too see the good news as make pywinauto easier. I can't wait though, perhaps I've to struggle and get the automation with version 0.6.8.

Meanwhile, I made another request and tagged you as well... if you could show some line on that..., it would be a great help

@vasily-v-ryabov vasily-v-ryabov mentioned this pull request May 4, 2020
Closed
@vasily-v-ryabov vasily-v-ryabov mentioned this pull request Dec 23, 2020
Closed
@vasily-v-ryabov vasily-v-ryabov mentioned this pull request May 16, 2021
Open
@vasily-v-ryabov vasily-v-ryabov mentioned this pull request Mar 26, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@vasily-v-ryabov vasily-v-ryabov vasily-v-ryabov left review comments

Assignees

@vasily-v-ryabov vasily-v-ryabov

Labels
PR-in-progress
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
5 participants
@cetygamer @airelil @jjbright @vasily-v-ryabov @drinkertea