ChangeYourWalls

Do you want to paint the walls or re-glue them altogether? But you're not quite sure they'll match the surroundings? This program allows to change the walls by the given pattern. This program aims to help with your interior update.

Requirements:

• CUDA 9.2+

How to use

• upload a pattern into demo/patterns dir
• upload your interior image into demo/source dir
• segment the interior with get_seg.py
• run main.py, select four corners (top left, top-right, bottom-right, bottom-left) with Left Botton of your mouse.
• • Click middle mouse button to apply the pattern on the selected corners
• • Click right button to delete the last selected corner (if it doesn't seem correct)

You can either select rectangle wall parts one-by-one or just select the bounding four corners to apply the pattern.

See *.py --help to see additional info. Just play with it!

Build a docker

docker build --build-arg UID="$(id -u)" --build-arg GID="$(id -g)" --build-arg UNAME="auto" -t mmseg_wall -f Dockerfile .

Run docker and get segmentation mask for the image

docker run --rm -it --gpus all --net=host --ipc=host -e DISPLAY=$DISPLAY -v /tmp/.X11-unix:/tmp/.X11-unix -v $HOME/.Xauthority:/home/auto/.Xauthority -v $PWD:/home/auto/ mmseg_wall

Download the model and config

mim download mmsegmentation --config pspnet_r101-d8_480x480_80k_pascal_context_59 --dest models/

Get the mask of the interior (to mask selected objects (ex., a wall))

python3 get_seg.py --image demo/source/test.png --output demo/mask/test.png --obj_class wall --device cuda

get the pattern

python3 main.py --image demo/source/test.png --mask demo/mask/test.png --pattern demo/patterns/texture_1.jpg 

After you finish, just hit any botton. Results are saved in demo/results dir

TODO:

• create tg bot @nikultimo
• automate corners selection
• play with various models. Improve the mask accuracy
• Add online pattern change wrt selected corners
• add weighted sum coefficients adjusting

References

• MMSegmentation