7,649
edits
Changes
Jump to navigation
Jump to search
→Usage of pix2code on RDP
To generate GUI to HTML:
cd compiler
./web-compiler.py ./code/test_imgtest.gui
==Discussion==
While pix2code can preserve the structure of the HTML page quite well, it cannot preserve the contents of the website. Most of the texts from the original page are distorted in the generated DSL. Moreover, pix2code is extremely expensive to train and the current model only works for very simple GUIs that are similar to ones in the training set. Hence, pix2code model would not be suited for building an information extractor. However, we can learn from the source code how to input and structure GUI data and construct LSTM networks on top of GUI and output DSL code.
