download out-of-domain iframes

[kmike]

When iframe is in a page it makes sense to get its content even if it is not in allowed domain. Maybe we shouldn't follow links in this case though.

[lopuhin]

Yeah, unless the iframe links point to the parent domain. I think ideally, the iframe should be included into the parent page contents in this case.

[kmike]

Yeah, I agree. There is QWebSettings::FrameFlatteningEnabled option (http://qutebrowser.org/tmp/qtdoc-linktitle/qwebsettings.html), maybe it could work for Splash. Alternatively, there is an API to go into iframes in QtWebKit (but not in upcoming QtWebEngine); is is already used by render.json endpoint, and we can create a Lua API for that if FrameFlatteningEnabled doesn't work.

[kmike]

Frame flattening option doesn't seem to work - I've tried it here scrapinghub/splash@8eb45d8, splash:html() doesn't include html content of iframes.