How to compile .html files?

[farzher]

If I have an html file

<div>sup</div>

How can I compile that into something I can then use in my .js file

Am I supposed to prepend all my compiled .html templates output into my main.js file?
And somehow use grult/gulp to prepend templates[filename] = before each compiled template?